9 docs tagged with "bayesian-statistics"

Bayes factors, marginal likelihood, BIC and AIC from a Bayesian perspective, Occam's razor via model evidence, and practical model selection in ML.

How Bayesian thinking transforms ML - uncertainty quantification, priors as regularization, probabilistic programming, and principled model comparison. Module map and learning objectives.

Sequential Bayesian updating, online learning, the Beta-Bernoulli stream, and the Kalman filter as Bayesian updating - how beliefs evolve as data arrives.

The philosophical divide between Bayesian and frequentist probability - concrete examples, when each approach is better, and how the choice shapes ML system design.

GP priors over functions, kernel functions (RBF, Matérn, periodic), GP regression with posterior mean and variance, hyperparameter optimization, and Bayesian optimization for ML hyperparameter tuning.

Hierarchical Bayesian models, partial pooling, multilevel regression, and the connection to multi-task learning - sharing information across groups with sparse data.

Why MCMC is needed, Metropolis-Hastings algorithm, Gibbs sampling, convergence diagnostics (R-hat, trace plots), and practical Bayesian inference with PyMC.

Choosing priors, conjugate distributions, posterior derivation via Bayes theorem, MAP estimation, and sensitivity analysis - the foundations of practical Bayesian ML.

ELBO derivation, mean-field variational inference, VI vs MCMC tradeoffs, the reparameterization trick, and variational autoencoders - scalable approximate Bayesian inference.