Lecture “Bayesian Learning”

General Information

Topics

Bayesian learning is a category of machine learning methods, which are based on a basic law of probability, called Bayes’ theorem. As advantages, Bayesian learning offers assessment of the estimation quality and model selection functionality in a single framework, while as disadvantages, it requires “integral” computation, which often is a bottleneck. In this course, we introduce Bayesian learning, discuss pros and cons, how to perform the integral computation based on “conjugacy”, and how to approximate Bayesian learning when it is intractable.

The course covers

• Bayesian modeling and model selection.
• Bayesian learning in conjugate cases.
• Approximate Bayesian learning in conditionally conjugate cases:
  • Gibbs sampling
  • variational Bayesian learning.
• Approximate Bayesian learning in non-conjugate cases:
  • Metropolis-Hastings algorithm.
  • local variational approximation.
  • expectation propagation.