Speaker |
Mark Girolami |
|---|---|
Affiliation |
UCL |
Date |
Friday, 27 April 2012 |
Time |
12:30-14:00 |
Location |
Zoom |
Link |
Darwin B15 Biochemistry LT |
Event series |
DeepMind/ELLIS CSML Seminar Series |
Abstract |
Markov chain Monte Carlo (MCMC) provides the dominant methodology for inference over statistical models with non-conjugate priors. Despite a wealth of theoretical characterisation of mixing times, geometric ergodicity, and asymptotic step-sizes, the design and implementation of MCMC methods remains something of an engineering art-form. An attempt to address this issue in a systematic manner leads one to consider the geometry of probability distributions, as has been the case previously in the study of e.g. higher-order efficiency in statistical estimators. By considering the natural Riemannian geometry of probability distributions MCMC proposal mechanisms based on Langevin diffusions that are characterised by the metric tensor and associated manifold connections are proposed and studied. Furthermore, optimal proposals that follow the geodesic paths related to the metric are defined via the Hamilton-Jacobi approach and these are empirically evaluated on some challenging modern-day inference tasks. Finally the exploitation of foliations in defining proposal mechanisms for hierarchical Bayesian models provides a tantalising glimpse of potential general methodology for efficient sampling for these notoriously challenging problems. Slides for the talk: PDF |
Biography |