\dm_csml_event_details UCL ELLIS

Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods


Speaker

Mark Girolami

Affiliation

UCL

Date

Friday, 27 April 2012

Time

12:30-14:00

Location

Zoom

Link

Darwin B15 Biochemistry LT

Event series

DeepMind/ELLIS CSML Seminar Series

Abstract

Markov chain Monte Carlo (MCMC) provides the dominant methodology for inference over statistical models with non-conjugate priors. Despite a wealth of theoretical characterisation of mixing times, geometric ergodicity, and asymptotic step-sizes, the design and implementation of MCMC methods remains something of an engineering art-form. An attempt to address this issue in a systematic manner leads one to consider the geometry of probability distributions, as has been the case previously in the study of e.g. higher-order efficiency in statistical estimators. By considering the natural Riemannian geometry of probability distributions MCMC proposal mechanisms based on Langevin diffusions that are characterised by the metric tensor and associated manifold connections are proposed and studied. Furthermore, optimal proposals that follow the geodesic paths related to the metric are defined via the Hamilton-Jacobi approach and these are empirically evaluated on some challenging modern-day inference tasks. Finally the exploitation of foliations in defining proposal mechanisms for hierarchical Bayesian models provides a tantalising glimpse of potential general methodology for efficient sampling for these notoriously challenging problems.

Slides for the talk: PDF

Biography