UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Auxiliary variational MCMC

Habib, R; Barber, D; (2019) Auxiliary variational MCMC. In: Proceedings of the 7th International Conference on Learning Representations, ICLR 2019. (pp. pp. 1-13). International Conference on Learning Representations Green open access

[thumbnail of auxiliary_variational_mcmc.pdf]
Preview
Text
auxiliary_variational_mcmc.pdf - Accepted Version

Download (395kB) | Preview

Abstract

We introduce Auxiliary Variational MCMC, a novel framework for learning MCMC kernels that combines recent advances in variational inference with insights drawn from traditional auxiliary variable MCMC methods such as Hamiltonian Monte Carlo. Our framework exploits low dimensional structure in the target distribution in order to learn a more efficient MCMC sampler. The resulting sampler is able to suppress random walk behaviour and mix between modes efficiently, without the need to compute gradients of the target distribution. We test our sampler on a number of challenging distributions, where the underlying structure is known, and on the task of posterior sampling in Bayesian logistic regression. Code to reproduce all experiments is available at https://github.com/AVMCMC.

Type: Proceedings paper
Title: Auxiliary variational MCMC
Event: 7th International Conference on Learning Representations, ICLR 2019
Open access status: An open access version is available from UCL Discovery
Publisher version: https://openreview.net/forum?id=r1NJqsRctX
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher's terms and conditions.
Keywords: MCMC, Variational Inference
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10097110
Downloads since deposit
272Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item