UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Optimal tuning of the hybrid Monte Carlo algorithm

Beskos, A; Pillai, N; Roberts, G; Sanz-Serna, J-M; Stuart, A; (2013) Optimal tuning of the hybrid Monte Carlo algorithm. Bernoulli , 19 (5A) pp. 1501-1534. 10.3150/12-BEJ414. Green open access


Download (332kB) | Preview


We investigate the properties of the hybrid Monte Carlo algorithm (HMC) in high dimensions. HMC develops a Markov chain reversible with respect to a given target distribution Π using separable Hamiltonian dynamics with potential −logΠ. The additional momentum variables are chosen at random from the Boltzmann distribution, and the continuous-time Hamiltonian dynamics are then discretised using the leapfrog scheme. The induced bias is removed via a Metropolis–Hastings accept/reject rule. In the simplified scenario of independent, identically distributed components, we prove that, to obtain an O(1) acceptance probability as the dimension d of the state space tends to ∞, the leapfrog step size h should be scaled as h=l×d−1/4. Therefore, in high dimensions, HMC requires O(d1/4) steps to traverse the state space. We also identify analytically the asymptotically optimal acceptance probability, which turns out to be 0.651 (to three decimal places). This value optimally balances the cost of generating a proposal, which decreases as l increases (because fewer steps are required to reach the desired final integration time), against the cost related to the average number of proposals required to obtain acceptance, which increases as l increases.

Type: Article
Title: Optimal tuning of the hybrid Monte Carlo algorithm
Open access status: An open access version is available from UCL Discovery
DOI: 10.3150/12-BEJ414
Publisher version: http://dx.doi.org/10.3150/12-BEJ414
Language: English
Additional information: Copyright © 2013 ISI/BS.
Keywords: Hamiltonian dynamics, high dimensions, optimal acceptance probability, leapfrog scheme, squared jumping distance
UCL classification: UCL > School of BEAMS
UCL > School of BEAMS > Faculty of Maths and Physical Sciences
URI: http://discovery.ucl.ac.uk/id/eprint/77553
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item