UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Reinforcement learning of rare diffusive dynamics

Das, A; Rose, DC; Garrahan, JP; Limmer, DT; (2021) Reinforcement learning of rare diffusive dynamics. Journal of Chemical Physics , 155 (13) , Article 134105. 10.1063/5.0057323. Green open access

[thumbnail of 5.0057323.pdf]
Preview
Text
5.0057323.pdf - Published Version

Download (8MB) | Preview

Abstract

We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, such as those relevant in the study of reactive events, and trajectories exhibiting rare fluctuations of time-integrated quantities in the long time limit, such as those relevant in the calculation of large deviation functions. In both cases, reinforcement learning techniques are used to optimize an added force that minimizes the Kullback–Leibler divergence between the conditioned trajectory ensemble and a driven one. Under the optimized added force, the system evolves the rare fluctuation as a typical one, affording a variational estimate of its likelihood in the original trajectory ensemble. Low variance gradients employing value functions are proposed to increase the convergence of the optimal force. The method we develop employing these gradients leads to efficient and accurate estimates of both the optimal force and the likelihood of the rare event for a variety of model systems.

Type: Article
Title: Reinforcement learning of rare diffusive dynamics
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1063/5.0057323
Publisher version: https://doi.org/10.1063/5.0057323
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Physics and Astronomy
URI: https://discovery.ucl.ac.uk/id/eprint/10136821
Downloads since deposit
Loading...
34Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item