UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Experience replay is associated with efficient nonlocal learning

Liu, Y; Mattar, MG; Behrens, TEJ; Daw, ND; Dolan, RJ; (2021) Experience replay is associated with efficient nonlocal learning. Science , 372 (6544) , Article eabf1357. 10.1126/science.abf1357. Green open access

[thumbnail of Liu_R2.pdf]
Preview
Text
Liu_R2.pdf - Accepted Version

Download (10MB) | Preview

Abstract

To make effective decisions, people need to consider the relationship between actions and outcomes. These are often separated by time and space. The neural mechanisms by which disjoint actions and outcomes are linked remain unknown. One promising hypothesis involves neural replay of nonlocal experience. Using a task that segregates direct from indirect value learning, combined with magnetoencephalography, we examined the role of neural replay in human nonlocal learning. After receipt of a reward, we found significant backward replay of nonlocal experience, with a 160-millisecond state-to-state time lag, which was linked to efficient learning of action values. Backward replay and behavioral evidence of nonlocal learning were more pronounced for experiences of greater benefit for future behavior. These findings support nonlocal replay as a neural mechanism for solving complex credit assignment problems during learning.

Type: Article
Title: Experience replay is associated with efficient nonlocal learning
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1126/science.abf1357
Publisher version: https://doi.org/10.1126/science.abf1357
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Imaging Neuroscience
URI: https://discovery.ucl.ac.uk/id/eprint/10129621
Downloads since deposit
763Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item