Korn, CW;
Bach, DR;
(2018)
Heuristic and optimal policy computations in the human brain during sequential decision-making.
Nature Communications
, 9
, Article 325. 10.1038/s41467-017-02750-3.
Preview |
Text (Published article)
s41467-017-02750-3.pdf - Published Version Download (2MB) | Preview |
Preview |
Text (Supplementary data)
Korn_Heuristic_optimal_policy_S1.pdf Download (2MB) | Preview |
Preview |
Text (Peer Review file)
Korn_Heuristic_optimal_policy_S2.pdf Download (4MB) | Preview |
Abstract
Optimal decisions across extended time horizons require value calculations over multiple probabilistic future states. Humans may circumvent such complex computations by resorting to easy-to-compute heuristics that approximate optimal solutions. To probe the potential interplay between heuristic and optimal computations, we develop a novel sequential decision-making task, framed as virtual foraging in which participants have to avoid virtual starvation. Rewards depend only on final outcomes over five-trial blocks, necessitating planning over five sequential decisions and probabilistic outcomes. Here, we report model comparisons demonstrating that participants primarily rely on the best available heuristic but also use the normatively optimal policy. FMRI signals in medial prefrontal cortex (MPFC) relate to heuristic and optimal policies and associated choice uncertainties. Crucially, reaction times and dorsal MPFC activity scale with discrepancies between heuristic and optimal policies. Thus, sequential decision-making in humans may emerge from integration between heuristic and optimal policies, implemented by controllers in MPFC.
| Type: | Article |
|---|---|
| Title: | Heuristic and optimal policy computations in the human brain during sequential decision-making |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/s41467-017-02750-3 |
| Publisher version: | http://dx.doi.org/10.1038/s41467-017-02750-3 |
| Language: | English |
| Additional information: | Open Access: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Imaging Neuroscience |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10048237 |
Archive Staff Only
 |
View Item |
