UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Reliability of Decision-Making and Reinforcement Learning Computational Parameters

Mkrtchian, A; Valton, V; Roiser, JP; (2023) Reliability of Decision-Making and Reinforcement Learning Computational Parameters. Computational Psychiatry , 7 (1) pp. 30-46. 10.5334/cpsy.86. Green open access

[thumbnail of 86-1-1215-1-10-20230208.pdf]
Preview
Text
86-1-1215-1-10-20230208.pdf - Published Version

Download (3MB) | Preview

Abstract

Computational models can offer mechanistic insight into cognition and therefore have the potential to transform our understanding of psychiatric disorders and their treatment. For translational efforts to be successful, it is imperative that computational measures capture individual characteristics reliably. Here we examine the reliability of reinforcement learning and economic models derived from two commonly used tasks. Healthy individuals (N = 50) completed a restless four-armed bandit and a calibrated gambling task twice, two weeks apart. Reward and punishment learning rates from the reinforcement learning model showed good reliability and reward and punishment sensitivity from the same model had fair reliability; while risk aversion and loss aversion parameters from a prospect theory model exhibited good and excellent reliability, respectively. Both models were further able to predict future behaviour above chance within individuals. This prediction was better when based on participants’ own model parameters than other participants’ parameter estimates. These results suggest that reinforcement learning, and particularly prospect theory parameters, as derived from a restless four-armed bandit and a calibrated gambling task, can be measured reliably to assess learning and decision-making mechanisms. Overall, these findings indicate the translational potential of clinically-relevant computational parameters for precision psychiatry.

Type: Article
Title: Reliability of Decision-Making and Reinforcement Learning Computational Parameters
Open access status: An open access version is available from UCL Discovery
DOI: 10.5334/cpsy.86
Publisher version: https://doi.org/10.5334/cpsy.86
Language: English
Additional information: COPYRIGHT: © 2023 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See http://creativecommons.org/ licenses/by/4.0/.
Keywords: Reliability; Computational psychiatry; Decision-making; Reinforcement learning; Prospect theory; Gambling
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Division of Psychiatry
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Institute of Cognitive Neuroscience
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Division of Psychiatry > Mental Health Neuroscience
URI: https://discovery.ucl.ac.uk/id/eprint/10181841
Downloads since deposit
27Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item