Solway, A;
Lohrenz, T;
Montague, PR;
(2017)
Simulating future value in intertemporal choice.
Scientific Reports
, 7
, Article 43119. 10.1038/srep43119.
![[thumbnail of srep43119.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/text.png) |
Text
srep43119.pdf - Published Version Download (1MB) |
Abstract
The laboratory study of how humans and other animals trade-off value and time has a long and storied history, and is the subject of a vast literature. However, despite a long history of study, there is no agreed upon mechanistic explanation of how intertemporal choice preferences arise. Several theorists have recently proposed model-based reinforcement learning as a candidate framework. This framework describes a suite of algorithms by which a model of the environment, in the form of a state transition function and reward function, can be converted on-line into a decision. The state transition function allows the model-based system to make decisions based on projected future states, while the reward function assigns value to each state, together capturing the necessary components for successful intertemporal choice. Empirical work has also pointed to a possible relationship between increased prospection and reduced discounting. In the current paper, we look for direct evidence of a relationship between temporal discounting and model-based control in a large new data set (n = 168). However, testing the relationship under several different modeling formulations revealed no indication that the two quantities are related.
| Type: | Article |
|---|---|
| Title: | Simulating future value in intertemporal choice |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/srep43119 |
| Publisher version: | http://dx.doi.org/10.1038/srep43119 |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Science & Technology, Multidisciplinary Sciences, Science & Technology - Other Topics, DECISION-MAKING, DELAYED REWARDS, PREFRONTAL CORTEX, EPISODIC PROSPECTION, BEHAVIORAL-CONTROL, SELF-CONTROL, MODEL, ADDICTION, THINKING, STIMULATION |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1563631 |
Archive Staff Only
 |
View Item |
