Schad, DJ;
Rapp, MA;
Garbusow, M;
Nebe, S;
Sebold, M;
Obst, E;
Sommer, C;
... Huys, QJM; + view all
(2020)
Dissociating neural learning signals in human sign- and goal-trackers.
Nature Human Behaviour
, 4
pp. 201-214.
10.1038/s41562-019-0765-5.
Preview |
Text (Article)
Schad-SignGoalTracking-Article.pdf - Accepted Version Download (3MB) | Preview |
Preview |
Text (Supplementary Material)
Schad-SignGoalTracking-Supplement.pdf - Accepted Version Download (13MB) | Preview |
Abstract
Individuals differ in how they learn from experience. In Pavlovian conditioning models, where cues predict reinforcer delivery at a different goal location, some animals-called sign-trackers-come to approach the cue, whereas others, called goal-trackers, approach the goal. In sign-trackers, model-free phasic dopaminergic reward-prediction errors underlie learning, which renders stimuli 'wanted'. Goal-trackers do not rely on dopamine for learning and are thought to use model-based learning. We demonstrate this double dissociation in 129 male humans using eye-tracking, pupillometry and functional magnetic resonance imaging informed by computational models of sign- and goal-tracking. We show that sign-trackers exhibit a neural reward prediction error signal that is not detectable in goal-trackers. Model-free value only guides gaze and pupil dilation in sign-trackers. Goal-trackers instead exhibit a stronger model-based neural state prediction error signal. This model-based construct determines gaze and pupil dilation more in goal-trackers.
Type: | Article |
---|---|
Title: | Dissociating neural learning signals in human sign- and goal-trackers |
Location: | England |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1038/s41562-019-0765-5 |
Publisher version: | https://doi.org/10.1038/s41562-019-0765-5 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Classical conditioning, Human behaviour, Learning algorithms, Reward |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Division of Psychiatry |
URI: | https://discovery.ucl.ac.uk/id/eprint/10086731 |
Archive Staff Only
![]() |
View Item |