Schulz, E;
Klenske, E;
Bramley, N;
Speekenbrink, M;
(2017)
Strategic exploration in human adaptive control.
In:
Proceedings of the annual meeting of the Cognitive Science Society 2017.
(pp. pp. 1047-1052).
Cognitive Science Society
Preview |
Text
paper0204.pdf - Published Version Download (2MB) | Preview |
Abstract
How do people explore in order to gain rewards in uncertain dynamical systems? Within a reinforcement learning paradigm, control normally involves trading off between exploration (i.e. trying out actions in order to gain more knowledge about the system) and exploitation (i.e. using current knowledge of the system to maximize reward). We study a novel control task in which participants must steer a boat on a grid, assessing whether participants explore strategically in order to produce higher rewards later on. We find that participants explore strategically yet conservatively, exploring more when mistakes are less costly and practicing actions that will be needed later on.
Type: | Proceedings paper |
---|---|
Title: | Strategic exploration in human adaptive control |
Event: | Annual meeting of the Cognitive Science Society 2017 |
Open access status: | An open access version is available from UCL Discovery |
Publisher version: | https://cogsci.mindmodeling.org/2017/ |
Language: | English |
Additional information: | This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Reinforcement Learning, Strategic Exploration, Control, Exploration-Exploitation |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology |
URI: | https://discovery.ucl.ac.uk/id/eprint/10140319 |
Archive Staff Only
View Item |