Speekenbrink, M;
Konstantinidis, E;
(2014)
Uncertainty and exploration in a restless bandit task.
In: Bello, P and Gaurini, M and McShane, M and Scassellati, B, (eds.)
Proceedings of the 36th Annual Conference of the Cognitive Science Society.
(pp. 1491 - 1496).
Cognitive Science Society: Austin, TX.
![[thumbnail of paper261.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/application_pdf.png) Preview |
PDF
paper261.pdf Available under License : See the attached licence file. Download (193kB) |
Abstract
Decision-making in noisy and changing environments requires a fine balance between exploiting knowledge about good courses of action and exploring the environment in order to improve upon this knowledge. We present an experiment in which participants made repeated choices between options for which the average rewards changed over time. Comparing a number of computational models of participants' behaviour in this task, we find evidence that a substantial number of them balanced exploration and exploitation by considering the probability that an option offers the maximum reward out of all the available options.
| Type: | Proceedings paper |
|---|---|
| Title: | Uncertainty and exploration in a restless bandit task |
| ISBN-13: | 978-0-9911967-0-8 |
| Open access status: | An open access version is available from UCL Discovery |
| Language: | English |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1437387 |
Archive Staff Only
 |
View Item |
