UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Uncertainty and exploration in a restless bandit task

Speekenbrink, M; Konstantinidis, E; (2014) Uncertainty and exploration in a restless bandit task. In: Bello, P and Gaurini, M and McShane, M and Scassellati, B, (eds.) Proceedings of the 36th Annual Conference of the Cognitive Science Society. (pp. 1491 - 1496). Cognitive Science Society: Austin, TX. Green open access

[img]
Preview
PDF
paper261.pdf
Available under License : See the attached licence file.

Download (193kB)

Abstract

Decision-making in noisy and changing environments requires a fine balance between exploiting knowledge about good courses of action and exploring the environment in order to improve upon this knowledge. We present an experiment in which participants made repeated choices between options for which the average rewards changed over time. Comparing a number of computational models of participants' behaviour in this task, we find evidence that a substantial number of them balanced exploration and exploitation by considering the probability that an option offers the maximum reward out of all the available options.

Type: Proceedings paper
Title: Uncertainty and exploration in a restless bandit task
ISBN-13: 978-0-9911967-0-8
Open access status: An open access version is available from UCL Discovery
Language: English
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/1437387
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item