UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers

Stewart, N; Ungemach, C; Harris, AJL; Bartels, DM; Newell, BR; Paolacci, G; Chandler, J; (2015) The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making , 10 (5) pp. 479-491. Green open access

[thumbnail of Harris_jdm14725.pdf]
Preview
Text
Harris_jdm14725.pdf - Published Version

Download (918kB) | Preview

Abstract

Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.

Type: Article
Title: The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Open access status: An open access version is available from UCL Discovery
Publisher version: https://psycnet.apa.org/record/2015-45545-008
Language: English
Additional information: Copyright: © 2015. The authors license this article under the terms of the Creative Commons Attribution 3.0 License.
Keywords: Social Sciences, Psychology, Multidisciplinary, Psychology, Amazon Mechanical Turk, MTurk, capture-recapture, population size, MODELS
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/10113258
Downloads since deposit
226Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item