UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Gorilla in our midst: An online behavioral experiment builder

Anwyl-Irvine, AL; Massonnié, J; Flitton, A; Kirkham, N; Evershed, JK; (2019) Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods 10.3758/s13428-019-01237-x. (In press). Green open access

[thumbnail of Massonnie VoR Anwyl-Irvine2019_Article_GorillaInOurMidstAnOnlineBehav.pdf]
Massonnie VoR Anwyl-Irvine2019_Article_GorillaInOurMidstAnOnlineBehav.pdf - Published Version

Download (1MB) | Preview


Behavioral researchers are increasingly conducting their studies online, to gain access to large and diverse samples that would be difficult to get in a laboratory environment. However, there are technical access barriers to building experiments online, and web browsers can present problems for consistent timing—an important issue with reaction-time-sensitive measures. For example, to ensure accuracy and test–retest reliability in presentation and response recording, experimenters need a working knowledge of programming languages such as JavaScript. We review some of the previous and current tools for online behavioral research, as well as how well they address the issues of usability and timing. We then present the Gorilla Experiment Builder (gorilla.sc), a fully tooled experiment authoring and deployment platform, designed to resolve many timing issues and make reliable online experimentation open and accessible to a wider range of technical abilities. To demonstrate the platform’s aptitude for accessible, reliable, and scalable research, we administered a task with a range of participant groups (primary school children and adults), settings (without supervision, at home, and under supervision, in both schools and public engagement events), equipment (participant’s own computer, computer supplied by the researcher), and connection types (personal internet connection, mobile phone 3G/4G). We used a simplified flanker task taken from the attentional network task (Rueda, Posner, & Rothbart, 2004). We replicated the Bconflict network^ effect in all these populations, demonstrating the platform’s capability to run reaction-time-sensitive experiments. Unresolved limitations of running experiments online are then discussed, along with potential solutions and some future features of the platform.

Type: Article
Title: Gorilla in our midst: An online behavioral experiment builder
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.3758/s13428-019-01237-x
Publisher version: https://doi.org/10.3758/s13428-019-01237-x
Language: English
Additional information: This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Keywords: Online methods . Remote testing . Browser timing . Attentional control . Online research . Timing accuracy
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
URI: https://discovery.ucl.ac.uk/id/eprint/10086544
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item