Eisele, G;
Hiekkaranta, A;
Kunkels, YK;
Rot, MAH;
van Ballegooijen, W;
Bartels, SL;
Bastiaansen, JA;
... Kirtley, OJ; + view all
(2025)
ESM-Q: A consensus-based quality assessment tool for experience sampling method items.
Behavior Research Methods
, 57
(4)
, Article 124. 10.3758/s13428-025-02626-1.
Preview |
Text
ESMQ-AcceptedVersion.pdf - Accepted Version Download (419kB) | Preview |
Abstract
The experience sampling method (ESM) is increasingly used by researchers from various disciplines to answer novel questions about individuals’ daily lives. Measurement best practices have long been overlooked in ESM research, and recent reviews show that item quality is often not reported in ESM studies. The absence of information about item quality may be partly explained by the lack of consensus on how ESM item quality should be evaluated. As part of the ESM Item Repository project (esmitemrepository.com)—an international open science initiative that collects ESM items in an open item bank and evaluates their quality—we brought together 42 international ESM experts to develop an ESM item quality assessment tool. In four Delphi phases, experts suggested 57 item quality criteria, rated the criteria, provided arguments for and against the criteria, and rated the criteria again, considering reflections from other experts. The result of the Delphi process is ESM-Q: a quality assessment tool consisting of 10 core criteria, as well as an additional 15 supplementary criteria, to be used depending on the type of items being rated and the availability of supplementary information. The criteria cover topics ranging from construct validity to the optimal wording of items. ESM-Q can aid ESM researchers in selecting existing ESM items, developing new high-quality ESM items, and evaluating the quality of ESM items in systematic reviews. Expert reflections also highlight open research questions surrounding ESM item design that form a research agenda for ESM measurement.
| Type: | Article |
|---|---|
| Title: | ESM-Q: A consensus-based quality assessment tool for experience sampling method items |
| Location: | United States |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.3758/s13428-025-02626-1 |
| Publisher version: | https://doi.org/10.3758/s13428-025-02626-1 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | Ambulatory assessment, Delphi study, Ecological momentary assessment, Item quality criteria, Questionnaire development, Humans, Delphi Technique |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Clinical, Edu and Hlth Psychology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10208509 |
Archive Staff Only
 |
View Item |
