UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Raising awareness about measurement error in research on unconscious mental processes.

Vadillo, MA; Malejka, S; Lee, DYH; Dienes, Z; Shanks, DR; (2021) Raising awareness about measurement error in research on unconscious mental processes. Psychonomic Bulletin and Review 10.3758/s13423-021-01923-y. (In press).

[thumbnail of Shanks_Vadillo et al. (2021, PBR).pdf] Text
Shanks_Vadillo et al. (2021, PBR).pdf - Accepted version
Access restricted to UCL open access staff until 16 June 2022.

Download (1MB)

Abstract

Experimental psychologists often neglect the poor psychometric properties of the dependent measures collected in their studies. In particular, a low reliability of measures can have dramatic consequences for the interpretation of key findings in some of the most popular experimental paradigms, especially when strong inferences are drawn from the absence of statistically significant correlations. In research on unconscious cognition, for instance, it is commonly argued that the lack of a correlation between task performance and measures of awareness or explicit recollection of the target stimuli provides strong support for the conclusion that the cognitive processes underlying performance must be unconscious. Using contextual cuing of visual search as a case study, we show that given the low reliability of the dependent measures collected in these studies, it is usually impossible to draw any firm conclusion about the unconscious character of this effect from correlational analyses. Furthermore, both a psychometric meta-analysis of the available evidence and a cognitive-modeling approach suggest that, in fact, we should expect to see very low correlations between performance and awareness at the empirical level, even if both constructs are perfectly related at the latent level. Convincing evidence for the unconscious character of contextual cuing and other effects will most likely demand richer and larger data sets, coupled with more powerful analytic approaches.

Type: Article
Title: Raising awareness about measurement error in research on unconscious mental processes.
Location: United States
DOI: 10.3758/s13423-021-01923-y
Publisher version: https://doi.org/10.3758/s13423-021-01923-y
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Contextual cuing, Meta-analysis, Reliability, Unconscious learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/10130954
Downloads since deposit
2Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item