UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings

Fleming, SM; (2017) HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings. Neuroscience of Consciousness , 2017 (1) , Article nix007. 10.1093/nc/nix007. Green open access

[thumbnail of HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings.pdf]
Preview
Text
HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings.pdf - Published Version

Download (1MB) | Preview

Abstract

Metacognition refers to the ability to reflect on and monitor one's cognitive processes, such as perception, memory and decision-making. Metacognition is often assessed in the lab by whether an observer's confidence ratings are predictive of objective success, but simple correlations between performance and confidence are susceptible to undesirable influences such as response biases. Recently, an alternative approach to measuring metacognition has been developed (Maniscalco and Lau 2012) that characterizes metacognitive sensitivity (meta-d') by assuming a generative model of confidence within the framework of signal detection theory. However, current estimation routines require an abundance of confidence rating data to recover robust parameters, and only provide point estimates of meta-d'. In contrast, hierarchical Bayesian estimation methods provide opportunities to enhance statistical power, incorporate uncertainty in group-level parameter estimates and avoid edge-correction confounds. Here I introduce such a method for estimating metacognitive efficiency (meta-d'/d') from confidence ratings and demonstrate its application for assessing group differences. A tutorial is provided on both the meta-d' model and the preparation of behavioural data for model fitting. Through numerical simulations I show that a hierarchical approach outperforms alternative fitting methods in situations where limited data are available, such as when quantifying metacognition in patient populations. In addition, the model may be flexibly expanded to estimate parameters encoding other influences on metacognitive efficiency. MATLAB software and documentation for implementing hierarchical meta-d' estimation (HMeta-d) can be downloaded at https://github.com/smfleming/HMeta-d.

Type: Article
Title: HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1093/nc/nix007
Publisher version: http://doi.org/10.1093/nc/nix007
Language: English
Additional information: Copyright © The Author 2017. Published by Oxford University Press. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
Keywords: Bayes, confidence, metacognition, signal detection theory
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/10053216
Downloads since deposit
90Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item