UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Understanding metric-related pitfalls in image analysis validation

Reinke, A; Tizabi, MD; Baumgartner, M; Eisenmann, M; Heckmann-Nötzel, D; Kavur, AE; Rädsch, T; ... Maier-Hein, L; + view all (2024) Understanding metric-related pitfalls in image analysis validation. Nature Methods , 21 pp. 182-194. 10.1038/s41592-023-02150-0.

[thumbnail of 2302.01790v4.pdf] Text
2302.01790v4.pdf - Accepted Version
Access restricted to UCL open access staff until 13 August 2024.

Download (33MB)

Abstract

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence research and its translation into practice. However, increasing evidence shows that, particularly in image analysis, metrics are often chosen inadequately. Although taking into account the individual strengths, weaknesses and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multistage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides a reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Although focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation.

Type: Article
Title: Understanding metric-related pitfalls in image analysis validation
Location: United States
DOI: 10.1038/s41592-023-02150-0
Publisher version: http://dx.doi.org/10.1038/s41592-023-02150-0
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Science & Technology, Life Sciences & Biomedicine, Biochemical Research Methods, Biochemistry & Molecular Biology, SEGMENTATION
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Cardiovascular Science
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Cardiovascular Science > Population Science and Experimental Medicine
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Cardiovascular Science > Population Science and Experimental Medicine > MRC Unit for Lifelong Hlth and Ageing
URI: https://discovery.ucl.ac.uk/id/eprint/10191651
Downloads since deposit
1Download
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item