UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values

Petraco, R; Dehbi, H-M; Howard, JP; Shun-Shin, MJ; Sen, S; Nijjer, SS; Mayet, J; ... Francis, DP; + view all (2018) Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values. Open Heart , 5 (1) , Article e000663. 10.1136/openhrt-2017-000663. Green open access

[thumbnail of Dehbi_Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values_VoR.pdf]
Preview
Text
Dehbi_Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values_VoR.pdf - Published Version

Download (3MB) | Preview

Abstract

BACKGROUND: Diagnostic accuracy is widely accepted by researchers and clinicians as an optimal expression of a test’s performance. The aim of this study was to evaluate the effects of disease severity distribution on values of diagnostic accuracy as well as propose a sample-independent methodology to calculate and display accuracy of diagnostic tests. METHODS AND FINDINGS: We evaluated the diagnostic relationship between two hypothetical methods to measure serum cholesterol (Chol_{rapid} and Chol_{gold} by generating samples with statistical software and (1) keeping the numerical relationship between methods unchanged and (2) changing the distribution of cholesterol values. Metrics of categorical agreement were calculated (accuracy, sensitivity and specificity). Finally, a novel methodology to display and calculate accuracy values was presented (the V-plot of accuracies). CONCLUSION: No single value of diagnostic accuracy can be used to describe the relationship between tests, as accuracy is a metric heavily affected by the underlying sample distribution. Our novel proposed methodology, the V-plot of accuracies, can be used as a sample-independent measure of a test performance against a reference gold standard.

Type: Article
Title: Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values
Open access status: An open access version is available from UCL Discovery
DOI: 10.1136/openhrt-2017-000663
Publisher version: http://dx.doi.org/10.1136/openhrt-2017-000663
Language: English
Additional information: © Article author(s) (or their employer[s] unless otherwise stated in the text of the article) 2018. This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license (http://creativecommons.org/licenses/by/4.0/).
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > Comprehensive CTU at UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10078568
Downloads since deposit
30Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item