Petraco, R;
Dehbi, H-M;
Howard, JP;
Shun-Shin, MJ;
Sen, S;
Nijjer, SS;
Mayet, J;
... Francis, DP; + view all
(2018)
Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values.
Open Heart
, 5
(1)
, Article e000663. 10.1136/openhrt-2017-000663.
Preview |
Text
Dehbi_Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values_VoR.pdf - Published Version Download (3MB) | Preview |
Abstract
BACKGROUND: Diagnostic accuracy is widely accepted by researchers and clinicians as an optimal expression of a test’s performance. The aim of this study was to evaluate the effects of disease severity distribution on values of diagnostic accuracy as well as propose a sample-independent methodology to calculate and display accuracy of diagnostic tests. METHODS AND FINDINGS: We evaluated the diagnostic relationship between two hypothetical methods to measure serum cholesterol (Chol_{rapid} and Chol_{gold} by generating samples with statistical software and (1) keeping the numerical relationship between methods unchanged and (2) changing the distribution of cholesterol values. Metrics of categorical agreement were calculated (accuracy, sensitivity and specificity). Finally, a novel methodology to display and calculate accuracy values was presented (the V-plot of accuracies). CONCLUSION: No single value of diagnostic accuracy can be used to describe the relationship between tests, as accuracy is a metric heavily affected by the underlying sample distribution. Our novel proposed methodology, the V-plot of accuracies, can be used as a sample-independent measure of a test performance against a reference gold standard.
| Type: | Article |
|---|---|
| Title: | Effects of disease severity distribution on the performance of quantitative diagnostic methods and proposal of a novel ‘V-plot’ methodology to display accuracy values |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1136/openhrt-2017-000663 |
| Publisher version: | http://dx.doi.org/10.1136/openhrt-2017-000663 |
| Language: | English |
| Additional information: | © Article author(s) (or their employer[s] unless otherwise stated in the text of the article) 2018. This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license (http://creativecommons.org/licenses/by/4.0/). |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > Comprehensive CTU at UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10078568 |
Archive Staff Only
 |
View Item |
