de Lara, ALMV;
Bhandari, PM;
Wu, Y;
Levis, B;
Thombs, B;
Benedetti, A;
Sun, Y;
... Zhang, Y; + view all
(2023)
A case study of an individual participant data meta-analysis of diagnostic accuracy showed that prediction regions represented heterogeneity well.
Scientific Reports
, 13
, Article 9275. 10.1038/s41598-023-36129-w.
Preview |
PDF
A case study of an individual participant data meta-analysis of diagnostic accuracy showed that prediction regions represent.pdf - Other Download (1MB) | Preview |
Abstract
The diagnostic accuracy of a screening tool is often characterized by its sensitivity and specificity. An analysis of these measures must consider their intrinsic correlation. In the context of an individual participant data meta-analysis, heterogeneity is one of the main components of the analysis. When using a random-effects meta-analytic model, prediction regions provide deeper insight into the effect of heterogeneity on the variability of estimated accuracy measures across the entire studied population, not just the average. This study aimed to investigate heterogeneity via prediction regions in an individual participant data meta-analysis of the sensitivity and specificity of the Patient Health Questionnaire-9 for screening to detect major depression. From the total number of studies in the pool, four dates were selected containing roughly 25%, 50%, 75% and 100% of the total number of participants. A bivariate random-effects model was fitted to studies up to and including each of these dates to jointly estimate sensitivity and specificity. Two-dimensional prediction regions were plotted in ROC-space. Subgroup analyses were carried out on sex and age, regardless of the date of the study. The dataset comprised 17,436 participants from 58 primary studies of which 2322 (13.3%) presented cases of major depression. Point estimates of sensitivity and specificity did not differ importantly as more studies were added to the model. However, correlation of the measures increased. As expected, standard errors of the logit pooled TPR and FPR consistently decreased as more studies were used, while standard deviations of the random-effects did not decrease monotonically. Subgroup analysis by sex did not reveal important contributions for observed heterogeneity; however, the shape of the prediction regions differed. Subgroup analysis by age did not reveal meaningful contributions to the heterogeneity and the prediction regions were similar in shape. Prediction intervals and regions reveal previously unseen trends in a dataset. In the context of a meta-analysis of diagnostic test accuracy, prediction regions can display the range of accuracy measures in different populations and settings.
| Type: | Article |
|---|---|
| Title: | A case study of an individual participant data meta-analysis of diagnostic accuracy showed that prediction regions represented heterogeneity well |
| Location: | England |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/s41598-023-36129-w |
| Publisher version: | http://dx.doi.org/10.1038/s41598-023-36129-w |
| Language: | English |
| Additional information: | This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
| Keywords: | Humans, Sensitivity and Specificity, Depressive Disorder, Major, Seizures, Data Collection |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Health Informatics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10193419 |
Archive Staff Only
 |
View Item |
