UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Highlighting uncertainty in clinical risk prediction using a model of emergency laparotomy mortality risk

Mathiszig-Lee, JF; Catling, FJR; Moonesinghe, SR; Brett, SJ; (2022) Highlighting uncertainty in clinical risk prediction using a model of emergency laparotomy mortality risk. npj Digital Medicine , 5 , Article 70. 10.1038/s41746-022-00616-7. Green open access

[thumbnail of s41746-022-00616-7.pdf]
Preview
Text
s41746-022-00616-7.pdf - Published Version

Download (4MB) | Preview

Abstract

Clinical prediction models typically make point estimates of risk. However, values of key variables are often missing during model development or at prediction time, meaning that the point estimates mask significant uncertainty and can lead to over-confident decision making. We present a model of mortality risk in emergency laparotomy which instead presents a distribution of predicted risks, highlighting the uncertainty over the risk of death with an intuitive visualisation. We developed and validated our model using data from 127134 emergency laparotomies from patients in England and Wales during 2013–2019. We captured the uncertainty arising from missing data using multiple imputation, allowing prospective, patient-specific imputation for variables that were frequently missing. Prospective imputation allows early prognostication in patients where these variables are not yet measured, accounting for the additional uncertainty this induces. Our model showed good discrimination and calibration (95% confidence intervals: Brier score 0.071–0.078, C statistic 0.859–0.873, calibration error 0.031–0.059) on unseen data from 37 hospitals, consistently improving upon the current gold-standard model. The dispersion of the predicted risks varied significantly between patients and increased where prospective imputation occurred. We present a case study that illustrates the potential impact of uncertainty quantification on clinical decision making. Our model improves mortality risk prediction in emergency laparotomy and has the potential to inform decision-makers and assist discussions with patients and their families. Our analysis code was robustly developed and is publicly available for easy replication of our study and adaptation to predicting other outcomes.

Type: Article
Title: Highlighting uncertainty in clinical risk prediction using a model of emergency laparotomy mortality risk
Open access status: An open access version is available from UCL Discovery
DOI: 10.1038/s41746-022-00616-7
Publisher version: https://doi.org/10.1038/s41746-022-00616-7
Language: English
Additional information: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
UCL classification: UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci > Department of Targeted Intervention
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci
URI: https://discovery.ucl.ac.uk/id/eprint/10150682
Downloads since deposit
19Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item