Panch, T;
Pollard, TJ;
Mattie, H;
Lindemer, E;
Keane, PA;
Celi, LA;
(2020)
"Yes, but will it work for my patients?" Driving clinically relevant research with benchmark datasets.
npj Digital Medicine
, 3
, Article 87. 10.1038/s41746-020-0295-6.
Preview |
Text
s41746-020-0295-6.pdf - Published Version Download (449kB) | Preview |
Abstract
Benchmark datasets have a powerful normative influence: by determining how the real world is represented in data, they define which problems will first be solved by algorithms built using the datasets and, by extension, who these algorithms will work for. It is desirable for these datasets to serve four functions: (1) enabling the creation of clinically relevant algorithms; (2) facilitating like-for-like comparison of algorithmic performance; (3) ensuring reproducibility of algorithms; (4) asserting a normative influence on the clinical domains and diversity of patients that will potentially benefit from technological advances. Without benchmark datasets that satisfy these functions, it is impossible to address two perennial concerns of clinicians experienced in computational research: "the data scientists just go where the data is rather than where the needs are," and, "yes, but will this work for my patients?" If algorithms are to be developed and applied for the care of patients, then it is prudent for the research community to create benchmark datasets proactively, across specialties. As yet, best practice in this area has not been defined. Broadly speaking, efforts will include design of the dataset; compliance and contracting issues relating to the sharing of sensitive data; enabling access and reuse; and planning for translation of algorithms to the clinical environment. If a deliberate and systematic approach is not followed, not only will the considerable benefits of clinical algorithms fail to be realized, but the potential harms may be regressively incurred across existing gradients of social inequity.
| Type: | Article |
|---|---|
| Title: | "Yes, but will it work for my patients?" Driving clinically relevant research with benchmark datasets |
| Location: | England |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/s41746-020-0295-6 |
| Publisher version: | https://doi.org/10.1038/s41746-020-0295-6 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Databases, Health policy |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Institute of Ophthalmology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10105528 |
Archive Staff Only
 |
View Item |
