Maloca, Peter M;
Pfau, Maximilian;
Janeschitz-Kriegl, Lucas;
Reich, Michael;
Goerdt, Lukas;
Holz, Frank G;
Müller, Philipp L;
... Denk, Nora; + view all
(2024)
Human selection bias drives the linear nature of the more ground truth effect in explainable deep learning optical coherence tomography image segmentation.
Journal of Biophotonics
, 17
(2)
, Article e202300274. 10.1002/jbio.202300274.
Preview |
Text
6761_0_merged_1673202709.pdf - Submitted Version Download (2MB) | Preview |
Abstract
Supervised deep learning (DL) algorithms are highly dependent on training data for which human graders are assigned, for example, for optical coherence tomography (OCT) image annotation. Despite the tremendous success of DL, due to human judgment, these ground truth labels can be inaccurate and/or ambiguous and cause a human selection bias. We therefore investigated the impact of the size of the ground truth and variable numbers of graders on the predictive performance of the same DL architecture and repeated each experiment three times. The largest training dataset delivered a prediction performance close to that of human experts. All DL systems utilized were highly consistent. Nevertheless, the DL under-performers could not achieve any further autonomous improvement even after repeated training. Furthermore, a quantifiable linear relationship between ground truth ambiguity and the beneficial effect of having a larger amount of ground truth data was detected and marked as the more-ground-truth effect.
| Type: | Article |
|---|---|
| Title: | Human selection bias drives the linear nature of the more ground truth effect in explainable deep learning optical coherence tomography image segmentation |
| Location: | Germany |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1002/jbio.202300274 |
| Publisher version: | https://doi.org/10.1002/jbio.202300274 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Explainable AI, machine learning, optical coherence tomography, retina |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Institute of Ophthalmology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10182080 |
Archive Staff Only
 |
View Item |
