UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Initial Responses to False Positives in AI-Supported Continuous Interactions: A Colonoscopy Case Study

Van Berkel, Niels; Opie, Jeremy; Ahmad, Omer F; Lovat, Laurence; Stoyanov, Danail; Blandford, Ann; (2022) Initial Responses to False Positives in AI-Supported Continuous Interactions: A Colonoscopy Case Study. The ACM Transactions on Interactive Intelligent Systems , 12 (1) , Article 2. 10.1145/3480247. Green open access

[thumbnail of TiiS_2021___False_Positives_Colonoscopy.pdf]
Preview
Text
TiiS_2021___False_Positives_Colonoscopy.pdf - Accepted Version

Download (1MB) | Preview

Abstract

The use of artificial intelligence (AI) in clinical support systems is increasing. In this article, we focus on AI support for continuous interaction scenarios. A thorough understanding of end-user behaviour during these continuous human-AI interactions, in which user input is sustained over time and during which AI suggestions can appear at any time, is still missing. We present a controlled lab study involving 21 endoscopists and an AI colonoscopy support system. Using a custom-developed application and an off-the-shelf videogame controller, we record participants’ navigation behaviour and clinical assessment across 14 endoscopic videos. Each video is manually annotated to mimic an AI recommendation, being either true positive or false positive in nature. We find that time between AI recommendation and clinical assessment is significantly longer for incorrect assessments. Further, the type of medical content displayed significantly affects decision time. Finally, we discover that the participant’s clinical role plays a large part in the perception of clinical AI support systems. Our study presents a realistic assessment of the effects of imperfect and continuous AI support in a clinical scenario.

Type: Article
Title: Initial Responses to False Positives in AI-Supported Continuous Interactions: A Colonoscopy Case Study
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3480247
Publisher version: https://doi.org/10.1145/3480247
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci > Department of Targeted Intervention
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci
URI: https://discovery.ucl.ac.uk/id/eprint/10147696
Downloads since deposit
32Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item