Zhang, Y; Bano, S; Page, AS; Deprest, J; Stoyanov, D; Vasconcelos, F; (2022) Retrieval of Surgical Phase Transitions Using Reinforcement Learning. In: Wang, L and Dou, Q and Fletcher, PT and Speidel, S and Li, S, (eds.) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. (pp. pp. 497-506). Springer: Cham, Switzerland.

Preview

Text Retrieval_of_surgical_phase_transitions_using_reinforcement_learning.pdf - Accepted Version Download (674kB) | Preview

Abstract

In minimally invasive surgery, surgical workflow segmentation from video analysis is a well studied topic. The conventional approach defines it as a multi-class classification problem, where individual video frames are attributed a surgical phase label. We introduce a novel reinforcement learning formulation for offline phase transition retrieval. Instead of attempting to classify every video frame, we identify the timestamp of each phase transition. By construction, our model does not produce spurious and noisy phase transitions, but contiguous phase blocks. We investigate two different configurations of this model. The first does not require processing all frames in a video (only <60% and <20% of frames in 2 different applications), while producing results slightly under the state-of-the-art accuracy. The second configuration processes all video frames, and outperforms the state-of-the art at a comparable computational cost. We compare our method against the recent top-performing frame-based approaches TeCNO and Trans-SVNet on the public dataset Cholec80 and also on an in-house dataset of laparoscopic sacrocolpopexy. We perform both a frame-based (accuracy, precision, recall and F1-score) and an event-based (event ratio) evaluation of our algorithms.

Download activity - last month

Export as XMLCSVJSON

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item