Mehta, P; Owen, D; Grammatikopoulou, M; Culshaw, L; Kerr, K; Stoyanov, D; Luengo, I; (2024) Hierarchical segmentation of surgical scenes in laparoscopy. International Journal of Computer Assisted Radiology and Surgery , 19 (7) pp. 1449-1457. 10.1007/s11548-024-03157-4.

Text Hierarchical Pritesh Mehta_accepted.pdf - Accepted Version Access restricted to UCL open access staff until 25 June 2025. Download (9MB)

Abstract

Purpose: Segmentation of surgical scenes may provide valuable information for real-time guidance and post-operative analysis. However, in some surgical video frames there is unavoidable ambiguity, leading to incorrect predictions of class or missed detections. In this work, we propose a novel method that alleviates this problem by introducing a hierarchy and associated hierarchical inference scheme that allows broad anatomical structures to be predicted when fine-grained structures cannot be reliably distinguished. Methods: First, we formulate a multi-label segmentation loss informed by a hierarchy of anatomical classes and then train a network using this. Subsequently, we use a novel leaf-to-root inference scheme (“Hiera-Mix”) to determine the trade-off between label confidence and granularity. This method can be applied to any segmentation model. We evaluate our method using a large laparoscopic cholecystectomy dataset with 65,000 labelled frames. Results: We observed an increase in per-structure detection F1 score for the critical structures, when evaluated across their sub-hierarchies, compared to the baseline method: 6.0% for the cystic artery and 2.9% for the cystic duct, driven primarily by increases in precision of 11.3% and 4.7%, respectively. This corresponded to visibly improved segmentation outputs, with better characterisation of the undissected area containing the critical structures and fewer inter-class confusions. For other anatomical classes, which did not stand to benefit from the hierarchy, performance was unimpaired. Conclusion: Our proposed hierarchical approach improves surgical scene segmentation in frames with ambiguity, by more suitably reflecting the model’s parsing of the scene. This may be beneficial in applications of surgical scene segmentation, including recent advancements towards computer-assisted intra-operative guidance.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as CSVJSONXML

Downloads by country - last 12 months

Export as XMLJSONCSV

Archive Staff Only

View Item