Colleoni, Emanuele;
Psychogyios, Dimitris;
Van Amsterdam, Beatrice;
Vasconcelos, Francisco;
Stoyanov, Danail;
(2022)
SSIS-Seg: Simulation-supervised image synthesis for surgical instrument segmentation.
IEEE Transactions on Medical Imaging
, 41
(11)
pp. 3074-3086.
10.1109/tmi.2022.3178549.
Preview |
Text
Colleoni_SSIS-Seg. Simulation-supervised image synthesis for surgical instrument segmentation_AAM.pdf Download (48MB) | Preview |
Abstract
Surgical instrument segmentation can be used in a range of computer assisted interventions and automation in surgical robotics. While deep learning architectures have rapidly advanced the robustness and performance of segmentation models, most are still reliant on supervision and large quantities of labelled data. In this paper, we present a novel method for surgical image generation that can fuse robotic instrument simulation and recent domain adaptation techniques to synthesize artificial surgical images to train surgical instrument segmentation models. We integrate attention modules into well established image generation pipelines and propose a novel cost function to support supervision from simulation frames in model training. We provide an extensive evaluation of our method in terms of segmentation performance along with a validation study on image quality using evaluation metrics. Additionally, we release a novel segmentation dataset from real surgeries that will be shared for research purposes. Both binary and semantic segmentation have been considered, and we show the capability of our synthetic images to train segmentation models compared with the latest methods from the literature.
| Type: | Article |
|---|---|
| Title: | SSIS-Seg: Simulation-supervised image synthesis for surgical instrument segmentation |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/tmi.2022.3178549 |
| Publisher version: | https://doi.org/10.1109/TMI.2022.3178549 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | Image-to-image translation, domain adaptation, surgical robot simulators, surgical tool segmentation, surgical vision |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10149624 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
