UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Technical note: Probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: Application to fetoscopy

Tella-Amo, M; Peter, L; Shakir, DI; Deprest, J; Stoyanov, D; Iglesias, JE; Vercauteren, T; (2018) Technical note: Probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: Application to fetoscopy. In: Proceedings of SPIE - Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling. SPIE: Texas, United States. Green open access

[thumbnail of 105760I.pdf]
Preview
Text
105760I.pdf - Published Version

Download (716kB) | Preview

Abstract

The most eâ†μective treatment for Twin-To-Twin Transfusion Syndrome is laser photocoagulation of the shared vascular anastomoses in the placenta. Vascular connections are extremely challenging to locate due to their caliber and the reduced field of view of the fetoscope. Therefore, mosaicking techniques are beneficial to expand the scene, facilitate navigation and allow vessel photocoagulation decision-making. Local vision-based mosaicking algorithms inherently drift over time due to the use of pairwise transformations. We propose the use of an electromagnetic tracker (EMT) sensor mounted at the tip of the fetoscope to obtain camera pose measurements, which we incorporate into a probabilistic framework with frame-To-frame visual information to achieve globally consistent sequential mosaics. We parametrize the problem in terms of plane and camera poses constrained by EMT measurements to enforce global consistency while leveraging pairwise image relationships in a sequential fashion through the use of Local Bundle Adjustment. We show that our approach is drift-free and performs similarly to state-of-The-Art global alignment techniques like Bundle Adjustment albeit with much less computational burden. Additionally, we propose a version of Bundle Adjustment that uses EMT information. We demonstrate the robustness to EMT noise and loss of visual information and evaluate mosaics for synthetic, phantom-based and ex vivo datasets.

Type: Proceedings paper
Title: Technical note: Probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: Application to fetoscopy
Event: SPIE Medical Imaging, 2018,
ISBN-13: 9781510616417
Open access status: An open access version is available from UCL Discovery
DOI: 10.1117/12.2319839
Publisher version: http://doi.org/10.1117/12.2319839
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10054065
Downloads since deposit
105Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item