Zhang, S;
Zhao, L;
Huang, S;
Mazomenos, EB;
Stoyanov, D;
(2024)
Direct Camera-Only Bundle Adjustment for 3D Textured Colon Surface Reconstruction Based on Pre-operative Model.
IEEE Transactions on Medical Robotics and Bionics
p. 1.
10.1109/TMRB.2024.3517168.
(In press).
Preview |
Text
Direct_Camera-Only_Bundle_Adjustment_for_3D_Textured_Colon_Surface_Reconstruction_Based_on_Pre-Operative_Model.pdf - Accepted Version Download (6MB) | Preview |
Abstract
This paper addresses the problem of reconstructing textured colon surface maps using a sequence of monocular colonoscopic images together with a 3D colon mesh model that has been segmented in CT colonography. The problem is formulated as a direct bundle adjustment (BA) problem which simultaneously optimizes all camera poses and the intensity of vertices on the pre-operative mesh model. This optimization is achieved by maximizing photometric consistency among multiple views of 2D images and the pre-operative 3D mesh model. The key properties of our proposed direct BA formulation involve eliminating the need for reference image specification, data association (feature extraction and matching), and image depth information. Thus, the proposed method is particularly suitable for scenarios where distinct features and image depth are not available, such as 2D colonoscopic images. Furthermore, we have proven that solving the proposed direct BA using the Gauss-Newton (GN) algorithm has the merit of optimizing camera poses only, which is equivalent to optimizing camera poses and the intensities of 3D vertices on the mesh together. Thus, a direct camera-only BA algorithm is proposed and used for 3D textured colon reconstruction from textureless 2D colonoscopic images. Validations using simulation, phantom, and in-vivo datasets are performed to demonstrate the accuracy and feasibility of the proposed algorithm.
| Type: | Article |
|---|---|
| Title: | Direct Camera-Only Bundle Adjustment for 3D Textured Colon Surface Reconstruction Based on Pre-operative Model |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TMRB.2024.3517168 |
| Publisher version: | https://doi.org/10.1109/tmrb.2024.3517168 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | colonoscopy, 3D reconstruction, camera-only, direct bundle adjustment, SLAM |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10202932 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
