Bonilla, Sierra;
Zhang, Shuai;
Psychogyios, Dimitrios;
Stoyanov, Danail;
Porto Guerra E Vasconcelos, Francisco;
Bano, Sophia;
(2024)
Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction.
In:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024.
(pp. pp. 274-283).
Spinger Nature: Cham, Switzerland.
![[thumbnail of GaussianPancakes-2.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/text.png) |
Text
GaussianPancakes-2.pdf - Accepted Version Access restricted to UCL open access staff until 4 October 2025. Download (27MB) |
Abstract
Within colorectal cancer diagnostics, conventional colonoscopy techniques face critical limitations, including a limited field of view and a lack of depth information, which can impede the detection of precancerous lesions. Current methods struggle to provide comprehensive and accurate 3D reconstructions of the colonic surface which can help minimize the missing regions and reinspection for pre-cancerous polyps. Addressing this, we introduce “Gaussian Pancakes”, a method that leverages 3D Gaussian Splatting (3D GS) combined with a Recurrent Neural Network-based Simultaneous Localization and Mapping (RNNSLAM) system. By introducing geometric and depth regularization into the 3D GS framework, our approach ensures more accurate alignment of Gaussians with the colon surface, resulting in smoother 3D reconstructions with novel viewing of detailed textures and structures. Evaluations across three diverse datasets show that Gaussian Pancakes enhances novel view synthesis quality, surpassing current leading methods with a 18% boost in PSNR and a 16% improvement in SSIM. It also delivers over 100\times faster rendering and more than 10\times shorter training times, making it a practical tool for real-time applications. Hence, this holds promise for achieving clinical translation for better detection and diagnosis of colorectal cancer. Code: https://github.com/smbonilla/GaussianPancakes.
| Type: | Proceedings paper |
|---|---|
| Title: | Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction |
| Event: | Medical Image Computing and Computer Assisted Intervention |
| ISBN-13: | 978-3-031-72088-8 |
| DOI: | 10.1007/978-3-031-72089-5_26 |
| Publisher version: | https://doi.org/10.1007/978-3-031-72089-5_26 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10201348 |
Loading...
Loading...Loading...| 1. |  United Kingdom | 1 |
Archive Staff Only
 |
View Item |
