Lin, J;
Clancy, NT;
Sun, X;
Qi, J;
Janatka, M;
Stoyanov, D;
Elson, DS;
(2016)
Probe-based rapid hybrid hyperspectral and tissue surface imaging aided by fully convolutional networks.
In: Ourselin, S and Joskowicz, L and Sabuncu, MR and Udal, G and Wells, W, (eds.)
Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016: 19th International Conference, Athens, Greece, October 17-21, 2016, Proceedings, Part III.
(pp. pp. 414-422).
Springer International Publishing: Athens, Greece.
Preview |
Text
Stoyanov_1606.04766v1.pdf - Accepted Version Download (456kB) | Preview |
Abstract
Tissue surface shape and reflectance spectra provide rich intra-operative information useful in surgical guidance. We propose a hybrid system which displays an endoscopic image with a fast joint inspection of tissue surface shape using structured light (SL) and hyperspectral imaging (HSI). For SL a miniature fibre probe is used to project a coloured spot pattern onto the tissue surface. In HSI mode standard endoscopic illumination is used, with the fibre probe collecting reflected light and encoding the spatial information into a linear format that can be imaged onto the slit of a spectrograph. Correspondence between the arrangement of fibres at the distal and proximal ends of the bundle was found using spectral encoding. Then during pattern decoding, a fully convolutional network (FCN) was used for spot detection, followed by a matching propagation algorithm for spot identification. This method enabled fast reconstruction (12 frames per second) using a GPU. The hyperspectral image was combined with the white light image and the reconstructed surface, showing the spectral information of different areas. Validation of this system using phantom and ex vivo experiments has been demonstrated.
Type: | Proceedings paper |
---|---|
Title: | Probe-based rapid hybrid hyperspectral and tissue surface imaging aided by fully convolutional networks |
Event: | International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2016) |
ISBN-13: | 9783319467252 |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1007/978-3-319-46726-9_48 |
Publisher version: | http://dx.doi.org/10.1007/978-3-319-46726-9_48 |
Language: | English |
Additional information: | The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-46726-9_48.S. |
Keywords: | Structured light, Hyperspectral imaging, Endoscopy, Deep learning |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng |
URI: | https://discovery.ucl.ac.uk/id/eprint/1530816 |
Archive Staff Only
View Item |