Li, Q;
Lin, J;
Clancy, NT;
Elson, DS;
(2019)
Estimation of tissue oxygen saturation from RGB images and sparse hyperspectral signals based on conditional generative adversarial network.
International Journal of Computer Assisted Radiology and Surgery
, 14
(6)
pp. 987-995.
10.1007/s11548-019-01940-2.
Preview |
Text
Estimation of tissue oxygen saturation from RGB images and sparse hyperspectral signals based on conditional generative adve.pdf - Published Version Download (1MB) | Preview |
Abstract
PURPOSE: Intra-operative measurement of tissue oxygen saturation (StO_{2}) is important in detection of ischaemia, monitoring perfusion and identifying disease. Hyperspectral imaging (HSI) measures the optical reflectance spectrum of the tissue and uses this information to quantify its composition, including StO_{2}. However, real-time monitoring is difficult due to capture rate and data processing time. METHODS: An endoscopic system based on a multi-fibre probe was previously developed to sparsely capture HSI data (sHSI). These were combined with RGB images, via a deep neural network, to generate high-resolution hypercubes and calculate StO_{2}. To improve accuracy and processing speed, we propose a dual-input conditional generative adversarial network, Dual2StO2, to directly estimate StO_{2} by fusing features from both RGB and sHSI. RESULTS: Validation experiments were carried out on in vivo porcine bowel data, where the ground truth StO_{2} was generated from the HSI camera. Performance was also compared to our previous super-spectral-resolution network, SSRNet in terms of mean StO_{2} prediction accuracy and structural similarity metrics. Dual2StO2 was also tested using simulated probe data with varying fibre number. CONCLUSIONS: StO_{2} estimation by Dual2StO2 is visually closer to ground truth in general structure and achieves higher prediction accuracy and faster processing speed than SSRNet. Simulations showed that results improved when a greater number of fibres are used in the probe. Future work will include refinement of the network architecture, hardware optimization based on simulation results, and evaluation of the technique in clinical applications beyond StO_{2} estimation.
| Type: | Article |
|---|---|
| Title: | Estimation of tissue oxygen saturation from RGB images and sparse hyperspectral signals based on conditional generative adversarial network |
| Location: | FRANCE |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s11548-019-01940-2 |
| Publisher version: | https://doi.org/10.1007/s11548-019-01940-2 |
| Language: | English |
| Additional information: | © 2020 Springer Nature Switzerland AG. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/). |
| Keywords: | Intro-operative imaging, Optical imaging, Tissue oxygen saturation, Generative adversarial network |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10113123 |
Archive Staff Only
 |
View Item |
