UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

3D Localization for Light-Field Microscopy via Convolutional Sparse Coding on Epipolar Images

Song, P; Jadan, HV; Howe, CL; Quicke, P; Foust, AJ; Dragotti, PL; (2020) 3D Localization for Light-Field Microscopy via Convolutional Sparse Coding on Epipolar Images. IEEE Transactions on Computational Imaging , 6 pp. 1017-1032. 10.1109/TCI.2020.2997301. Green open access

[thumbnail of 09103942.pdf]
Preview
Text
09103942.pdf - Published Version

Download (11MB) | Preview

Abstract

Light-field microscopy (LFM) is a type of all-optical imaging system that is able to capture 4D geometric information of light rays and can reconstruct a 3D model from a single snapshot. In this paper, we propose a new 3D localization approach to effectively detect 3D positions of neuronal cells from a single light-field image with high accuracy and outstanding robustness to light scattering. This is achieved by constructing a depth-aware dictionary and by combining it with convolutional sparse coding. Specifically, our approach includes 3 key parts: light-field calibration, depth-aware dictionary construction, and localization based on convolutional sparse coding (CSC). In the first part, an observed raw light-field image is calibrated and then decoded into a two-plane parameterized 4D format which leads to the epi-polar plane image (EPI). The second part involves simulating a set of light-fields using a wave-optics forward model for a ball-shaped volume that is located at different depths. Then, a depth-aware dictionary is constructed where each element is a synthetic EPI associated to a specific depth. Finally, by taking full advantage of the sparsity prior and shift-invariance property of EPI, 3D localization is achieved via convolutional sparse coding on an observed EPI with respect to the depth-aware EPI dictionary. We evaluate our approach on both non-scattering specimen (fluorescent beads suspended in agarose gel) and scattering media (brain tissues of genetically encoded mice). Extensive experiments demonstrate that our approach can reliably detect the 3D positions of granular targets with small Root Mean Square Error (RMSE), high robustness to optical aberration and light scattering in mammalian brain tissues.

Type: Article
Title: 3D Localization for Light-Field Microscopy via Convolutional Sparse Coding on Epipolar Images
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TCI.2020.2997301
Publisher version: https://doi.org/10.1109/TCI.2020.2997301
Language: English
Additional information: This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/.
Keywords: Light-field microscopy, epi-polar plane image, convolutional sparse coding, depth-aware dictionary
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10109554
Downloads since deposit
86Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item