Verinaz-Jadan, H;
Howe, CL;
Song, P;
Lesept, F;
Kittler, J;
Foust, AJ;
Dragotti, PL;
(2023)
Physics-Based Deep Learning for Imaging Neuronal Activity via Two-Photon and Light Field Microscopy.
IEEE Transactions on Computational Imaging
, 9
pp. 565-580.
10.1109/TCI.2023.3282052.
Preview |
PDF
LFM2P_paper (1).pdf - Other Download (7MB) | Preview |
Abstract
Light Field Microscopy (LFM) is an imaging technique that offers the opportunity to study fast dynamics in biological systems due to its 3D imaging speed and is particularly attractive for functional neuroimaging. Traditional model-based approaches employed in microscopy for reconstructing 3D images from light-field data are affected by reconstruction artifacts and are computationally demanding. This work introduces a deep neural network for LFM to image neuronal activity under adverse conditions: limited training data, background noise, and scattering mammalian brain tissue. The architecture of the network is obtained by unfolding the ISTA algorithm and is based on the observation that neurons in the tissue are sparse. Our approach is also based on a novel modelling of the imaging system that uses a linear convolutional neural network to fit the physics of the acquisition process. We train the network in a semi-supervised manner based on an adversarial training framework. The small labelled dataset required for training is acquired from a single sample via two-photon microscopy, a point-scanning 3D imaging technique that achieves high spatial resolution and deep tissue penetration but at a lower speed than LFM. We introduce physics knowledge of the system in the design of the network architecture and during training to complete our semi-supervised approach. We experimentally show that in the proposed scenario, our method performs better than typical deep learning and model-based reconstruction strategies for imaging neuronal activity in mammalian brain tissue via LFM, considering reconstruction quality, generalization to functional imaging, and reconstruction speed.
| Type: | Article |
|---|---|
| Title: | Physics-Based Deep Learning for Imaging Neuronal Activity via Two-Photon and Light Field Microscopy |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TCI.2023.3282052 |
| Publisher version: | https://doi.org/10.1109/TCI.2023.3282052 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences > Neuro, Physiology and Pharmacology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10183406 |
Archive Staff Only
 |
View Item |
