UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Physics-Based Deep Learning for Imaging Neuronal Activity via Two-Photon and Light Field Microscopy

Verinaz-Jadan, H; Howe, CL; Song, P; Lesept, F; Kittler, J; Foust, AJ; Dragotti, PL; (2023) Physics-Based Deep Learning for Imaging Neuronal Activity via Two-Photon and Light Field Microscopy. IEEE Transactions on Computational Imaging , 9 pp. 565-580. 10.1109/TCI.2023.3282052. Green open access

[thumbnail of LFM2P_paper (1).pdf]
Preview
PDF
LFM2P_paper (1).pdf - Other

Download (7MB) | Preview

Abstract

Light Field Microscopy (LFM) is an imaging technique that offers the opportunity to study fast dynamics in biological systems due to its 3D imaging speed and is particularly attractive for functional neuroimaging. Traditional model-based approaches employed in microscopy for reconstructing 3D images from light-field data are affected by reconstruction artifacts and are computationally demanding. This work introduces a deep neural network for LFM to image neuronal activity under adverse conditions: limited training data, background noise, and scattering mammalian brain tissue. The architecture of the network is obtained by unfolding the ISTA algorithm and is based on the observation that neurons in the tissue are sparse. Our approach is also based on a novel modelling of the imaging system that uses a linear convolutional neural network to fit the physics of the acquisition process. We train the network in a semi-supervised manner based on an adversarial training framework. The small labelled dataset required for training is acquired from a single sample via two-photon microscopy, a point-scanning 3D imaging technique that achieves high spatial resolution and deep tissue penetration but at a lower speed than LFM. We introduce physics knowledge of the system in the design of the network architecture and during training to complete our semi-supervised approach. We experimentally show that in the proposed scenario, our method performs better than typical deep learning and model-based reconstruction strategies for imaging neuronal activity in mammalian brain tissue via LFM, considering reconstruction quality, generalization to functional imaging, and reconstruction speed.

Type: Article
Title: Physics-Based Deep Learning for Imaging Neuronal Activity via Two-Photon and Light Field Microscopy
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TCI.2023.3282052
Publisher version: https://doi.org/10.1109/TCI.2023.3282052
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences > Neuro, Physiology and Pharmacology
URI: https://discovery.ucl.ac.uk/id/eprint/10183406
Downloads since deposit
5Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item