UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Conditional Variational Autoencoder for Learned Image Reconstruction

Zhang, C; Barbano, R; Jin, B; (2021) Conditional Variational Autoencoder for Learned Image Reconstruction. Computation , 9 (11) , Article 114. 10.3390/computation9110114. Green open access

[thumbnail of Jin_computation-09-00114.pdf]
Preview
Text
Jin_computation-09-00114.pdf - Published Version

Download (1MB) | Preview

Abstract

Learned image reconstruction techniques using deep neural networks have recently gained popularity and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect information uncertainty. In this work, we develop a novel computational framework that approximates the posterior distribution of the unknown image at each query observation. The proposed framework is very flexible: it handles implicit noise models and priors, it incorporates the data formation process (i.e., the forward operator), and the learned reconstructive properties are transferable between different datasets. Once the network is trained using the conditional variational autoencoder loss, it provides a computationally efficient sampler for the approximate posterior distribution via feed-forward propagation, and the summarizing statistics of the generated samples are used for both point-estimation and uncertainty quantification. We illustrate the proposed framework with extensive numerical experiments on positron emission tomography (with both moderate and low-count levels) showing that the framework generates high-quality samples when compared with state-of-the-art methods.

Type: Article
Title: Conditional Variational Autoencoder for Learned Image Reconstruction
Open access status: An open access version is available from UCL Discovery
DOI: 10.3390/computation9110114
Publisher version: https://doi.org/10.3390/computation9110114
Language: English
Additional information: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
Keywords: conditional variational autoencoder; uncertainty quantification; deep learning; image reconstruction
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10137615
Downloads since deposit
348Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item