UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Manifold Learning by Mixture Models of VAEs for Inverse Problems

Alberti, Giovanni S; Hertrich, Johannes; Santacesaria, Matteo; Sciutto, Silvia; (2024) Manifold Learning by Mixture Models of VAEs for Inverse Problems. Journal of Machine Learning Research , 25 , Article 202. Green open access

[thumbnail of 23-0396.pdf]
Preview
Text
23-0396.pdf - Published Version

Download (4MB) | Preview

Abstract

Representing a manifold of very high-dimensional data with generative models has been shown to be computationally efficient in practice. However, this requires that the data manifold admits a global parameterization. In order to represent manifolds of arbitrary topology, we propose to learn a mixture model of variational autoencoders. Here, every encoder-decoder pair represents one chart of a manifold. We propose a loss function for maximum likelihood estimation of the model weights and choose an architecture that provides us the analytical expression of the charts and of their inverses. Once the manifold is learned, we use it for solving inverse problems by minimizing a data fidelity term restricted to the learned manifold. To solve the arising minimization problem we propose a Riemannian gradient descent algorithm on the learned manifold. We demonstrate the performance of our method for low-dimensional toy examples as well as for deblurring and electrical impedance tomography on certain image manifolds.

Type: Article
Title: Manifold Learning by Mixture Models of VAEs for Inverse Problems
Open access status: An open access version is available from UCL Discovery
Publisher version: https://www.jmlr.org/papers/v25/23-0396.html
Language: English
Additional information: This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.
Keywords: Manifold learning, mixture models, variational autoencoders, Riemannian optimization, inverse problems
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10195706
Downloads since deposit
10Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item