Alberti, Giovanni S;
Hertrich, Johannes;
Santacesaria, Matteo;
Sciutto, Silvia;
(2024)
Manifold Learning by Mixture Models of VAEs for Inverse Problems.
Journal of Machine Learning Research
, 25
, Article 202.
Preview |
Text
23-0396.pdf - Published Version Download (4MB) | Preview |
Abstract
Representing a manifold of very high-dimensional data with generative models has been shown to be computationally efficient in practice. However, this requires that the data manifold admits a global parameterization. In order to represent manifolds of arbitrary topology, we propose to learn a mixture model of variational autoencoders. Here, every encoder-decoder pair represents one chart of a manifold. We propose a loss function for maximum likelihood estimation of the model weights and choose an architecture that provides us the analytical expression of the charts and of their inverses. Once the manifold is learned, we use it for solving inverse problems by minimizing a data fidelity term restricted to the learned manifold. To solve the arising minimization problem we propose a Riemannian gradient descent algorithm on the learned manifold. We demonstrate the performance of our method for low-dimensional toy examples as well as for deblurring and electrical impedance tomography on certain image manifolds.
Type: | Article |
---|---|
Title: | Manifold Learning by Mixture Models of VAEs for Inverse Problems |
Open access status: | An open access version is available from UCL Discovery |
Publisher version: | https://www.jmlr.org/papers/v25/23-0396.html |
Language: | English |
Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. |
Keywords: | Manifold learning, mixture models, variational autoencoders, Riemannian optimization, inverse problems |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10195706 |
Archive Staff Only
View Item |