Chérief-Abdellatif, Badr-Eddine;
Shi, Yuyang;
Doucet, Arnaud;
Guedj, Benjamin;
(2022)
On PAC-Bayesian reconstruction guarantees for VAEs.
In: Camps-Valls, Gustau and Ruiz, Francisco JR and Valera, Isabel, (eds.)
Proceedings of The 25th International Conference on Artificial Intelligence and Statistics.
(pp. pp. 3066-2079).
Proceedings of Machine Learning Research (PMLR): Virtual conference.
Preview |
Text
Guedj_cherief-abdellatif22a.pdf Download (2MB) | Preview |
Abstract
Despite its wide use and empirical successes, the theoretical understanding and study of the behaviour and performance of the variational autoencoder (VAE) have only emerged in the past few years. We contribute to this recent line of work by analysing the VAE’s reconstruction ability for unseen test data, leveraging arguments from the PAC-Bayes theory. We provide generalisation bounds on the theoretical reconstruction error, and provide insights on the regularisation effect of VAE objectives. We illustrate our theoretical results with supporting experiments on classical benchmark datasets.
| Type: | Proceedings paper |
|---|---|
| Title: | On PAC-Bayesian reconstruction guarantees for VAEs |
| Event: | 25th International Conference on Artificial Intelligence and Statistics (AISTATS) 2022 |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://proceedings.mlr.press/v151/cherief-abdella... |
| Language: | English |
| Additional information: | This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10144913 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
