Foti, Simone;
Koo, Bongjin;
Stoyanov, Danail;
Clarkson, Matthew J;
(2022)
3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces.
In:
Proceedings 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
IEEE
(In press).
Preview |
Text
2111.12448v5.pdf - Accepted Version Download (12MB) | Preview |
Abstract
Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is required. In this paper, we propose an intuitive yet effective self-supervised approach to train a 3D shape variational autoencoder (VAE) which encourages a disentangled latent representation of identity features. Curating the mini-batch generation by swapping arbitrary features across different shapes allows to define a loss function leveraging known differences and similarities in the latent representations. Experimental results conducted on 3D meshes show that state-of-the-art methods for latent disentanglement are not able to disentangle identity features of faces and bodies. Our proposed method properly decouples the generation of such features while maintaining good representation and reconstruction capabilities.
| Type: | Proceedings paper |
|---|---|
| Title: | 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces |
| Event: | CVPR 2022 |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://ieeexplore.ieee.org/xpl/conhome/1000147/al... |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng UCL > Provost and Vice Provost Offices > UCL BEAMS UCL UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10146037 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
