Mustafa, Armin;
Caliskan, Akin;
Agapito, Lourdes;
Hilton, Adrian;
(2021)
Multi-person Implicit Reconstruction from a Single Image.
In:
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021.
(pp. pp. 14469-14478).
Institute of Electrical and Electronics Engineers (IEEE)
Preview |
Text
De Agapito Vicente_Multi-person Implicit Reconstruction from a Single Image_AAM.pdf Download (8MB) | Preview |
Abstract
We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and therefore cannot capture accurate 3D models of people with loose clothing and hair; or they require manual intervention to resolve occlusions or interactions. Our method addresses both limitations by introducing the first end-to-end learning approach to perform model-free implicit reconstruction for realistic 3D capture of multiple clothed people in arbitrary poses (with occlusions) from a single image. Our network simultaneously estimates the 3D geometry of each person and their 6DOF spatial locations, to obtain a coherent multi-human reconstruction. In addition, we introduce a new synthetic dataset that depicts images with a varying number of inter-occluded humans and a variety of clothing and hair styles. We demonstrate robust, high-resolution reconstructions on images of multiple humans with complex occlusions, loose clothing and a large variety of poses and scenes. Our quantitative evaluation on both synthetic and real world datasets demonstrates state-of-the-art performance with significant improvements in the accuracy and completeness of the reconstructions over competing approaches.
| Type: | Proceedings paper |
|---|---|
| Title: | Multi-person Implicit Reconstruction from a Single Image |
| Event: | IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
| Location: | Nashville, TN, USA |
| Dates: | 20th-25th June 2021 |
| ISBN-13: | 978-1-6654-4509-2 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/CVPR46437.2021.01424 |
| Publisher version: | https://doi.org/10.1109/CVPR46437.2021.01424 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | Hair, Solid modeling, Three-dimensional displays, Shape, Clothing, Spatial coherence, Manuals |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10150697 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
