Wang, Tuanfeng Y;
Ceylan, Duygu;
Singh, Krishna Kumar;
Mitra, Niloy J;
(2022)
Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis.
In:
2021 International Conference on 3D Vision (3DV).
(pp. pp. 268-277).
IEEE: London,UK.
Preview |
PDF
dance.pdf - Accepted Version Download (5MB) | Preview |
Abstract
Synthesizing dynamic appearances of humans in motion plays a central role in applications such as ARWR and video editing. While many recent methods have been proposed to tackle this problem,handling loose garments with complex textures and high dynamic motion still remains challenging. In this paper,we propose a video based appearance synthesis method that tackles such challenges and demonstrates high quality results for in-the-wild videos that have not been shown before. Specifically,we adopt a StyleGAN based architecture to the task of person specific video based motion retargeting. We introduce a novel motion signature that is used to modulate the generator weights to capture dynamic appearance changes as well as regularizing the single frame based pose estimates to improve temporal coherency. We evaluate our method on a set of challenging videos and show that our approach achieves state-of-the-art performance both qualitatively and quantitatively.
| Type: | Proceedings paper |
|---|---|
| Title: | Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis |
| Event: | 9th International Conference on 3D Vision (3DV) |
| Location: | ELECTR NETWORK |
| Dates: | 1 Dec 2021 - 3 Dec 2021 |
| ISBN-13: | 9781665426886 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/3DV53792.2021.00037 |
| Publisher version: | https://doi.org/10.1109/3DV53792.2021.00037 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Science & Technology, Technology, Computer Science, Artificial Intelligence, Computer Science, Software Engineering, Engineering, Electrical & Electronic, Imaging Science & Photographic Technology, Computer Science, Engineering |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10159079 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
