Tang, Xiangjun;
Wu, Linjun;
Wang, He;
Wu, Yiqian;
Hu, Bo;
Li, Songnan;
Gong, Xu;
... Jin, Xiaogang; + view all
(2024)
Decoupling Contact for Fine-Grained Motion Style Transfer.
In:
SIGGRAPH Asia 2024 Conference Papers.
(pp. pp. 1-11).
ACM
Preview |
Text
2409.05387v1.pdf - Accepted Version Download (5MB) | Preview |
Abstract
Motion style transfer changes the style of a motion while retaining its content and is useful in computer animations and games. Contact is an essential component of motion style transfer that should be controlled explicitly in order to express the style vividly while enhancing motion naturalness and quality. However, it is unknown how to decouple and control contact to achieve fine-grained control in motion style transfer. In this paper, we present a novel style transfer method for fine-grained control over contacts while achieving both motion naturalness and spatial-temporal variations of style. Based on our empirical evidence, we propose controlling contact indirectly through the hip velocity, which can be further decomposed into the trajectory and contact timing, respectively. To this end, we propose a new model that explicitly models the correlations between motions and trajectory/contact timing/style, allowing us to decouple and control each separately. Our approach is built around a motion manifold, where hip controls can be easily integrated into a Transformer-based decoder. It is versatile in that it can generate motions directly as well as be used as post-processing for existing methods to improve quality and contact controllability. In addition, we propose a new metric that measures a correlation pattern of motions based on our empirical evidence, aligning well with human perception in terms of motion naturalness. Based on extensive evaluation, our method outperforms existing methods in terms of style expressivity and motion quality.
| Type: | Proceedings paper |
|---|---|
| Title: | Decoupling Contact for Fine-Grained Motion Style Transfer |
| Event: | SA '24: SIGGRAPH Asia 2024 Conference Papers |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3680528.3687609 |
| Publisher version: | https://doi.org/10.1145/3680528.3687609 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Style transfer, Motion quality, Editing |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10203193 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
