Gonzalez-Franco, M;
Egan, Z;
Peachey, M;
Antley, A;
Randhavane, T;
Panda, P;
Zhang, Y;
... Ofek, E; + view all
(2021)
MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library.
In:
Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR).
(pp. pp. 91-98).
Institute of Electrical and Electronics Engineers (IEEE): Utrecht, Netherlands.
Preview |
Text
MoveBox-Democratizing-MoCap-for-the-Microsoft-Rocketbox-Avatar-Library.pdf - Accepted Version Download (785kB) | Preview |
Abstract
This paper presents MoveBox an open sourced toolbox for animating motion captured (MoCap) movements onto the Microsoft Rocketbox library of avatars. Motion capture is performed using a single depth sensor, such as Azure Kinect or Windows Kinect V2. Motion capture is performed in real-time using a single depth sensor, such as Azure Kinect or Windows Kinect V2, or extracted from existing RGB videos offline leveraging deep-learning computer vision techniques. Our toolbox enables real-time animation of the user’s avatar by converting the transformations between systems that have different joints and hierarchies. Additional features of the toolbox include recording, playback and looping animations, as well as basic audio lip sync, blinking and resizing of avatars as well as finger and hand animations. Our main contribution is both in the creation of this open source tool as well as the validation on different devices and discussion of MoveBox’s capabilities by end users.
| Type: | Proceedings paper |
|---|---|
| Title: | MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library |
| Event: | 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) |
| ISBN-13: | 978-1-7281-7463-1 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/AIVR50618.2020.00026 |
| Publisher version: | https://doi.org/10.1109/AIVR50618.2020.00026 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | Avatars, Animation, Motion Capture, MoCap, Rigging, Depth Cameras, Lip Sync |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10120191 |
Archive Staff Only
 |
View Item |
