Huang, X;
Twycross, J;
Wild, F;
(2019)
A Process for the Semi-Automated Generation of Life-Sized, Interactive 3D Character Models for Holographic Projection.
In:
Proceedings of the 2019 International Conference on 3D Immersion (IC3D).
IEEE
Preview |
Text
A PROCESS FOR THE SEMI-AUTOMATED GENERATION OF LIFE-SIZED, INTERACTIVE 3D CHARACTER MODELS FOR HOLOGRAPHIC PROJECTION Xinyu Huang, John Twycross, Fridolin Wild.pdf - Published Version Download (2MB) | Preview |
Abstract
By mixing digital data into the real world, Augmented Reality (AR) can deliver potent immersive and interactive experience to its users. In many application contexts, this requires the capability to deploy animated, high fidelity 3D character models. In this paper, we propose a novel approach to efficiently transform – using 3D scanning – an actor to a photorealistic, animated character. This generated 3D assistant must be able to move to perform recorded motion capture data, and it must be able to generate dialogue with lip sync to naturally interact with the users. The approach we propose for creating these virtual AR assistants utilizes photogrammetric scanning, motion capture, and free viewpoint video for their integration in Unity. We deploy the Occipital Structure sensor to acquire static high-resolution textured surfaces, and a Vicon motion capture system to track series of movements. The proposed capturing process consists of the steps scanning, reconstruction with Wrap 3 and Maya, editing texture maps to reduce artefacts with Photoshop, and rigging with Maya and Motion Builder to render the models fit for animation and lip-sync using LipSyncPro. We test the approach in Unity by scanning two human models with 23 captured animations each. Our findings indicate that the major factors affecting the result quality are environment setup, lighting, and processing constraints.
| Type: | Proceedings paper |
|---|---|
| Title: | A Process for the Semi-Automated Generation of Life-Sized, Interactive 3D Character Models for Holographic Projection |
| Event: | 2019 International Conference on 3D Immersion (IC3D) |
| ISBN-13: | 978-1-7281-5189-2 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/IC3D48390.2019.8975993 |
| Publisher version: | https://doi.org/10.1109/IC3D48390.2019.8975993 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | 3D scanning, reconstruction, motion capture, Augmented Reality |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10091505 |
Archive Staff Only
 |
View Item |
