UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Process for the Semi-Automated Generation of Life-Sized, Interactive 3D Character Models for Holographic Projection

Huang, X; Twycross, J; Wild, F; (2019) A Process for the Semi-Automated Generation of Life-Sized, Interactive 3D Character Models for Holographic Projection. In: Proceedings of the 2019 International Conference on 3D Immersion (IC3D). IEEE Green open access

[thumbnail of A PROCESS  FOR THE SEMI-AUTOMATED GENERATION OF  LIFE-SIZED, INTERACTIVE 3D CHARACTER MODELS  FOR HOLOGRAPHIC PROJECTION  Xinyu Huang, John Twycross, Fridolin Wild.pdf]
Preview
Text
A PROCESS FOR THE SEMI-AUTOMATED GENERATION OF LIFE-SIZED, INTERACTIVE 3D CHARACTER MODELS FOR HOLOGRAPHIC PROJECTION Xinyu Huang, John Twycross, Fridolin Wild.pdf - Published Version

Download (2MB) | Preview

Abstract

By mixing digital data into the real world, Augmented Reality (AR) can deliver potent immersive and interactive experience to its users. In many application contexts, this requires the capability to deploy animated, high fidelity 3D character models. In this paper, we propose a novel approach to efficiently transform – using 3D scanning – an actor to a photorealistic, animated character. This generated 3D assistant must be able to move to perform recorded motion capture data, and it must be able to generate dialogue with lip sync to naturally interact with the users. The approach we propose for creating these virtual AR assistants utilizes photogrammetric scanning, motion capture, and free viewpoint video for their integration in Unity. We deploy the Occipital Structure sensor to acquire static high-resolution textured surfaces, and a Vicon motion capture system to track series of movements. The proposed capturing process consists of the steps scanning, reconstruction with Wrap 3 and Maya, editing texture maps to reduce artefacts with Photoshop, and rigging with Maya and Motion Builder to render the models fit for animation and lip-sync using LipSyncPro. We test the approach in Unity by scanning two human models with 23 captured animations each. Our findings indicate that the major factors affecting the result quality are environment setup, lighting, and processing constraints.

Type: Proceedings paper
Title: A Process for the Semi-Automated Generation of Life-Sized, Interactive 3D Character Models for Holographic Projection
Event: 2019 International Conference on 3D Immersion (IC3D)
ISBN-13: 978-1-7281-5189-2
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/IC3D48390.2019.8975993
Publisher version: https://doi.org/10.1109/IC3D48390.2019.8975993
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: 3D scanning, reconstruction, motion capture, Augmented Reality
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media
URI: https://discovery.ucl.ac.uk/id/eprint/10091505
Downloads since deposit
340Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item