UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Exploring the use of skeletal tracking for cheaper motion graphs and on-set decision making in free-viewpoint video production

MacQuarrie, A; Steed, A; (2020) Exploring the use of skeletal tracking for cheaper motion graphs and on-set decision making in free-viewpoint video production. In: Proceedings of the CVMP '20: European Conference on Visual Media Production. Association for Computing Machinery (ACM) Green open access

[img]
Preview
Text
CVMP_FVV_MotionGraphs.pdf - Accepted version

Download (5MB) | Preview

Abstract

In free-viewpoint video (FVV), the motion and surface appearance of a real-world performance is captured as an animated mesh. While this technology can produce high-fidelity recreations of actors, the required 3D reconstruction step has substantial processing demands. This means FVV experiences are currently expensive to produce, and the processing delay means on-set decisions are hampered by a lack of feedback. This work explores the possibility of using RGB-camera-based skeletal tracking to reduce the amount of content that must be 3D reconstructed, as well as aiding on-set decision making. One particularly relevant application is in the construction of Motion Graphs, where state-of-the-art techniques require large amounts of content to be 3D reconstructed before a graph can be built, resulting in large amounts of wasted processing effort. Here, we propose the use of skeletons to assess which clips of FVV content to process, resulting in substantial cost savings with a limited impact on performance accuracy. Additionally, we explore how this technique could be utilised on set to reduce the possibility of requiring expensive reshoots.

Type: Proceedings paper
Title: Exploring the use of skeletal tracking for cheaper motion graphs and on-set decision making in free-viewpoint video production
Event: CVMP '20: European Conference on Visual Media Production
ISBN-13: 978-1-4503-8198-7
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3429341.3429353
Publisher version: https://doi.org/10.1145/3429341.3429353
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10120190
Downloads since deposit
5Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item