Pan, Xiaoyu;
Zheng, Bowen;
Jiang, Xinwei;
Xu, Guanglong;
Gu, Xianli;
Li, Jingxiang;
Kou, Qilong;
... Jin, Xiaogang; + view all
(2023)
A Locality-based Neural Solver for Optical Motion Capture.
In:
SA '23: SIGGRAPH Asia 2023 Conference Papers.
(pp. p. 117).
ACM
Preview |
PDF
2309.00428.pdf - Accepted Version Download (33MB) | Preview |
Abstract
We present a novel locality-based learning method for cleaning and solving optical motion capture data. Given noisy marker data, we propose a new heterogeneous graph neural network which treats markers and joints as different types of nodes, and uses graph convolution operations to extract the local features of markers and joints and transform them to clean motions. To deal with anomaly markers (e.g. occluded or with big tracking errors), the key insight is that a marker’s motion shows strong correlations with the motions of its immediate neighboring markers but less so with other markers, a.k.a. locality, which enables us to efficiently fill missing markers (e.g. due to occlusion). Additionally, we also identify marker outliers due to tracking errors by investigating their acceleration profiles. Finally, we propose a training regime based on representation learning and data augmentation, by training the model on data with masking. The masking schemes aim to mimic the occluded and noisy markers often observed in the real data. Finally, we show that our method achieves high accuracy on multiple metrics across various datasets. Extensive comparison shows our method outperforms state-of-the-art methods in terms of prediction accuracy of occluded marker position error by approximately 20%, which leads to a further error reduction on the reconstructed joint rotations and positions by 30%. The code and data for this paper are available at https://github.com/non-void/LocalMoCap.
| Type: | Proceedings paper |
|---|---|
| Title: | A Locality-based Neural Solver for Optical Motion Capture |
| Event: | SA '23: SIGGRAPH Asia 2023 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3610548.3618148 |
| Publisher version: | http://dx.doi.org/10.1145/3610548.3618148 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Motion Capture, Motion Capture Marker Cleaning, Motion Capture Solving, Machine Learning |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10184390 |
Archive Staff Only
 |
View Item |
