Zheng, Q;
Wu, W;
Pan, H;
Mitra, N;
Cohen-Or, D;
Huang, H;
(2021)
Inferring object properties from human interaction and transferring them to new motions.
Computational Visual Media
, 7
(3)
pp. 375-392.
10.1007/s41095-021-0218-8.
Preview |
Text
Mitra_Zheng2021_Article_InferringObjectPropertiesFromH.pdf - Published Version Download (2MB) | Preview |
Abstract
Humans regularly interact with their surrounding objects. Such interactions often result in strongly correlated motions between humans and the interacting objects. We thus ask: “Is it possible to infer object properties from skeletal motion alone, even without seeing the interacting object itself?” In this paper, we present a fine-grained action recognition method that learns to infer such latent object properties from human interaction motion alone. This inference allows us to disentangle the motion from the object property and transfer object properties to a given motion. We collected a large number of videos and 3D skeletal motions of performing actors using an inertial motion capture device. We analyzed similar actions and learned subtle differences between them to reveal latent properties of the interacting objects. In particular, we learned to identify the interacting object, by estimating its weight, or its spillability. Our results clearly demonstrate that motions and interacting objects are highly correlated and that related object latent properties can be inferred from 3D skeleton sequences alone, leading to new synthesis possibilities for motions involving human interaction.
| Type: | Article |
|---|---|
| Title: | Inferring object properties from human interaction and transferring them to new motions |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s41095-021-0218-8 |
| Publisher version: | https://doi.org/10.1007/s41095-021-0218-8 |
| Language: | English |
| Additional information: | This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10139846 |
Archive Staff Only
 |
View Item |
