Agudo, A;
Martinez Montiel, JM;
Agapito, L;
Calvo, B;
(2017)
Modal Space: A Physics-Based Model for Sequential Estimation of Time-Varying Shape from Monocular Video.
Journal of Mathematical Imaging and Vision
, 57
(1)
pp. 75-98.
10.1007/s10851-016-0668-2.
Preview |
Text
De Agapito Vicente_87654427.pdf - Accepted Version Download (9MB) | Preview |
Abstract
This paper describes two sequential methods for recovering the camera pose together with the 3D shape of highly deformable surfaces from a monocular video. The nonrigid 3D shape is modeled as a linear combination of mode shapes with time-varying weights that define the shape at each frame and are estimated on-the-fly. The low-rank constraint is combined with standard smoothness priors to optimize the model parameters over a sliding window of image frames. We propose to obtain a physics-based shape basis using the initial frames on the video to code the time-varying shape along the sequence, reducing the problem from trilinear to bilinear. To this end, the 3D shape is discretized by means of a soup of elastic triangular finite elements where we apply a force balance equation. This equation is solved using modal analysis via a simple eigenvalue problem to obtain a shape basis that encodes the modes of deformation. Even though this strategy can be applied in a wide variety of scenarios, when the observations are denser, the solution can become prohibitive in terms of computational load. We avoid this limitation by proposing two efficient coarse-to-fine approaches that allow us to easily deal with dense 3D surfaces. This results in a scalable solution that estimates a small number of parameters per frame and could potentially run in real time. We show results on both synthetic and real videos with ground truth 3D data, while robustly dealing with artifacts such as noise and missing data.
| Type: | Article |
|---|---|
| Title: | Modal Space: A Physics-Based Model for Sequential Estimation of Time-Varying Shape from Monocular Video |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s10851-016-0668-2 |
| Publisher version: | https://doi.org/10.1007/s10851-016-0668-2 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Sequential nonrigid structure from motion, Dense reconstruction, Modal analysis, Finite elements |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10074877 |
Archive Staff Only
 |
View Item |
