Qiao, M;
Zheng, J;
Zhang, W;
Ma, Q;
Li, L;
Kainz, B;
O’Regan, DP;
... Bai, W; + view all
(2026)
Mesh4D: A Motion-Aware Multi-view Variational Autoencoder for 3D+t Mesh Reconstruction.
In:
Image Computing and Computer Assisted Intervention – MICCAI 2025.
(pp. pp. 343-353).
Springer: Cham, Switzerland.
(In press).
![[thumbnail of 0276_paper.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/text.png) |
Text
0276_paper.pdf - Accepted Version Access restricted to UCL open access staff until 1 October 2026. Download (4MB) |
Abstract
Reconstructing temporally coherent 3D meshes of the beating heart from multi-view MR images is an important but challenging problem. The challenge is entangled by the complexity in integrating multi-view data, the sparse coverage of a 3D geometry by 2D image slices, and the interplay between geometry and motion. Current approaches often treat mesh reconstruction and motion estimation as two separate problems. Here we propose Mesh4D, a novel motion-aware method that jointly learns cardiac shape and motion, directly from multi-view MR image sequences. The method introduces three key innovations: (1) A cross-attention encoder that fuses multi-view image information, (2) A transformer-based variational autoencoder (VAE) that jointly model the image feature and motion, and (3) A deformation decoder that generates continuous deformation fields and temporally smooth 3D+t cardiac meshes. Incorporating geometric regularisation and motion consistency constraints, Mesh4D can reconstruct high-quality 3D+t meshes (7,698 vertices, 15,384 faces) of the heart ventricles across 50 time frames, within less than 3 s. When compared to existing approaches, Mesh4D achieves notable improvements in reconstruction accuracy and motion smoothness, offering an efficient image-to-mesh solution for quantifying shape and motion of the heart and creating digital heart models.
| Type: | Proceedings paper |
|---|---|
| Title: | Mesh4D: A Motion-Aware Multi-view Variational Autoencoder for 3D+t Mesh Reconstruction |
| Event: | Medical Image Computing and Computer Assisted Intervention – MICCAI 2025 |
| ISBN-13: | 9783032053244 |
| DOI: | 10.1007/978-3-032-05325-1_33 |
| Publisher version: | https://doi.org/10.1007/978-3-032-05325-1_33 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Mechanical Engineering |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10216712 |
Archive Staff Only
 |
View Item |
