Goo, June Moh; Zeng, Zichao; Morelli, Luca; Remondino, Fabio; Boehm, Jan; (2025) Exploring modern end-to-end AI-based multi-view 3D reconstruction. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences , XLVIII pp. 91-97. 10.5194/isprs-archives-xlviii-1-w6-2025-91-2025.

Preview

PDF isprs-archives-XLVIII-1-W6-2025-91-2025.pdf - Published Version Download (7MB) | Preview

Abstract

Deriving accurate 3D geometry from multi-view 2D imagery remains a fundamental problem in photogrammetry and computer vision. Conventional pipelines, comprising feature extraction, image matching, bundle adjustment and dense reconstruction, are grounded in well-established geometric principles but remain sensitive to complex scenarios such as significant illumination variability, deficiency in texture and high variability in viewing angles. Recent deep learning developments have triggered a paradigm shift, reformulating multi-view 3D reconstruction as a data-driven, end-to-end optimization problem. Neural architectures now jointly learn feature representations, correspondence estimation and geometric reasoning, supported by large-scale training datasets, high-performance GPU computation, transformer networks and differentiable rendering frameworks. This study methodically examines the transition from traditional photogrammetric approaches to end-to-end AI-based reconstruction pipelines. Using benchmark geomatic datasets, we quantitatively evaluate the performance of two recent and representative end-to-end deep learning methods compared to classical photogrammetry. Results highlight performances of AI-driven approaches in 3D reconstructions and their limits for in large-scale, metric-oriented mapping and modeling applications.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item