Tao, Y;
Xiong, S;
Conway, SJ;
Muller, JP;
Guimpier, A;
Fawdon, P;
Thomas, N;
(2021)
Rapid single image-based dtm estimation from exomars tgo cassis images using generative adversarial u-nets.
Remote Sensing
, 13
(15)
, Article 2877. 10.3390/rs13152877.
Preview |
Text
remotesensing-13-02877-v2.pdf - Published Version Download (7MB) | Preview |
Abstract
The lack of adequate stereo coverage and where available, lengthy processing time, vari-ous artefacts, and unsatisfactory quality and complexity of automating the selection of the best set of processing parameters, have long been big barriers for large-area planetary 3D mapping. In this paper, we propose a deep learning-based solution, called MADNet (Multi-scale generative Adversarial u-net with Dense convolutional and up-projection blocks), that avoids or resolves all of the above issues. We demonstrate the wide applicability of this technique with the ExoMars Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) 4.6 m/pixel images on Mars. Only a single input image and a coarse global 3D reference are required, without knowing any camera models or imaging parameters, to produce high-quality and high-resolution full-strip Digital Terrain Models (DTMs) in a few seconds. In this paper, we discuss technical details of the MADNet system and provide detailed comparisons and assessments of the results. The resultant MADNet 8 m/pixel CaSSIS DTMs are qualitatively very similar to the 1 m/pixel HiRISE DTMs. The resultant MADNet CaSSIS DTMs display excellent agreement with nested Mars Reconnaissance Orbiter Context Camera (CTX), Mars Express’s High-Resolution Stereo Camera (HRSC), and Mars Orbiter Laser Altimeter (MOLA) DTMs at large-scale, and meanwhile, show fairly good correlation with the High-Resolution Imaging Science Experiment (HiRISE) DTMs for fine-scale details. In addition, we show how MADNet outperforms traditional photogrammetric methods, both on speed and quality, for other datasets like HRSC, CTX, and HiRISE, without any parameter tuning or re-training of the model. We demonstrate the results for Oxia Planum (the landing site of the European Space Agency’s Rosalind Franklin ExoMars rover 2023) and a couple of sites of high scientific interest.
| Type: | Article |
|---|---|
| Title: | Rapid single image-based dtm estimation from exomars tgo cassis images using generative adversarial u-nets |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.3390/rs13152877 |
| Publisher version: | https://doi.org/10.3390/rs13152877 |
| Language: | English |
| Additional information: | © 2021 by the Authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
| Keywords: | DTM; digital terrain model; deep learning; 3D mapping; 3D reconstruction; real-time 3D; TGO; CaSSIS; Oxia Planum; ExoMars; high-resolution 3D; Mars |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Space and Climate Physics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10132378 |
Archive Staff Only
 |
View Item |
