UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks

Francis, A; Mrziglod, J; Sidiropoulos, P; Muller, J-P; (2021) SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks. IEEE Transactions on Geoscience and Remote Sensing 10.1109/TGRS.2021.3128280. (In press). Green open access

[thumbnail of 2111.08349v1.pdf]
Preview
Text
2111.08349v1.pdf - Accepted Version

Download (34MB) | Preview

Abstract

We introduce a novel neural network architecture -- Spectral ENcoder for SEnsor Independence (SEnSeI) -- by which several multispectral instruments, each with different combinations of spectral bands, can be used to train a generalised deep learning model. We focus on the problem of cloud masking, using several pre-existing datasets, and a new, freely available dataset for Sentinel-2. Our model is shown to achieve state-of-the-art performance on the satellites it was trained on (Sentinel-2 and Landsat 8), and is able to extrapolate to sensors it has not seen during training such as Landsat 7, Per\'uSat-1, and Sentinel-3 SLSTR. Model performance is shown to improve when multiple satellites are used in training, approaching or surpassing the performance of specialised, single-sensor models. This work is motivated by the fact that the remote sensing community has access to data taken with a hugely variety of sensors. This has inevitably led to labelling efforts being undertaken separately for different sensors, which limits the performance of deep learning models, given their need for huge training sets to perform optimally. Sensor independence can enable deep learning models to utilise multiple datasets for training simultaneously, boosting performance and making them much more widely applicable. This may lead to deep learning approaches being used more frequently for on-board applications and in ground segment data processing, which generally require models to be ready at launch or soon afterwards.

Type: Article
Title: SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TGRS.2021.3128280
Publisher version: http://dx.doi.org/10.1109/TGRS.2021.3128280
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Cloud masking, deep learning, multispectral, interoperability, sensor independence, earth observation
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Space and Climate Physics
URI: https://discovery.ucl.ac.uk/id/eprint/10139054
Downloads since deposit
56Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item