UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks

Wei, Xijia; Wei, Zhiqiang; Radu, Valentin; (2021) Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks. Sensors , 21 (22) , Article 7488. 10.3390/s21227488. Green open access

[thumbnail of Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks. .pdf]
Preview
Text
Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks. .pdf - Published Version

Download (2MB) | Preview

Abstract

Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localization using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localization system, MM-Loc, relying on zero hand-engineered features, but learning automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures can estimate the location independently. But for better accuracy, a multimodal neural network that fuses the features of early modality-specific representations is a better proposition. Our proposed MM-Loc system is tested on cross-modality samples characterised by different sampling rate and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

Type: Article
Title: Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks
Location: Switzerland
Open access status: An open access version is available from UCL Discovery
DOI: 10.3390/s21227488
Publisher version: https://doi.org/10.3390/s21227488
Language: English
Additional information: © 2022 MDPI. This is an open access article distributed under the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/).
Keywords: indoor localization, sensor fusion, multimodal deep neural network, multimodal sensing, wifi fingerprinting, pedestrian dead reckoning
UCL classification: UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10149406
Downloads since deposit
15Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item