Wei, Xijia;
Wei, Zhiqiang;
Radu, Valentin;
(2021)
Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks.
Sensors
, 21
(22)
, Article 7488. 10.3390/s21227488.
Preview |
Text
Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks. .pdf - Published Version Download (2MB) | Preview |
Abstract
Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localization using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localization system, MM-Loc, relying on zero hand-engineered features, but learning automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures can estimate the location independently. But for better accuracy, a multimodal neural network that fuses the features of early modality-specific representations is a better proposition. Our proposed MM-Loc system is tested on cross-modality samples characterised by different sampling rate and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.
Type: | Article |
---|---|
Title: | Sensor-Fusion for Smartphone Location Tracking Using Hybrid Multimodal Deep Neural Networks |
Location: | Switzerland |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.3390/s21227488 |
Publisher version: | https://doi.org/10.3390/s21227488 |
Language: | English |
Additional information: | © 2022 MDPI. This is an open access article distributed under the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/). |
Keywords: | indoor localization, sensor fusion, multimodal deep neural network, multimodal sensing, wifi fingerprinting, pedestrian dead reckoning |
UCL classification: | UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL |
URI: | https://discovery.ucl.ac.uk/id/eprint/10149406 |
Archive Staff Only
View Item |