Vally, Azraa;
Maswoswere, Gerald;
Bowden, Nicholas;
Paine, Stephen;
Amayo, Paul;
Markham, Andrew;
Patel, Amir;
(2025)
M2S2: A Multimodal Sensor System for Remote Animal Motion Capture in the Wild.
IEEE Sensors Letters
, 9
(4)
, Article 5501104. 10.1109/LSENS.2025.3542233.
Preview |
PDF
M2S2_sensorsLetters.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Capturing animal locomotion in the wild is far more challenging than in controlled laboratory settings. Wildlife subjects move unpredictably, and issues, such as scaling, occlusion, lighting changes, and the lack of ground truth data, make motion capture difficult. Unlike human biomechanics, where machine learning thrives with annotated datasets, such resources are scarce for wildlife. Multimodal sensing offers a solution by combining the strengths of various sensors, such as Light Detection and Ranging {LiDAR) and thermal cameras, to compensate for individual sensor limitations. In addition, some sensors, like LiDAR, can provide training data for monocular pose estimation models. We introduce a multimodal sensor system (M2S2) for capturing animal motion in the wild. M2S2 integrates RGB, depth, thermal, event, LiDAR, and acoustic sensors to overcome challenges like synchronization and calibration. We showcase its application with data from cheetahs, offering a new resource for advancing sensor fusion algorithms in wildlife motion capture. (Figure presented)
| Type: | Article |
|---|---|
| Title: | M2S2: A Multimodal Sensor System for Remote Animal Motion Capture in the Wild |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/LSENS.2025.3542233 |
| Publisher version: | https://doi.org/10.1109/lsens.2025.3542233 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Animals, Calibration, Cameras, Engineering, Engineering, Electrical & Electronic, Instruments & Instrumentation, Laser radar, motion capture, Motion capture, Physical Sciences, Physics, Physics, Applied, pose estimation, Pose estimation, Radar, Science & Technology, sensor fusion, sensor systems, Sensor systems, Sensors, Synchronization, Technology, Thermal sensors |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10210129 |
Archive Staff Only
 |
View Item |
