UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Movement in Multiple Time Neural Network for Automatic Detection of Pain Behaviour

Olugbade, T; Gold, N; Williams, A; Berthouze, N; (2020) A Movement in Multiple Time Neural Network for Automatic Detection of Pain Behaviour. In: ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal Interaction. (pp. pp. 442-445). ACM Green open access

[thumbnail of ICMI_Workshop__MTNN__2020_camera_ready.pdf]
Preview
Text
ICMI_Workshop__MTNN__2020_camera_ready.pdf - Accepted Version

Download (471kB) | Preview

Abstract

The use of multiple clocks has been a favoured approach to modelling the multiple timescales of sequential data. Previous work based on clocks and multi-timescale studies in general have not clearly accounted for multidimensionality of data such that each dimension has its own timescale(s). Focusing on body movement data which has independent yet coordinating degrees of freedom, we propose a Movement in Multiple Time (MiMT) neural network. Our MiMT models multiple timescales by learning different levels of movement interpretation (i.e. labels) and further allows for separate timescales across movements dimensions. We obtain 0.75 and 0.58 average F1 scores respectively for binary frame-level and three-class window-level classification of pain behaviour based on the MiMT. Findings in ablation studies suggest that these two elements of the MiMT are valuable to modelling multiple timescales of multidimensional sequential data.

Type: Proceedings paper
Title: A Movement in Multiple Time Neural Network for Automatic Detection of Pain Behaviour
Event: The 2020 International Conference on Multimodal Interaction (ICMI ’20 Companion)
Location: Virtual Event, Netherlands
Dates: 25 October 2020 - 29 October 2020
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3395035.3425969
Publisher version: https://doi.org/10.1145/3395035.3425969
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Clinical, Edu and Hlth Psychology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10110932
Downloads since deposit
55Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item