Chen, Qingshuang;
Abu-Zhaya, Rana;
Seidl, Amanda;
Zhu, Fengqing;
(2019)
CNN Based Touch Interaction Detection for Infant Speech Development.
In:
2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).
(pp. pp. 20-25).
IEEE: San Jose, CA, USA.
Preview |
Text
Abu Zhaya_CNN Based Touch Interaction Detection For Infant Speech Development_.pdf Download (702kB) | Preview |
Abstract
In this paper, we investigate the detection of interaction in videos between two people, namely, a caregiver and an infant. We are interested in a particular type of human interaction known as touch, as touch is a key social and emotional signal used by caregivers when interacting with their children. We propose an automatic touch event recognition method to determine the potential time interval when the caregiver touches the infant. In addition to label the touch events, we also classify them into six touch types based on which body part of infant has been touched. CNN based human pose estimation and person segmentation are used to analyze the spatial relationship between the caregivers hands and the infants. We demonstrate promising results for touch detection and show great potential of reducing human effort in manually generating precise touch annotations.
| Type: | Proceedings paper |
|---|---|
| Title: | CNN Based Touch Interaction Detection for Infant Speech Development |
| Event: | Second International Conference on Multimedia Information Processing and Retrieval MIPR 2019 |
| Location: | San Jose, CA |
| Dates: | 28 Mar 2019 - 30 Mar 2019 |
| ISBN-13: | 978-1-7281-1198-8 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/MIPR.2019.00012 |
| Publisher version: | https://doi.org/10.1109/MIPR.2019.00012 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Pose estimation; Detectors; Event detection; Task analysis; Feature extraction; Tracking; Pediatrics |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Speech, Hearing and Phonetic Sciences |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10165195 |
Archive Staff Only
 |
View Item |
