UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children

Volta, E; Niewiadomski, R; Olugbade, T; Gilio, C; Cocchi, E; Berthouze, N; Gori, M; (2019) Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children. In: Gratch, Jonathan and Gunes, Hatice and Schuller, Bjorn and Valstar, Michel, (eds.) Proceedings of the 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). (pp. pp. 420-426). IEEE: Cambridge, UK. Green open access

[thumbnail of ACII2019_weDRAWChiossWithoutCopy-Final.pdf]
Preview
Text
ACII2019_weDRAWChiossWithoutCopy-Final.pdf - Accepted Version

Download (169kB) | Preview

Abstract

When developing children interaction systems, such as serious games in educational technology context, it is important to take into account and address relevant cognitive and emotional child's experiences that may influence learning outcomes. Some works were done to analyze and automatically recognize these cognitive and affective states from nonverbal expressive behaviors. However, there is a lack of knowledge about visually impaired children and their body language to convey those states during learning tasks. In this paper, we present an analysis of nonverbal expressive behaviors of both blind and low-vision children, aiming at understanding what type of body communication can be an indicator of two cognitive states: engagement and confidence. In the study we consider the data collected along the EU-ICT H2020 weDRAW Project, while children were asked to solve mathematical tasks with their body. For such dataset, we propose a list of 31 nonverbal behaviors, annotated both by visually impaired rehabilitators and naive observers. In the last part of the paper, we propose a preliminary study on automatic recognition of engagement and confidence states from 2D positional data. The classification results are up to 0.71 (F-score) on three class classification task.

Type: Proceedings paper
Title: Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children
Event: 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/ACII.2019.8925521
Publisher version: https://doi.org/10.1109/ACII.2019.8925521
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: visually impaired children, engagement, confidence, learning, cognition, nonverbal behaviors, classification, machine learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
URI: https://discovery.ucl.ac.uk/id/eprint/10078123
Downloads since deposit
96Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item