Volta, E;
Niewiadomski, R;
Olugbade, T;
Gilio, C;
Cocchi, E;
Berthouze, N;
Gori, M;
(2019)
Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children.
In: Gratch, Jonathan and Gunes, Hatice and Schuller, Bjorn and Valstar, Michel, (eds.)
Proceedings of the 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII).
(pp. pp. 420-426).
IEEE: Cambridge, UK.
Preview |
Text
ACII2019_weDRAWChiossWithoutCopy-Final.pdf - Accepted Version Download (169kB) | Preview |
Abstract
When developing children interaction systems, such as serious games in educational technology context, it is important to take into account and address relevant cognitive and emotional child's experiences that may influence learning outcomes. Some works were done to analyze and automatically recognize these cognitive and affective states from nonverbal expressive behaviors. However, there is a lack of knowledge about visually impaired children and their body language to convey those states during learning tasks. In this paper, we present an analysis of nonverbal expressive behaviors of both blind and low-vision children, aiming at understanding what type of body communication can be an indicator of two cognitive states: engagement and confidence. In the study we consider the data collected along the EU-ICT H2020 weDRAW Project, while children were asked to solve mathematical tasks with their body. For such dataset, we propose a list of 31 nonverbal behaviors, annotated both by visually impaired rehabilitators and naive observers. In the last part of the paper, we propose a preliminary study on automatic recognition of engagement and confidence states from 2D positional data. The classification results are up to 0.71 (F-score) on three class classification task.
| Type: | Proceedings paper |
|---|---|
| Title: | Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children |
| Event: | 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/ACII.2019.8925521 |
| Publisher version: | https://doi.org/10.1109/ACII.2019.8925521 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | visually impaired children, engagement, confidence, learning, cognition, nonverbal behaviors, classification, machine learning |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10078123 |
Archive Staff Only
 |
View Item |
