Reidy, L;
Chan, D;
Nduka, C;
Gunes, H;
(2020)
Facial Electromyography-based Adaptive Virtual Reality Gaming for Cognitive Training.
ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction
, 2020
(October)
pp. 174-183.
10.1145/3382507.3418845.
Preview |
Text
icmi1164-reidyA.pdf - Published Version Download (4MB) | Preview |
Abstract
Cognitive training has shown promising results for delivering improvements in human cognition related to attention, problem solving, reading comprehension and information retrieval. However, two frequently cited problems in cognitive training literature are a lack of user engagement with the training programme, and a failure of developed skills to generalise to daily life. This paper introduces a new cognitive training (CT) paradigm designed to address these two limitations by combining the benefits of gamification, virtual reality (VR), and affective adaptation in the development of an engaging, ecologically valid, CT task. Additionally, it incorporates facial electromyography (EMG) as a means of determining user affect while engaged in the CT task. This information is then utilised to dynamically adjust the game's difficulty in real-time as users play, with the aim of leading them into a state of flow. Affect recognition rates of 64.1% and 76.2%, for valence and arousal respectively, were achieved by classifying a DWT-Haar approximation of the input signal using kNN. The affect-aware VR cognitive training intervention was then evaluated with a control group of older adults. The results obtained substantiate the notion that adaptation techniques can lead to greater feelings of competence and a more appropriate challenge of the user's skills.
| Type: | Article |
|---|---|
| Title: | Facial Electromyography-based Adaptive Virtual Reality Gaming for Cognitive Training |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3382507.3418845 |
| Publisher version: | https://doi.org/10.1145/3382507.3418845 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Institute of Cognitive Neuroscience |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10124912 |
Archive Staff Only
 |
View Item |
