UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Dyadic joint visual attention interaction in face-to-face collaborative problem-solving at K-12 Maths Education: A Multimodal Approach

Yang, CW; Cukurova, M; Porayska-Pomsta, K; (2021) Dyadic joint visual attention interaction in face-to-face collaborative problem-solving at K-12 Maths Education: A Multimodal Approach. In: Proceedings of the First International Workshop on Multimodal Artificial Intelligence in Education (MAIED 2021) At the 22nd International Conference on Artificial Intelligence in Education (AIED 2021). (pp. pp. 61-70). CEUR Green open access

[thumbnail of Cukurova_paper6.pdf]
Preview
Text
Cukurova_paper6.pdf - Published Version

Download (1MB) | Preview

Abstract

Collaborative problem-solving (CPS) is an essential skill in the workplace in the 21st century, but the assessment and support of the CPS process with scientifically objective evidence are challenging. This research aims to understand in-class CPS interaction by investigating the change of a dyad's cognitive engagement during a mathematics lesson. Here, we propose a multimodal evaluation of joint visual attention (JVA) based on eye gazes and eye blinks data as non-verbal indicators of dyadic cognitive engagement. Our results indicate that this multimodal approach can bring more insights into students' CPS process than unimodal evaluations of JVA in temporal analysis. This study contributes to the field by demonstrating the value of nonverbal multimodal JVA temporal analysis in CPS assessment and the utility of eye physiological data in improving the interpretation of dyadic cognitive engagement. Moreover, a method is proposed for capturing gaze convergence by considering eye fixations and the overlapping time between two eye gazes. We conclude the paper with our preliminary findings from a pilot study investigating the proposed approach in a real-world teaching context.

Type: Proceedings paper
Title: Dyadic joint visual attention interaction in face-to-face collaborative problem-solving at K-12 Maths Education: A Multimodal Approach
Open access status: An open access version is available from UCL Discovery
Publisher version: http://ceur-ws.org/Vol-2902/
Language: English
Additional information: © 2021 for the individual papers by the papers' authors. Copyright © 2021 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media
URI: https://discovery.ucl.ac.uk/id/eprint/10132157
Downloads since deposit
132Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item