UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Learning Analytics Approach to Monitoring the Quality of Online One-to-One Tutoring

Cukurova, M; Khan, M; Millan, E; Luckin, R; (2022) A Learning Analytics Approach to Monitoring the Quality of Online One-to-One Tutoring. Journal of Learning Analytics , 9 (2) pp. 105-120. 10.18608/jla.2022.7411. Green open access

[thumbnail of Cukurova_7411-Article Text-36729-9-10-20220831.pdf] Text
Cukurova_7411-Article Text-36729-9-10-20220831.pdf

Download (643kB)

Abstract

One-to-one online tutoring provided by human tutors can improve students’ learning outcomes. However, monitoring the quality of such tutoring is a significant challenge. In this paper, we propose a learning analytics approach to monitoring online one-to-one tutoring quality. The approach analyzes teacher behaviours and classifies tutoring sessions into those that are effective and those that are not effective. More specifically, we use sequential behaviour pattern mining to analyze tutoring sessions using the CM-SPAM algorithm and classify tutoring sessions into effective and less effective using the J-48 and JRIP decision tree classifiers. To show the feasibility of the approach, we analyzed data from 2,250 minutes of online one-to-one primary math tutoring sessions with 44 tutors from eight schools. The results showed that the approach can classify tutors’ effectiveness with high accuracy (F measures of 0.89 and 0.98 were achieved). The results also showed that effective tutors present significantly more frequent hint provision and proactive planning behaviours than their less-effective colleagues in these online one-to-one sessions. Furthermore, effective tutors sequence their monitoring actions with appropriate pauses and initiations of students’ self-correction behaviours. We conclude that the proposed approach is feasible for monitoring the quality of online one-to-one primary math tutoring sessions.

Type: Article
Title: A Learning Analytics Approach to Monitoring the Quality of Online One-to-One Tutoring
Open access status: An open access version is available from UCL Discovery
DOI: 10.18608/jla.2022.7411
Publisher version: https://doi.org/10.18608/jla.2022.7411
Language: English
Additional information: Copyright (c) 2022 Journal of Learning Analytics. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Keywords: online one-to-one tutoring, learning analytics, sequential pattern mining, decision trees, research paper
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media
URI: https://discovery.ucl.ac.uk/id/eprint/10142366
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item