UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Examining the predictive validity of the Duolingo English Test: Evidence from a major UK university

Isaacs, Talia; Hu, Ruolin; Trenkic, Danijela; Varga, Julia; (2023) Examining the predictive validity of the Duolingo English Test: Evidence from a major UK university. Language Testing , 40 (3) pp. 748-770. 10.1177/02655322231158550. Green open access

[thumbnail of Isaacs_Examining the predictive validity of the Duolingo English Test- Evidence from a major UK university_VoR.pdf]
Preview
Text
Isaacs_Examining the predictive validity of the Duolingo English Test- Evidence from a major UK university_VoR.pdf

Download (184kB) | Preview

Abstract

The COVID-19 pandemic has changed the university admissions and proficiency testing landscape. One change has been the meteoric rise in use of the fully automated Duolingo English Test (DET) for university entrance purposes, offering test-takers a cheaper, shorter, accessible alternative. This rapid response study is the first to investigate the predictive value of DET test scores in relation to university students’ academic attainment, taking into account students’ degree level, academic discipline, and nationality. We also compared DET test-takers’ academic performance with that of students admitted using traditional proficiency tests. Credit-weighted first-year academic grades of 1881 DET test-takers (1389 postgraduate, 492 undergraduate) enrolled at a large, research-intensive London university in Autumn 2020 were positively associated with DET Overall scores for postgraduate students (adj. r = .195) but not undergraduate students (adj. r = −.112). This result was mirrored in correlational patterns for students admitted through IELTS (n = 2651) and TOEFL iBT (n = 436), contributing to criterion-related validity evidence. Students admitted with DET enjoyed lower academic success than the IELTS and TOEFL iBT test-takers, although sample characteristics may have shaped this finding. We discuss implications for establishing cut scores and harnessing test-takers’ academic language development through pre-sessional and in-sessional support.

Type: Article
Title: Examining the predictive validity of the Duolingo English Test: Evidence from a major UK university
Open access status: An open access version is available from UCL Discovery
DOI: 10.1177/02655322231158550
Publisher version: https://doi.org/10.1177/02655322231158550
Language: English
Additional information: © The Author(s) 2023. This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/).
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media
URI: https://discovery.ucl.ac.uk/id/eprint/10164102
Downloads since deposit
129Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item