Jerrim, J;
Micklewright, J;
Heine, JH;
Salzer, C;
McKeown, C;
(2018)
PISA 2015: how big is the ‘mode effect’ and what has been done about it?
Oxford Review of Education
, 44
(4)
pp. 476-493.
10.1080/03054985.2018.1430025.
Preview |
Text
Jerrim_Revised_Main_Body_27_11_2017_Clean.pdf - Accepted Version Download (794kB) | Preview |
Abstract
The Programme for International Student Assessment (PISA) is an important cross-national study of 15-year-olds’ academic knowledge and skills. Educationalists and public policymakers eagerly await the tri-annual results, with particular interest in whether their country has moved up or slid down the international rankings, as compared to earlier rounds. In 2015 a major change was implemented in PISA, with the introduction of computer-based assessment. This has the potential to reduce comparability of PISA test scores across countries and over time. We investigate this issue using PISA 2015 field trial data for three countries: Germany, Sweden, and Ireland. We show how, if left unaccounted for, the change to computer-based testing could limit the comparability of PISA test scores. We then describe the methodology the study organisers have used to account for such mode effects. Our key conclusion is that although the adjustment made is unlikely to overcome all the potential challenges of switching to computer-based tests, it represents an improvement over the alternative of making no adjustment at all.
| Type: | Article |
|---|---|
| Title: | PISA 2015: how big is the ‘mode effect’ and what has been done about it? |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1080/03054985.2018.1430025 |
| Publisher version: | https://doi.org/10.1080/03054985.2018.1430025 |
| Language: | English |
| Additional information: | This version is the author accepted manuscrip. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | PISA, trends over time, mode effects, computer-based assessment |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10039757 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
