Jerrim, J;
Parker, P;
Choi, A;
Chmielewski, AK;
Sälzer, Ch;
Shure, N;
(2018)
How Robust Are Cross‐Country Comparisons of PISA Scores to the Scaling Model Used?
Educational Measurement: Issues and Practice
10.1111/emip.12211.
(In press).
Preview |
Text
Jerrim_How robust are cross-country comparisons of PISA scores to the scaling model used_AAM.pdf - Accepted Version Download (1MB) | Preview |
Abstract
The Programme for International Student Assessment (PISA) is an important international study of 15‐olds' knowledge and skills. New results are released every 3 years, and have a substantial impact upon education policy. Yet, despite its influence, the methodology underpinning PISA has received significant criticism. Much of this criticism has focused upon the psychometric scaling model used to create the proficiency scores. The aim of this article is to therefore investigate the robustness of cross‐country comparisons of PISA scores to subtle changes to the underlying scaling model used. This includes the specification of the item‐response model, whether the difficulty and discrimination of items are allowed to vary across countries (item‐by‐country interactions) and how test questions not reached by pupils are treated. Our key finding is that these technical choices make little substantive difference to the overall country‐level results.
| Type: | Article |
|---|---|
| Title: | How Robust Are Cross‐Country Comparisons of PISA Scores to the Scaling Model Used? |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1111/emip.12211 |
| Publisher version: | https://doi.org/10.1111/emip.12211 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | item-response theory, PISA, large-scale international assessments |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10049242 |
Archive Staff Only
 |
View Item |
