General or specific abilities? Evidence from 33 countries participating in the PISA assessments

Advanced search
Browse by:

Department | Year

UCL Theses | Latest

Deposit your research

General or specific abilities? Evidence from 33 countries participating in the PISA assessments

Pokropek, A; Marks, GN; Borgonovi, F; Koc, P; Greiff, S; (2022) General or specific abilities? Evidence from 33 countries participating in the PISA assessments. Intelligence , 92 , Article 101653. 10.1016/j.intell.2022.101653. Green open access

[thumbnail of Pokropek_Marks_Borgonovi_Kock_Greiff_RPS.pdf]

Preview

Text
Pokropek_Marks_Borgonovi_Kock_Greiff_RPS.pdf - Accepted Version
Download (1MB) | Preview

Abstract

Psychometricians working on International Large Scale Assessments (ILSAs) typically specify latent ability factors with distinct and correlated constructs for test domains, such as reading, mathematics and science. A construct for general ability is not specified. However, several country-specific studies conclude that ILSAs largely reflect general ability. We extend such studies and examine the dimensionality of the 2018 PISA assessment in 33 OECD countries examining three models: three-dimensional IRT model, the bifactor IRT model and the bifactor (S-1) IRT model. A four-tiered approach was adopted. First, models were compared using an information criterion (AIC). Second, the correlations from the multidimensional model were estimated to assess in which countries the three dimensions are sufficient discriminant validity. Third, a variety of bifactor indices were utilized to establish the explanatory power and reliabilities of the latent dimensions generated by the three models. Finally, the statistical relationships between the latent factors derived from the three models and educationally relevant covariates were estimated. The bifactor model fits the data better than standard multidimensional model or S-1 model in every country investigated. The correlations in the correlated factor model are above 0.8 in all 33 countries. The symmetrical bifactor general ability model shows that 80%, or more, of the common variance in student responses to the PISA instruments is accounted for by a general ability factor. On average, 27% of variance in the mathematics items is independent of the general factor and can be attributed to a specific mathematics ability factor. The respective estimates for reading are 12% and science is 17%. Relationships for selected covariates with the PISA domains follow the same pattern as general ability in the bifactor model.

Type:	Article
Title:	General or specific abilities? Evidence from 33 countries participating in the PISA assessments
Open access status:	An open access version is available from UCL Discovery
DOI:	10.1016/j.intell.2022.101653
Publisher version:	https://doi.org/10.1016/j.intell.2022.101653
Language:	English
Additional information:	This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords:	Social Sciences, Psychology, Multidisciplinary, Psychology, Bifactor model, S-1 model, Scaling of large-scale assessments, PISA, General ability, ACADEMIC-ACHIEVEMENT, SEX-DIFFERENCES, READING-ACHIEVEMENT, GENETIC-ANALYSIS, BIFACTOR MODELS, INTELLIGENCE, SCHOOL, MATHEMATICS, PERFORMANCE, TIMSS
UCL classification:	UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute UCL > Provost and Vice Provost Offices > School of Education UCL
URI:	https://discovery.ucl.ac.uk/id/eprint/10151149