eprintid: 10151149 rev_number: 8 eprint_status: archive userid: 699 dir: disk0/10/15/11/49 datestamp: 2022-07-04 10:45:56 lastmod: 2024-05-06 06:10:04 status_changed: 2022-07-04 10:45:56 type: article metadata_visibility: show sword_depositor: 699 creators_name: Pokropek, A creators_name: Marks, GN creators_name: Borgonovi, F creators_name: Koc, P creators_name: Greiff, S title: General or specific abilities? Evidence from 33 countries participating in the PISA assessments ispublished: pub divisions: B14 divisions: J81 divisions: B16 divisions: UCL keywords: Social Sciences, Psychology, Multidisciplinary, Psychology, Bifactor model, S-1 model, Scaling of large-scale assessments, PISA, General ability, ACADEMIC-ACHIEVEMENT, SEX-DIFFERENCES, READING-ACHIEVEMENT, GENETIC-ANALYSIS, BIFACTOR MODELS, INTELLIGENCE, SCHOOL, MATHEMATICS, PERFORMANCE, TIMSS note: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. abstract: Psychometricians working on International Large Scale Assessments (ILSAs) typically specify latent ability factors with distinct and correlated constructs for test domains, such as reading, mathematics and science. A construct for general ability is not specified. However, several country-specific studies conclude that ILSAs largely reflect general ability. We extend such studies and examine the dimensionality of the 2018 PISA assessment in 33 OECD countries examining three models: three-dimensional IRT model, the bifactor IRT model and the bifactor (S-1) IRT model. A four-tiered approach was adopted. First, models were compared using an information criterion (AIC). Second, the correlations from the multidimensional model were estimated to assess in which countries the three dimensions are sufficient discriminant validity. Third, a variety of bifactor indices were utilized to establish the explanatory power and reliabilities of the latent dimensions generated by the three models. Finally, the statistical relationships between the latent factors derived from the three models and educationally relevant covariates were estimated. The bifactor model fits the data better than standard multidimensional model or S-1 model in every country investigated. The correlations in the correlated factor model are above 0.8 in all 33 countries. The symmetrical bifactor general ability model shows that 80%, or more, of the common variance in student responses to the PISA instruments is accounted for by a general ability factor. On average, 27% of variance in the mathematics items is independent of the general factor and can be attributed to a specific mathematics ability factor. The respective estimates for reading are 12% and science is 17%. Relationships for selected covariates with the PISA domains follow the same pattern as general ability in the bifactor model. date: 2022-05-05 date_type: published publisher: ELSEVIER SCIENCE INC official_url: https://doi.org/10.1016/j.intell.2022.101653 oa_status: green full_text_type: other language: eng primo: open primo_central: open_green verified: verified_manual elements_id: 1957220 doi: 10.1016/j.intell.2022.101653 lyricists_name: Borgonovi, Francesca lyricists_id: FBORG54 actors_name: Borgonovi, Francesca actors_id: FBORG54 actors_role: owner full_text_status: public publication: Intelligence volume: 92 article_number: 101653 pages: 13 citation: Pokropek, A; Marks, GN; Borgonovi, F; Koc, P; Greiff, S; (2022) General or specific abilities? Evidence from 33 countries participating in the PISA assessments. Intelligence , 92 , Article 101653. 10.1016/j.intell.2022.101653 <https://doi.org/10.1016/j.intell.2022.101653>. Green open access document_url: https://discovery.ucl.ac.uk/id/eprint/10151149/1/Pokropek_Marks_Borgonovi_Kock_Greiff_RPS.pdf