Zhang, Jiajie;
Watson, Paul;
Hodgson, Barry;
(2022)
A new approach to impact case study analytics.
Data & Policy
, 4
, Article e30. 10.1017/dap.2022.21.
Preview |
Text
Zhang_A new approach to impact case study analytics_VoR.pdf Download (2MB) | Preview |
Abstract
The 2014 Research Excellence Framework (REF) assessed the quality of university research in the UK. 20% of the assessment was allocated according to peer review of the impact of research, reflecting the growing importance of impact in UK government policy. Beyond academia, impact is defined as a change or benefit to the economy, society, culture, public policy or services, health, the environment, or quality of life. Each institution submitted a set of four-page impact case studies. These are predominantly free-form descriptions and evidences of the impact of study. Numerous analyses of these case studies have been conducted, but they have utilised either qualitative methods or primary forms of text searching. These approaches have limitations, including the time required to manually analyse the data and the frequently inferior quality of the answers provided by applying computational analysis to unstructured, context-less free text data. This paper describes a new system to address these problems. At its core is a structured, queryable representation of the case study data. We describe the ontology design used to structure the information and how semantic web related technologies are used to store and query the data. Experiments show that this gives two significant advantages over existing techniques: improved accuracy in question answering and the capability to answer a broader range of questions, by integrating data from external sources. Then we investigate whether machine learning can predict each case study’s grade using this structured representation. The results provide accurate predictions for computer science impact case studies.
| Type: | Article |
|---|---|
| Title: | A new approach to impact case study analytics |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1017/dap.2022.21 |
| Publisher version: | http://dx.doi.org/10.1017/dap.2022.21 |
| Language: | English |
| Additional information: | © The Author(s), 2022. Published by Cambridge University Press. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0). |
| Keywords: | impact, infrastructure, knowledge generation, ontology, semantic web |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL SLASH UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > Dept of Information Studies |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10194991 |
Archive Staff Only
 |
View Item |
