UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Cochrane Centralised Search Service showed high sensitivity identifying randomized controlled trials: A retrospective analysis

Noel-Storr, AH; Dooley, G; Wisniewski, S; Glanville, J; Thomas, J; Cox, S; Featherstone, R; (2020) Cochrane Centralised Search Service showed high sensitivity identifying randomized controlled trials: A retrospective analysis. Journal of Clinical Epidemiology 10.1016/j.jclinepi.2020.08.008. (In press). Green open access

[thumbnail of PIIS0895435620301165.pdf]
Preview
Text
PIIS0895435620301165.pdf - Published Version

Download (670kB) | Preview

Abstract

BACKGROUND: The Cochrane Central Register of Controlled Trials (CENTRAL) is compiled from a number of sources, including PubMed and Embase. Since 2017, we have increased the number of sources feeding into CENTRAL and improved the efficiency of our processes through the use of APIs, machine learning and crowdsourcing. OBJECTIVES: Our objectives were twofold: (1) Assess the effectiveness of Cochrane's centralised search and screening processes to correctly identify references to published reports which are eligible for inclusion in Cochrane systematic reviews of randomised controlled trials (RCTs). (2) Identify opportunities to improve the performance of Cochrane's centralised search and screening processes to identify references to eligible trials. METHODS: We identified all references to RCTs (either published journal articles or trial registration records) with a publication or registration date between 1st January 2017 and 31st December 2018 that had been included in a Cochrane intervention review. We then viewed an audit trail for each included reference to determine if it had been identified by our centralised search process and subsequently added to CENTRAL. RESULTS: We identified 650 references to included studies with a publication year of 2017 or 2018. Of those, 634 (97.5%) had been captured by Cochrane's Centralised Search Service (CSS). Sixteen references had been missed by the CSS: six had PubMed-not-MEDLINE status, four were missed by the centralised Embase search, three had been misclassified by Cochrane Crowd, one was from a journal not indexed in MEDLINE or Embase, one had only been added to Embase in 2019, and one reference had been rejected by the automated RCT machine learning classifier. Of the sixteen missed references, eight were the main or only publication to the trial in the review in which it had been included. CONCLUSIONS: This analysis has shown that Cochrane's centralised search and screening processes are highly sensitive. It has also helped us to understand better why some references to eligible RCTs have been missed. The CSS is playing a critical role in helping to populate CENTRAL and is moving us towards making CENTRAL a comprehensive repository of RCTs.

Type: Article
Title: Cochrane Centralised Search Service showed high sensitivity identifying randomized controlled trials: A retrospective analysis
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.jclinepi.2020.08.008
Publisher version: http://dx.doi.org/10.1016/j.jclinepi.2020.08.008
Language: English
Additional information: © 2020 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
Keywords: Cochrane Central Register of Controlled Trials, Crowdsourcing, Evidence synthesis, Information retrieval, Machine learning, Methodological filter, Randomised controlled trial, Systematic review
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute
URI: https://discovery.ucl.ac.uk/id/eprint/10111329
Downloads since deposit
52Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item