UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review

Sadoyu, S; Tanni, KA; Punrum, N; Paengtrai, S; Kategaew, W; Promchit, N; Lai, NM; ... Chaiyakunapruk, N; + view all (2022) Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review. PLOS ONE , 17 (6) , Article e0269009. 10.1371/journal.pone.0269009. Green open access

[thumbnail of journal.pone.0269009.pdf]
Preview
Text
journal.pone.0269009.pdf - Published Version

Download (1MB) | Preview

Abstract

INTRODUCTION: The number of umbrella reviews (URs) that compiled systematic reviews and meta-analysis (SR-MAs) has increased dramatically over recent years. No formal guidance for assessing the certainty of evidence in URs of meta-analyses exists nowadays. URs of non-interventional studies help establish evidence linking exposure to certain health outcomes in a population. This study aims to identify and describe the methodological approaches for assessing the certainty of the evidence in published URs of non-interventions. METHODS: We searched from 3 databases including PubMed, Embase, and The Cochrane Library from May 2010 to September 2021. We included URs that included SR-MAs of studies with non-interventions. Two independent reviewers screened and extracted data. We compared URs characteristics stratified by publication year, journal ranking, journal impact factor using Chi-square test. RESULTS: Ninety-nine URs have been included. Most were SR-MAs of observational studies evaluating association of non-modifiable risk factors with some outcomes. Only half (56.6%) of the included URs assessed the certainty of the evidence. The most frequently used criteria is credibility assessment (80.4%), followed by GRADE approach (14.3%). URs published in journals with higher journal impact factor assessed certainty of evidence than URs published in lower impact group (77.1 versus 37.2% respectively, p < 0.05). However, criteria for credibility assessment used in four of the seven URs that were published in top ranking journals were slightly varied. CONCLUSIONS: Half of URs of MAs of non-interventional studies have assessed the certainty of the evidence, in which criteria for credibility assessment was the commonly used method. Guidance and standards are required to ensure the methodological rigor and consistency of certainty of evidence assessment for URs.

Type: Article
Title: Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1371/journal.pone.0269009
Publisher version: https://doi.org/10.1371/journal.pone.0269009
Language: English
Additional information: Copyright © 2022 Sadoyu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Keywords: Bibliometrics, Scientific publishing, Metaanalysis, Medical risk factors, Database searching, Epidemiology, Observational studies, Systematic reviews
UCL classification: UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute
UCL > Provost and Vice Provost Offices > School of Education
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10150877
Downloads since deposit
Loading...
35Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
1.United States
6
2.Germany
2
3.China
1
4.Russian Federation
1
5.New Zealand
1

Archive Staff Only

View Item View Item