UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines

Martindale, Alexander PL; Ng, Benjamin; Ngai, Victoria; Kale, Aditya U; Ferrante di Ruffano, Lavinia; Golub, Robert M; Collins, Gary S; ... Liu, Xiaoxuan; + view all (2024) Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines. Nature Communications , 15 , Article 1619. 10.1038/s41467-024-45355-3. Green open access

[thumbnail of Denniston_Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines_VoR.pdf]
Preview
Text
Denniston_Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines_VoR.pdf - Published Version

Download (1MB) | Preview

Abstract

The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77–94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.

Type: Article
Title: Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1038/s41467-024-45355-3
Publisher version: http://dx.doi.org/10.1038/s41467-024-45355-3
Language: English
Additional information: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Institute of Ophthalmology
URI: https://discovery.ucl.ac.uk/id/eprint/10188173
Downloads since deposit
5Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item