UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Type I error rates of multi-arm multi-stage clinical trials: strong control and impact of intermediate outcomes

Bratton, DJ; Parmar, MK; Phillips, PP; Choodari-Oskooei, B; (2016) Type I error rates of multi-arm multi-stage clinical trials: strong control and impact of intermediate outcomes. Trials , 17 , Article 309. 10.1186/s13063-016-1382-5. Green open access

[thumbnail of Type I error rates of multi-arm multi-stage clinical trials: strong control and impact of intermediate outcomes.pdf]
Preview
Text
Type I error rates of multi-arm multi-stage clinical trials: strong control and impact of intermediate outcomes.pdf - Accepted Version

Download (545kB) | Preview

Abstract

BACKGROUND: The multi-arm multi-stage (MAMS) design described by Royston et al. [Stat Med. 2003;22(14):2239-56 and Trials. 2011;12:81] can accelerate treatment evaluation by comparing multiple treatments with a control in a single trial and stopping recruitment to arms not showing sufficient promise during the course of the study. To increase efficiency further, interim assessments can be based on an intermediate outcome (I) that is observed earlier than the definitive outcome (D) of the study. Two measures of type I error rate are often of interest in a MAMS trial. Pairwise type I error rate (PWER) is the probability of recommending an ineffective treatment at the end of the study regardless of other experimental arms in the trial. Familywise type I error rate (FWER) is the probability of recommending at least one ineffective treatment and is often of greater interest in a study with more than one experimental arm. METHODS: We demonstrate how to calculate the PWER and FWER when the I and D outcomes in a MAMS design differ. We explore how each measure varies with respect to the underlying treatment effect on I and show how to control the type I error rate under any scenario. We conclude by applying the methods to estimate the maximum type I error rate of an ongoing MAMS study and show how the design might have looked had it controlled the FWER under any scenario. RESULTS: The PWER and FWER converge to their maximum values as the effectiveness of the experimental arms on I increases. We show that both measures can be controlled under any scenario by setting the pairwise significance level in the final stage of the study to the target level. In an example, controlling the FWER is shown to increase considerably the size of the trial although it remains substantially more efficient than evaluating each new treatment in separate trials. CONCLUSIONS: The proposed methods allow the PWER and FWER to be controlled in various MAMS designs, potentially increasing the uptake of the MAMS design in practice. The methods are also applicable in cases where the I and D outcomes are identical.

Type: Article
Title: Type I error rates of multi-arm multi-stage clinical trials: strong control and impact of intermediate outcomes
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1186/s13063-016-1382-5
Publisher version: http://dx.doi.org/10.1186/s13063-016-1382-5
Language: English
Additional information: Copyright © 2016 Bratton et al. Open Access: This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0) (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Keywords: False positive rate, Familywise error rate, MAMS, Multi-arm, Multi-stage
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > MRC Clinical Trials Unit at UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute for Global Health
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute for Global Health > Infection and Population Health
URI: https://discovery.ucl.ac.uk/id/eprint/1503561
Downloads since deposit
157Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item