UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Assessing the impact of efficacy stopping rules on the error rates under the multi-arm multi-stage framework

Blenkinsop, A; Parmar, MK; Choodari-Oskooei, B; (2019) Assessing the impact of efficacy stopping rules on the error rates under the multi-arm multi-stage framework. Clinical Trials 10.1177/1740774518823551. (In press). Green open access

[thumbnail of Blenkinsop_Assessing the impact of efficacy stopping rules on the error rates under the multi-arm multi-stage framework_VoR.pdf]
Preview
Text
Blenkinsop_Assessing the impact of efficacy stopping rules on the error rates under the multi-arm multi-stage framework_VoR.pdf - Published Version

Download (206kB) | Preview

Abstract

BACKGROUND: The multi-arm multi-stage framework uses intermediate outcomes to assess lack-of-benefit of research arms at interim stages in randomised trials with time-to-event outcomes. However, the design lacks formal methods to evaluate early evidence of overwhelming efficacy on the definitive outcome measure. We explore the operating characteristics of this extension to the multi-arm multi-stage design and how to control the pairwise and familywise type I error rate. Using real examples and the updated nstage program, we demonstrate how such a design can be developed in practice. METHODS: We used the Dunnett approach for assessing treatment arms when conducting comprehensive simulation studies to evaluate the familywise error rate, with and without interim efficacy looks on the definitive outcome measure, at the same time as the planned lack-of-benefit interim analyses on the intermediate outcome measure. We studied the effect of the timing of interim analyses, allocation ratio, lack-of-benefit boundaries, efficacy rule, number of stages and research arms on the operating characteristics of the design when efficacy stopping boundaries are incorporated. Methods for controlling the familywise error rate with efficacy looks were also addressed. RESULTS: Incorporating Haybittle–Peto stopping boundaries on the definitive outcome at the interim analyses will not inflate the familywise error rate in a multi-arm design with two stages. However, this rule is conservative; in general, more liberal stopping boundaries can be used with minimal impact on the familywise error rate. Efficacy bounds in trials with three or more stages using an intermediate outcome may inflate the familywise error rate, but we show how to maintain strong control. CONCLUSION: The multi-arm multi-stage design allows stopping for both lack-of-benefit on the intermediate outcome and efficacy on the definitive outcome at the interim stages. We provide guidelines on how to control the familywise error rate when efficacy boundaries are implemented in practice.

Type: Article
Title: Assessing the impact of efficacy stopping rules on the error rates under the multi-arm multi-stage framework
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1177/1740774518823551
Publisher version: https://doi.org/10.1177/1740774518823551
Language: English
Additional information: © The Author(s) 2019. This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (http://www.creativecommons.org/licenses/by-nc/4.0/).
Keywords: Multi-arm, multi-stage, lack-of-benefit boundary, efficacy stopping boundary, familywise error rate, multi-arm multi-stage
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > MRC Clinical Trials Unit at UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10066335
Downloads since deposit
128Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item