UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Methods for Population Adjustment with Limited Access to Individual Patient Data: A Review and Simulation Study

Remiro-Azócar, A; Heath, A; Baio, G; (2021) Methods for Population Adjustment with Limited Access to Individual Patient Data: A Review and Simulation Study. Research Synthesis Methods , 12 (6) pp. 750-775. 10.1002/jrsm.1511. Green open access

[thumbnail of Baio_jrsm.1511.pdf]
Preview
Text
Baio_jrsm.1511.pdf - Published Version

Download (2MB) | Preview

Abstract

Population-adjusted indirect comparisons estimate treatment effects when access to individual patient data is limited and there are cross-trial differences in effect modifiers. Popular methods include matching-adjusted indirect comparison (MAIC) and simulated treatment comparison (STC). There is limited formal evaluation of these methods and whether they can be used to accurately compare treatments. Thus, we undertake a comprehensive simulation study to compare standard unadjusted indirect comparisons, MAIC and STC across 162 scenarios. This simulation study assumes that the trials are investigating survival outcomes and measure continuous covariates, with the log hazard ratio as the measure of effect. MAIC yields unbiased treatment effect estimates under no failures of assumptions. The typical usage of STC produces bias because it targets a conditional treatment effect where the target estimand should be a marginal treatment effect. The incompatibility of estimates in the indirect comparison leads to bias as the measure of effect is non-collapsible. Standard indirect comparisons are systematically biased, particularly under stronger covariate imbalance and interaction effects. Standard errors and coverage rates are often valid in MAIC but the robust sandwich variance estimator underestimates variability where effective sample sizes are small. Interval estimates for the standard indirect comparison are too narrow and STC suffers from bias-induced undercoverage. MAIC provides the most accurate estimates and, with lower degrees of covariate overlap, its bias reduction outweighs the loss in precision under no failures of assumptions. An important future objective is the development of an alternative formulation to STC that targets a marginal treatment effect. This article is protected by copyright. All rights reserved.

Type: Article
Title: Methods for Population Adjustment with Limited Access to Individual Patient Data: A Review and Simulation Study
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1002/jrsm.1511
Publisher version: https://doi.org/10.1002/jrsm.1511
Language: English
Additional information: © 2021 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Keywords: Health technology assessment, clinical trials, comparative effectiveness research, indirect treatment comparison, oncology, simulation study
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/10131164
Downloads since deposit
539Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item