UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Identifying inconsistency in network meta-analysis: Is the net heat plot a reliable method?

Freeman, SC; Fisher, D; White, IR; Auperin, A; Carpenter, JR; (2019) Identifying inconsistency in network meta-analysis: Is the net heat plot a reliable method? Statistics in Medicine , 38 (29) pp. 5547-5564. 10.1002/sim.8383. Green open access

[thumbnail of White_Identifying inconsistency in network meta-analysis. Is the net heat plot a reliable method_VoR.pdf]
Preview
Text
White_Identifying inconsistency in network meta-analysis. Is the net heat plot a reliable method_VoR.pdf

Download (2MB) | Preview

Abstract

One of the biggest challenges for network meta-analysis is inconsistency, which occurs when the direct and indirect evidence conflict. Inconsistency causes problems for the estimation and interpretation of treatment effects and treatment contrasts. Krahn and colleagues proposed the net heat approach as a graphical tool for identifying and locating inconsistency within a network of randomized controlled trials. For networks with a treatment loop, the net heat plot displays statistics calculated by temporarily removing each design one at a time, in turn, and assessing the contribution of each remaining design to the inconsistency. The net heat plot takes the form of a matrix which is displayed graphically with coloring indicating the degree of inconsistency in the network. Applied to a network of individual participant data assessing overall survival in 7531 patients with lung cancer, we were surprised to find no evidence of important inconsistency from the net heat approach; this contradicted other approaches for assessing inconsistency such as the Bucher approach, Cochran's Q statistic, node-splitting, and the inconsistency parameter approach, which all suggested evidence of inconsistency within the network at the 5% level. Further theoretical work shows that the calculations underlying the net heat plot constitute an arbitrary weighting of the direct and indirect evidence which may be misleading. We illustrate this further using a simulation study and a network meta-analysis of 10 treatments for diabetes. We conclude that the net heat plot does not reliably signal inconsistency or identify designs that cause inconsistency.

Type: Article
Title: Identifying inconsistency in network meta-analysis: Is the net heat plot a reliable method?
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1002/sim.8383
Publisher version: https://doi.org/10.1002/sim.8383
Language: English
Additional information: © 2019 The Authors. Statistics in Medicine Published by John Wiley & Sons Ltd. This is an open access article under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/).
Keywords: inconsistency, net heat plot, network meta-analysis
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > MRC Clinical Trials Unit at UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10084744
Downloads since deposit
42Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item