UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Using Bayes Factors for testing hypotheses about intervention effectiveness in addictions research

Beard, EV; Dienes, Z; Muirhead, C; West, R; (2016) Using Bayes Factors for testing hypotheses about intervention effectiveness in addictions research. Addiction , 111 (12) pp. 2230-2247. 10.1111/add.13501. Green open access

[thumbnail of Beard_et_al-2016-Addiction.pdf]
Preview
Text
Beard_et_al-2016-Addiction.pdf

Download (284kB) | Preview

Abstract

Background and aims: It has been proposed that more use should be made of Bayes Factors in hypothesis testing in addiction research. Bayes Factors are the ratios of the likelihood of a specified hypothesis (e.g. an intervention effect within a given range) to another hypothesis (e.g. no effect). They are particularly important for differentiating lack of strong evidence for an effect and evidence for lack of an effect. This paper reviewed randomised trials reported in Addiction between January and June 2013 to assess how far Bayes Factors might improve the interpretation of the data. Methods: Seventy five effect sizes and their standard errors were extracted from 12 trials. Seventy three per cent (n=55) of these were non-significant (i.e. p>0.05). For each non-significant finding a Bayes Factor was calculated using a population effect derived from previous research. In sensitivity analyses, a further two Bayes Factors were calculated assuming clinically meaningful and plausible ranges around this population effect. Results: Twenty per cent (n=11) of the non-significant Bayes Factors were < 1/3rd and 3.6% (n=2) were > 3. The other 76.4% (n=42) of Bayes Factors were between 1/3rd and 3. Of these, 26 were in the direction of there being an effect (Bayes Factor >1 & <3); 12 tended to favour the hypothesis of no effect (Bayes Factor <1 & >1/3rd); and for 4 there was no evidence either way (Bayes Factor =1). In sensitivity analyses, 13.3% of Bayes Factors were <1/3rd (n=20), 62.7% (n=94) were between 1/3rd and 3 and 24.0% (n=36) were >3, showing good concordance with the main results. Conclusions: Use of Bayes Factors when analysing data from randomised trials of interventions in addiction research can provide important information that would lead to more precise conclusions than are typically obtained using currently prevailing methods.

Type: Article
Title: Using Bayes Factors for testing hypotheses about intervention effectiveness in addictions research
Open access status: An open access version is available from UCL Discovery
DOI: 10.1111/add.13501
Publisher version: http://doi.org/10.1111/add.13501
Language: English
Additional information: © 2016 The Authors. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Keywords: Addiction, Bayes factors, Bayesian, hypothesis testing, non-significant, RCT.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Epidemiology and Health
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Epidemiology and Health > Behavioural Science and Health
URI: https://discovery.ucl.ac.uk/id/eprint/1498792
Downloads since deposit
169Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item