UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Using simulation studies to evaluate statistical methods

Morris, TP; White, I; Crowther, MJ; (2019) Using simulation studies to evaluate statistical methods. Statistics in Medicine , 38 (11) pp. 2074-2102. 10.1002/sim.8086. Green open access

[thumbnail of 2019 - Morris - simulation studies tutorial - stat med.pdf]
Preview
Text
2019 - Morris - simulation studies tutorial - stat med.pdf - Published Version

Download (1MB) | Preview

Abstract

Simulation studies are computer experiments that involve creating data by pseudo‐random sampling. A key strength of simulation studies is the ability to understand the behavior of statistical methods because some “truth” (usually some parameter/s of interest) is known from the process of generating the data. This allows us to consider properties of methods, such as bias. While widely used, simulation studies are often poorly designed, analyzed, and reported. This tutorial outlines the rationale for using simulation studies and offers guidance for design, execution, analysis, reporting, and presentation. In particular, this tutorial provides a structured approach for planning and reporting simulation studies, which involves defining aims, data‐generating mechanisms, estimands, methods, and performance measures (“ADEMP”); coherent terminology for simulation studies; guidance on coding simulation studies; a critical discussion of key performance measures and their estimation; guidance on structuring tabular and graphical presentation of results; and new graphical presentations. With a view to describing recent practice, we review 100 articles taken from Volume 34 of Statistics in Medicine, which included at least one simulation study and identify areas for improvement.

Type: Article
Title: Using simulation studies to evaluate statistical methods
Open access status: An open access version is available from UCL Discovery
DOI: 10.1002/sim.8086
Publisher version: https://doi.org/10.1002/sim.8086
Language: English
Additional information: © 2019 The Authors. This is an open access article under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Keywords: Graphics for simulation, Monte Carlo, simulation design, simulation reporting, simulation studies
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > MRC Clinical Trials Unit at UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10066118
Downloads since deposit
252Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item