UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Comparing What to What, on What Scale? The Impact of Item Comparisons and Reference Points in Communicating Risk and Uncertainty

Rakow, T; Blackshaw, E; Pagel, C; Spiegelhalter, DS; (2018) Comparing What to What, on What Scale? The Impact of Item Comparisons and Reference Points in Communicating Risk and Uncertainty. Journal of Behavioral Decision Making , 31 (4) pp. 547-561. 10.1002/bdm.2073. Green open access

[thumbnail of Pagel_Main paper_RAKOW_Reference_Points_RESUB_02_JBDM_29.11.2017.pdf]
Preview
Text
Pagel_Main paper_RAKOW_Reference_Points_RESUB_02_JBDM_29.11.2017.pdf - Accepted Version

Download (1MB) | Preview

Abstract

The mandated public availability of individual hospital's audit data for children's heart surgery in the UK creates a challenging scenario for communicating these complex and sensitive data to diverse audiences. On the basis of this scenario, we conducted three experiments with the aim of understanding how best to help lay people understand these data and the practical goal of improving the public presentation of these data. The experiments compared different outcome measures for displaying the survival rate (percentage scale versus the ratio of the predicted/observed rates) and presentation formats (individual hospital versus all hospitals shown) for outcomes data presented relative to prediction intervals generated by a risk model that adjusts for case mix. Our data highlight how easily inappropriate comparisons can influence evaluations of complex data: for instance, both a survival ratio of 1 and the presence of other hospitals seemingly provided reference points that resulted in inappropriately harsh evaluations of some hospitals. By drawing on evaluability theory, we demonstrate how to enhance people's understanding of these complex data while also discouraging inappropriate comparisons, which has implications for communicating risk and uncertainty and for choice architecture design in a range of contexts.

Type: Article
Title: Comparing What to What, on What Scale? The Impact of Item Comparisons and Reference Points in Communicating Risk and Uncertainty
Open access status: An open access version is available from UCL Discovery
DOI: 10.1002/bdm.2073
Publisher version: https://doi.org/10.1002/bdm.2073
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: risk communication; uncertainty; prediction intervals; reference-dependent evaluation; evaluability
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Mathematics
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Mathematics > Clinical Operational Research Unit
URI: https://discovery.ucl.ac.uk/id/eprint/10039066
Downloads since deposit
48Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item