UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Framework for Evaluating Dashboards in Healthcare

Zhuang, Mengdie; Concannon, David; Manley, Ed; (2022) A Framework for Evaluating Dashboards in Healthcare. IEEE Transactions on Visualization and Computer Graphics , 28 (4) pp. 1715-1731. 10.1109/tvcg.2022.3147154. (In press). Green open access

[thumbnail of dashboard_evaluation.pdf]
dashboard_evaluation.pdf - Accepted Version

Download (6MB) | Preview


In the era of ‘information overload’, effective information provision is essential for enabling rapid response and critical decision making. In making sense of diverse information sources, dashboards have become an indispensable tool, providing fast, effective, adaptable, and personalized access to information for professionals and the general public alike. However, these objectives place heavy requirements on dashboards as information systems in usability and effective design. Understanding these issues is challenging given the absence of consistent and comprehensive approaches to dashboard evaluation. In this article we systematically review literature on dashboard implementation in healthcare, where dashboards have been employed widely, and where there is widespread interest for improving the current state of the art, and subsequently analyse approaches taken towards evaluation. We draw upon consolidated dashboard literature and our own observations to introduce a general definition of dashboards which is more relevant to current trends, together with seven evaluation scenarios - task performance, behaviour change, interaction workflow, perceived engagement, potential utility, algorithm performance and system implementation. These scenarios distinguish different evaluation purposes which we illustrate through measurements, example studies, and common challenges in evaluation study design. We provide a breakdown of each evaluation scenario, and highlight some of the more subtle questions. We demonstrate the use of the proposed framework by a design study guided by this framework. We conclude by comparing this framework with existing literature, outlining a number of active discussion points and a set of dashboard evaluation best practices for the academic, clinical and software development communities alike.

Type: Article
Title: A Framework for Evaluating Dashboards in Healthcare
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/tvcg.2022.3147154
Publisher version: http://dx.doi.org/10.1109/tvcg.2022.3147154
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Visualization , Refining, Medical services, Market research, Software, Usability, Task analysis
UCL classification: UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment > Centre for Advanced Spatial Analysis
UCL > Provost and Vice Provost Offices > UCL BEAMS
URI: https://discovery.ucl.ac.uk/id/eprint/10144356
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item