UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Evaluation strategies for HCI Toolkit research

Ledo, D; Houben, S; Vermeulen, J; Marquardt, N; Oehlberg, L; Greenberg, S; (2018) Evaluation strategies for HCI Toolkit research. In: Mandryk, R and Hancock, M and Perry, M and Cox, A, (eds.) CHI '18, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. (pp. 36:1-36:17). ACM: New York, USA. Green open access

[img]
Preview
Text
pn1203-ledo-2.pdf - Accepted version

Download (1MB) | Preview

Abstract

Toolkit research plays an important role in the field of HCI, as it can heavily influence both the design and implementa-tion of interactive systems. For publication, the HCI commu-nity typically expects toolkit research to include an evalua-tion component. The problem is that toolkit evaluation is challenging, as it is often unclear what 'evaluating' a toolkit means and what methods are appropriate. To address this problem, we analyzed 68 published toolkit papers. From our analysis, we provide an overview of, reflection on, and dis-cussion of evaluation methods for toolkit contributions. We identify and discuss the value of four toolkit evaluation strat-egies, including the associated techniques that each employs. We offer a categorization of evaluation strategies for toolkit researchers, along with a discussion of the value, potential limitations, and trade-offs associated with each strategy.

Type: Proceedings paper
Title: Evaluation strategies for HCI Toolkit research
Event: CHI '18, 2018 CHI Conference on Human Factors in Computing Systems, 21-26 April 2018, Montreal, Canada
ISBN-13: 9781450356206
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3173574.3173610
Publisher version: https://dx.doi.org/10.1145/3173574.3173610
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Toolkits; user interfaces; prototyping; design; evaluation
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10053385
Downloads since deposit
89Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item