Ledo, D;
Houben, S;
Vermeulen, J;
Marquardt, N;
Oehlberg, L;
Greenberg, S;
(2018)
Evaluation strategies for HCI Toolkit research.
In: Mandryk, R and Hancock, M and Perry, M and Cox, A, (eds.)
CHI '18, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems.
(pp. 36:1-36:17).
ACM: New York, USA.
Preview |
Text
pn1203-ledo-2.pdf - Accepted Version Download (1MB) | Preview |
Abstract
Toolkit research plays an important role in the field of HCI, as it can heavily influence both the design and implementa-tion of interactive systems. For publication, the HCI commu-nity typically expects toolkit research to include an evalua-tion component. The problem is that toolkit evaluation is challenging, as it is often unclear what 'evaluating' a toolkit means and what methods are appropriate. To address this problem, we analyzed 68 published toolkit papers. From our analysis, we provide an overview of, reflection on, and dis-cussion of evaluation methods for toolkit contributions. We identify and discuss the value of four toolkit evaluation strat-egies, including the associated techniques that each employs. We offer a categorization of evaluation strategies for toolkit researchers, along with a discussion of the value, potential limitations, and trade-offs associated with each strategy.
| Type: | Proceedings paper |
|---|---|
| Title: | Evaluation strategies for HCI Toolkit research |
| Event: | CHI '18, 2018 CHI Conference on Human Factors in Computing Systems, 21-26 April 2018, Montreal, Canada |
| ISBN-13: | 9781450356206 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3173574.3173610 |
| Publisher version: | https://dx.doi.org/10.1145/3173574.3173610 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Toolkits; user interfaces; prototyping; design; evaluation |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10053385 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
