Blandford, A;
Adams, A;
Attfield, S;
Buchanan, G;
Gow, J;
Makri, S;
Rimmer, J;
(2008)
The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work.
Information Processing & Management
, 44
(1)
4 - 21.
10.1016/j.ipm.2007.01.021.
![[thumbnail of 5098.pdf]](https://discovery.ucl.ac.uk/style/images/fileicons/application_pdf.png) Preview |
PDF
5098.pdf Download (697kB) |
Abstract
The strongest tradition of IR systems evaluation has focused on system effectiveness; more recently, there has been a growing interest in evaluation of Interactive IR systems, balancing system and user-oriented evaluation criteria. In this paper we shift the focus to considering how IR systems, and particularly digital libraries, can be evaluated to assess (and improve) their fit with users' broader work activities. Taking this focus, we answer a different set of evaluation questions that reveal more about the design of interfaces, user-system interactions and how systems may be deployed in the information working context. The planning and conduct of such evaluation studies share some features with the established methods for conducting IR evaluation studies, but come with a shift in emphasis; for example, a greater range of ethical considerations may be pertinent. We present the PRET A Rapporter framework for structuring user-centred evaluation studies and illustrate its application to three evaluation studies of digital library systems. (c) 2007 Elsevier Ltd. All rights reserved.
| Type: | Article |
|---|---|
| Title: | The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.ipm.2007.01.021 |
| Publisher version: | http://dx.doi.org/10.1016/j.ipm.2007.01.021 |
| Language: | English |
| Additional information: | © 2007 Elsevier Ltd.. This manuscript is made available under a Creative Commons Attribution Non-commercial Non-derivative 4.0 International license (CC BY-NC-ND 4.0). This license allows you to share, copy, distribute and transmit the work for personal and non-commercial use providing author and publisher attribution is clearly stated. Further details about CC BY licenses are available at http://creativecommons.org/ licenses/by/4.0. Access may be initially restricted by the publisher. |
| Keywords: | Digital library, usability evaluation, hci, case study, retrieval experimentation, seeking, behavior, system |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL SLASH UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities |
| URI: | https://discovery.ucl.ac.uk/id/eprint/5098 |
Archive Staff Only
 |
View Item |
