UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Topic (Query) Selection for IR Evaluation

Zhu, J; Wang, J; Cox, I; Vinay, V; (2009) Topic (Query) Selection for IR Evaluation. In: Sanderson, M and Zhai, CX and Zobel, J and Allan, J and Aslam, JA, (eds.) PROCEEDINGS 32ND ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL. (pp. 802 - 803). ASSOC COMPUTING MACHINERY

Full text not available from this repository.


The need for evaluating large amounts of topics (queries) makes IR evaluation an uneasy task. In this paper, we study a topic selection problem for IR evaluation. The selection criterion is based on the overall difficulty of the chosen set, as well as the uncertainty of the final IR metric applied to the systems. Our preliminary experiments demonstrate that our approach helps to identify a set of topics that provides confident estimates of systems' performance while keeping the requirement of the query difficulty.

Type: Proceedings paper
Title: Topic (Query) Selection for IR Evaluation
Event: 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
Location: Boston, MA
Dates: 2009-07-19 - 2009-07-23
ISBN-13: 978-1-60558-483-6
URI: http://discovery.ucl.ac.uk/id/eprint/178863
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item