Lipani, A;
Lupu, M;
Hanbury, A;
(2017)
Visual Pool: A tool to visualize and interact with the pooling method.
In:
SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.
(pp. pp. 1321-1324).
ACM: USA: New York.
Preview |
Text
main.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Every year more than 25 test collections are built among the main Information Retrieval (IR) evaluation campaigns. They are extremely important in IR because they become the evaluation praxis for the forthcoming years. Test collections are built mostly using the pooling method. The main advantage of this method is that it drastically reduces the number of documents to be judged. It does so at the cost of introducing biases, which are sometimes aggravated by non optimal configuration. In this paper we develop a novel visualization technique for the pooling method, and integrate it in a demo application named Visual Pool. This demo application enables the user to interact with the pooling method with ease, and develops visual hints in order to analyze existing test collections, and build better ones.
| Type: | Proceedings paper |
|---|---|
| Title: | Visual Pool: A tool to visualize and interact with the pooling method |
| Event: | 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 07 - 11 August 2017, Shinjuku, Tokyo, Japan |
| ISBN-13: | 9781450350228 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3077136.3084146 |
| Publisher version: | https://doi.org/10.1145/3077136.3084146 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Visualization; Test Collections; Pooling Method; Pooling Strategies |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10059977 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
