Zou, B;
Lampos, V;
Liang, S;
Ren, Z;
Yilmaz, E;
Cox, IJ;
(2017)
A Concept Language Model for Ad-hoc Retrieval.
In:
Proceedings of the 26th International Conference on World Wide Web Companion.
(pp. pp. 885-886).
ACM publishing: Perth, Australia.
Preview |
Text
p885-zou.pdf - Published Version Download (947kB) | Preview |
Abstract
We propose an extension to language models for information retrieval. Typically, language models estimate the probability of a document generating the query, where the query is considered as a set of independent search terms. We extend this approach by considering the concepts implied by both the query and words in the document. The model combines the probability of the document generating the concept embodied by the query, and the traditional language model probability of the document generating the query terms. We use a word embedding space to express concepts. The similarity between two vectors in this space is estimated using a weighted cosine distance. The weighting significantly enhances the discrimination between vectors. We evaluate our model on benchmark datasets (TREC 6–8) and empirically demonstrate it outperforms state-of-the-art baselines.
Type: | Proceedings paper |
---|---|
Title: | A Concept Language Model for Ad-hoc Retrieval |
Event: | 26th International Conference on World Wide Web Companion |
ISBN-13: | 978-1-4503-4914-7 |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1145/3041021.3054209 |
Publisher version: | http://dx.doi.org/10.1145/3041021.3054209 |
Language: | English |
Additional information: | © 2017 International World Wide Web Conference Committee (IW3C2), published under Creative Commons CC BY 4.0 License. |
Keywords: | Language model; Ad-hoc retrieval; Word embeddings |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10038480 |




Archive Staff Only
![]() |
View Item |