UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Concept Language Model for Ad-hoc Retrieval

Zou, B; Lampos, V; Liang, S; Ren, Z; Yilmaz, E; Cox, IJ; (2017) A Concept Language Model for Ad-hoc Retrieval. In: Proceedings of the 26th International Conference on World Wide Web Companion. (pp. pp. 885-886). ACM publishing: Perth, Australia. Green open access

[thumbnail of p885-zou.pdf]
Preview
Text
p885-zou.pdf - Published Version

Download (947kB) | Preview

Abstract

We propose an extension to language models for information retrieval. Typically, language models estimate the probability of a document generating the query, where the query is considered as a set of independent search terms. We extend this approach by considering the concepts implied by both the query and words in the document. The model combines the probability of the document generating the concept embodied by the query, and the traditional language model probability of the document generating the query terms. We use a word embedding space to express concepts. The similarity between two vectors in this space is estimated using a weighted cosine distance. The weighting significantly enhances the discrimination between vectors. We evaluate our model on benchmark datasets (TREC 6–8) and empirically demonstrate it outperforms state-of-the-art baselines.

Type: Proceedings paper
Title: A Concept Language Model for Ad-hoc Retrieval
Event: 26th International Conference on World Wide Web Companion
ISBN-13: 978-1-4503-4914-7
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3041021.3054209
Publisher version: http://dx.doi.org/10.1145/3041021.3054209
Language: English
Additional information: © 2017 International World Wide Web Conference Committee (IW3C2), published under Creative Commons CC BY 4.0 License.
Keywords: Language model; Ad-hoc retrieval; Word embeddings
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10038480
Downloads since deposit
Loading...
194Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item