UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Mean-Variance Analysis: A New Document Ranking Theory in Information Retrieval

Wang, J; (2009) Mean-Variance Analysis: A New Document Ranking Theory in Information Retrieval. In: Boughanem, M and Berrut, C and Mothe, J and SouleDupuy, C, (eds.) ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS. (pp. 4 - 16). SPRINGER-VERLAG BERLIN

Full text not available from this repository.

Abstract

This paper concerns document ranking in information retrieval. In information retrieval systems, the widely accepted probability ranking principle (PRP) suggests that, for optimal retrieval, documents should be ranked in order of decreasing probability of relevance. In this paper, we present a new document ranking paradigm, arguing that a better, more general solution is to optimize top-n ranked documents is a whole, rather than ranking them independently. Inspired by the Modern Portfolio Theory in finance. we quantify a ranked list of documents on the basis of its expected overall relevance (mean) and its variance; the latter serves as a measure of risk, which was rarely studied for document ranking in the past. Through the analysis of the mean and variance. we show that an optimal rank order is the one that maximizes the overall relevance (mean) of the ranked list at a given risk level (variance). Based on this principle, we then derive an efficient, document ranking algorithm. It extends the PRP by considering both the uncertainty of relevance predictions and correlations between retrieved documents. Furthermore, we quantify the benefits of diversification, and theoretically show that, diversifying documents is an effective way to reduce, the risk of document ranking. Experimental results on the, collaborative filtering problem confirms the theoretical insights with improved recommendation performance, e.g.. achieved over 300% performance gain over the PRP-based ranking on the user-based recommendation.

Type:Proceedings paper
Title:Mean-Variance Analysis: A New Document Ranking Theory in Information Retrieval
Event:31st European Conference on Information Research
Location:Toulouse, FRANCE
Dates:2009-04-06 - 2009-04-09
ISBN-13:978-3-642-00957-0
Keywords:MODELS
UCL classification:UCL > School of BEAMS > Faculty of Engineering Science > Computer Science

Archive Staff Only: edit this record