UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

A Framework for Evaluating Automatic Image Annotation Algorithms

Athanasakos, K; Stathopoulos, V; Jose, JM; (2010) A Framework for Evaluating Automatic Image Annotation Algorithms. In: Gurrin, C and He, Y and Kazai, G and Kruschwitz, U and Little, S and Roelleke, T and Ruger, S and VanRijsbergen, K, (eds.) ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS. (pp. 217 - 228). SPRINGER-VERLAG BERLIN

Full text not available from this repository.

Abstract

Several Automatic Image Annotation (AIA) algorithms have been introduced recently, which have been found to outperform previous models. However, each one of them has been evaluated using either different descriptors, collections or parts of collections, or "easy" settings. This fact renders their results non-comparable, while we show Dint collection-specific properties are responsible for the high reported performance measures, and not the actual models. In this paper we introduce a framework for the evaluation of image annotation models, which we use to evaluate two state-of-the-art AIA algorithms. Our findings reveal that. a simple Support Vector Machine (SVM) approach using Global MPEG-7 Features outperforms state-of-the-art AIA models across several collection settings. It seems that these models heavily depend on the set of features and the data used, while it is easy to exploit collection-specific properties, such as tag popularity especially in the commonly used Corel 5K dataset and still achieve good performance.

Type:Proceedings paper
Title:A Framework for Evaluating Automatic Image Annotation Algorithms
Event:32nd European Conference on Information Retrieval Research
Location:Milton Keynes, ENGLAND
Dates:2010-03-28 - 2010-03-31
ISBN-13:978-3-642-12274-3
Keywords:RETRIEVAL
UCL classification:UCL > School of BEAMS > Faculty of Maths and Physical Sciences > Statistical Science

Archive Staff Only: edit this record