UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Evaluating performance in continuous context recognition using event-driven error characterisation

Ward, JA; Lukowicz, P; Troester, G; (2006) Evaluating performance in continuous context recognition using event-driven error characterisation. In: Hazas, M and Krumm, J and Strang, T, (eds.) Proceedings of the 2nd International Symposium on Location- and Context-Awareness: LoCA 2006. (pp. pp. 239-255). Springer, Berlin, Heidelberg: Dublin, Ireland. Green open access

[img]
Preview
Text
Ward_WLT06loca.pdf

Download (412kB) | Preview

Abstract

Evaluating the performance of a continuous activity recognition system can be a challenging problem. To-date there is no widely accepted standard for dealing with this, and in general methods and measures are adapted from related fields such as speech and vision. Much of the problem stems from the often imprecise and ambiguous nature of the real-world events that an activity recognition system has to deal with. A recognised event might have variable duration, or be shifted in time from the corresponding real-world event. Equally it might be broken up into smaller pieces, or joined together to form larger events. Most evaluation attempts tend to smooth over these issues, using “fuzzy” boundaries, or some other parameter based error decision, so as to make possible the use of standard performance measures (such as insertions and deletions.) However, we argue that reducing the various facets of a activity system into limited error categories – that were originally intended for different problem domains – can be overly restrictive. In this paper we attempt to identify and characterise the errors typical to continuous activity recognition, and develop a method for quantifying them in an unambiguous manner. By way of an initial investigation, we apply the method to an example taken from previous work, and discuss the advantages that this provides over two of the most commonly used methods.

Type: Proceedings paper
Title: Evaluating performance in continuous context recognition using event-driven error characterisation
Event: 2nd International Workshop on Location- and Context-Awareness :LoCA 2006
Location: Dublin, IRELAND
Dates: 10 May 2006 - 11 May 2006
ISBN: 3-540-34150-1
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/11752967_16
Publisher version: https://doi.org/10.1007/11752967_16
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Ground Truth, Activity Recognition, Automatic Speech Recognition, Optical Character Recognition, Event Error
UCL classification: UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Institute of Cognitive Neuroscience
URI: https://discovery.ucl.ac.uk/id/eprint/1535729
Downloads since deposit
51Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item