UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Performance Metrics for Activity Recognition

Ward, JA; Lukowicz, P; Gellersen, HW; (2011) Performance Metrics for Activity Recognition. ACM Transactions on Intelligent Systems and Technology (TIST) , 2 (1) , Article 6. 10.1145/1889681.1889687. Green open access

[thumbnail of WLG10-draft.pdf]
Preview
Text
WLG10-draft.pdf - Accepted version

Download (1MB) | Preview

Abstract

In this article, we introduce and evaluate a comprehensive set of performance metrics and visualisations for continuous activity recognition (AR). We demonstrate how standard evaluation methods, often borrowed from related pattern recognition problems, fail to capture common artefacts found in continuous AR—specifically event fragmentation, event merging and timing offsets. We support our assertion with an analysis on a set of recently published AR papers. Building on an earlier initial work on the topic, we develop a frame-based visualisation and corresponding set of class-skew invariant metrics for the one class versus all evaluation. These are complemented by a new complete set of event-based metrics that allow a quick graphical representation of system performance—showing events that are correct, inserted, deleted, fragmented, merged and those which are both fragmented and merged. We evaluate the utility of our approach through comparison with standard metrics on data from three different published experiments. This shows that where event- and frame-based precision and recall lead to an ambiguous interpretation of results in some cases, the proposed metrics provide a consistently unambiguous explanation.

Type: Article
Title: Performance Metrics for Activity Recognition
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/1889681.1889687
Publisher version: http://doi.org/10.1145/1889681.1889687
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
URI: https://discovery.ucl.ac.uk/id/eprint/1535339
Downloads since deposit
679Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item