UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Novel evaluation metrics for sparse spatio-temporal point process hotspot predictions - a crime case study

Adepeju, M; Rosser, G; Cheng, T; (2016) Novel evaluation metrics for sparse spatio-temporal point process hotspot predictions - a crime case study. International Journal of Geographical Information Science , 30 (11) pp. 2133-2154. 10.1080/13658816.2016.1159684. Green open access

[thumbnail of IJGIS Adepejue Rosser Cheng 2016.pdf]
Preview
Text
IJGIS Adepejue Rosser Cheng 2016.pdf - Published Version

Download (2MB) | Preview

Abstract

Many physical and sociological processes are represented as discrete events in time and space. These spatio-temporal point processes are often sparse, meaning that they cannot be aggregated and treated with conventional regression models. Models based on the point process framework may be employed instead for prediction purposes. Evaluating the predictive performance of these models poses a unique challenge, as the same sparseness prevents the use of popular measures such as the root mean squared error. Statistical likelihood is a valid alternative, but this does not measure absolute performance and is therefore difficult for practitioners and researchers to interpret. Motivated by this limitation, we develop a practical toolkit of evaluation metrics for spatio-temporal point process predictions. The metrics are based around the concept of hotspots, which represent areas of high point density. In addition to measuring predictive accuracy, our evaluation toolkit considers broader aspects of predictive performance, including a characterisation of the spatial and temporal distributions of predicted hotspots and a comparison of the complementarity of different prediction methods. We demonstrate the application of our evaluation metrics using a case study of crime prediction, comparing four varied prediction methods using crime data from two different locations and multiple crime types. The results highlight a previously unseen interplay between predictive accuracy and spatio-temporal dispersion of predicted hotspots. The new evaluation framework may be applied to compare multiple prediction methods in a variety of scenarios, yielding valuable new insight into the predictive performance of point process-based prediction.

Type: Article
Title: Novel evaluation metrics for sparse spatio-temporal point process hotspot predictions - a crime case study
Open access status: An open access version is available from UCL Discovery
DOI: 10.1080/13658816.2016.1159684
Publisher version: http://dx.doi.org/10.1080/13658816.2016.1159684
Language: English
Additional information: Copyright © 2016 The Author(s). Published by Taylor & Francis. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Keywords: Point process, hotspot, prediction, space-time, crime
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng
URI: https://discovery.ucl.ac.uk/id/eprint/1492674
Downloads since deposit
230Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item