UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Delta Divergence: A Novel Decision Cognizant Measure of Classifier Incongruence

Kittler, J; Zor, C; (2019) Delta Divergence: A Novel Decision Cognizant Measure of Classifier Incongruence. IEEE Transactions on Cybernetics , 49 (6) pp. 2331-2343. 10.1109/TCYB.2018.2825353. Green open access

[thumbnail of 08370682.pdf]
Preview
Text
08370682.pdf - Published Version

Download (1MB) | Preview

Abstract

In pattern recognition, disagreement between two classifiers regarding the predicted class membership of an observation can be indicative of an anomaly and its nuance. Since, in general, classifiers base their decisions on class a posteriori probabilities, the most natural approach to detecting classifier incongruence is to use divergence. However, existing divergences are not particularly suitable to gauge classifier incongruence. In this paper, we postulate the properties that a divergence measure should satisfy and propose a novel divergence measure, referred to as delta divergence. In contrast to existing measures, it focuses on the dominant (most probable) hypotheses and, thus, reduces the effect of the probability mass distributed over the non dominant hypotheses (clutter). The proposed measure satisfies other important properties, such as symmetry, and independence of classifier confidence. The relationship of the proposed divergence to some baseline measures, and its superiority, is shown experimentally.

Type: Article
Title: Delta Divergence: A Novel Decision Cognizant Measure of Classifier Incongruence
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TCYB.2018.2825353
Publisher version: http://doi.org/10.1109/TCYB.2018.2825353
Language: English
Additional information: This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/
Keywords: Classifier incongruence, divergence clutter, f-divergences, total variation distance
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10067254
Downloads since deposit
Loading...
95Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item