From margins to probabilities in multiclass learning problems.
In: VanHarmelen, F, (ed.)
ECAI 2002: 15TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS.
(pp. 400 - 404).
I O S PRESS
We study the problem of multiclass classification within the framework of error correcting output codes (ECOC) using margin-based binary classifiers. An important open problem in this context is how to measure the distance between class codewords and the outputs of the classifiers. In this paper we propose a new decoding function that combines the margins through an estimate of their class conditional probabilities. We report experiments using support vector machines as the base binary classifiers, showing the advantage of the proposed decoding function over other functions of the margin commonly used in practice. We also present new theoretical results bounding the leave-one-out error of ECOC of kernel machines, which can be used to tune kernel parameters. An empirical validation indicates that the bound leads to good estimates of kernel parameters and the corresponding classifiers attain high accuracy.
|Title:||From margins to probabilities in multiclass learning problems|
|Event:||15th European Conference on Artificial Intelligence|
|Location:||CLAUDE BERNARD UNIV, LYON, FRANCE|
|Dates:||2002-07-21 - 2002-07-26|
|Keywords:||machine learning, error correcting output codes, support vector machines, statistical learning theory|
|UCL classification:||UCL > School of BEAMS
UCL > School of BEAMS > Faculty of Engineering Science
Archive Staff Only