UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

New results on error correcting output codes of kernel machines

Passerini, A; Pontil, M; Frasconi, P; (2004) New results on error correcting output codes of kernel machines. In: IEEE T NEURAL NETWOR. (pp. 45 - 54). IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Full text not available from this repository.


We study the problem of multiclass classification within the framework of error correcting output codes (ECOC) using margin-based binary classifiers. Specifically, we address two important open problems in this context: decoding and model selection. The decoding problem concerns how to map the outputs of the classifiers into class codewords. In this paper we introduce a new decoding function that combines the margins through an estimate of their class conditional probabilities. Concerning model selection, we present new theoretical results bounding the leave-one-out (1,00) error of ECOC of kernel machines, which can be used to tune kernel hyperparameters. We report experiments using support vector machines as the base binary classifiers, showing the advantage of the proposed decoding function over other functions of the margin commonly used in practice. Moreover, our empirical evaluations on model selection indicate that the bound leads to good estimates of kernel parameters.

Type: Proceedings paper
Title: New results on error correcting output codes of kernel machines
DOI: 10.1109/TNN.2003.820841
Keywords: error correcting output codes (ECOC), machine learning, statistical learning theory, support vector machines, SUPPORT VECTOR MACHINES, CROSS-VALIDATION, MATRICES
URI: http://discovery.ucl.ac.uk/id/eprint/158378
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item