Leave one out error, stability, and generalization of voting combinations of classifiers.
71 - 97.
We study the leave-one-out and generalization errors of voting combinations of learning machines. A special case considered is a variant of bagging. We analyze in detail combinations of kernel machines, such as support vector machines, and present theoretical estimates of their leave-one-out error. We also derive novel bounds on the stability of combinations of any classifiers. These bounds can be used to formally show that, for example, bagging increases the stability of unstable learning machines. We report experiments supporting the theoretical findings.
|Title:||Leave one out error, stability, and generalization of voting combinations of classifiers|
|Keywords:||cross-validation, bagging, combinations of machines, stability, BOUNDS|
|UCL classification:||UCL > School of BEAMS
UCL > School of BEAMS > Faculty of Engineering Science
Archive Staff Only