UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Approximation of Ensemble Boundary Using Spectral Coefficients

Windeatt, T; Zor, C; Camgoz, NC; (2019) Approximation of Ensemble Boundary Using Spectral Coefficients. IEEE Transactions on Neural Networks and Learning Systems , 30 (4) pp. 1272-1277. 10.1109/TNNLS.2018.2861579. Green open access

[thumbnail of windeattTNNLS-2013-P-0123.pdf]
Preview
Text
windeattTNNLS-2013-P-0123.pdf - Accepted Version

Download (1MB) | Preview

Abstract

IEEE A spectral analysis of a Boolean function is proposed for approximating the decision boundary of an ensemble of classifiers, and an intuitive explanation of computing Walsh coefficients for the functional approximation is provided. It is shown that the difference between the first- and third-order coefficient approximations is a good indicator of optimal base classifier complexity. When combining neural networks, the experimental results on a variety of artificial and real two-class problems demonstrate under what circumstances ensemble performance can be improved. For tuned base classifiers, the first-order coefficients provide performance similar to the majority vote. However, for weak/fast base classifiers, higher order coefficient approximation may give better performance. It is also shown that higher order coefficient approximation is superior to the Adaboost logarithmic weighting rule when boosting weak decision tree base classifiers.

Type: Article
Title: Approximation of Ensemble Boundary Using Spectral Coefficients
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TNNLS.2018.2861579
Publisher version: http://doi.org/10.1109/TNNLS.2018.2861579
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10068290
Downloads since deposit
Loading...
105Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item