eprintid: 10068290 rev_number: 18 eprint_status: archive userid: 608 dir: disk0/10/06/82/90 datestamp: 2019-02-19 13:36:12 lastmod: 2021-09-20 22:36:52 status_changed: 2019-02-19 13:36:12 type: article metadata_visibility: show creators_name: Windeatt, T creators_name: Zor, C creators_name: Camgoz, NC title: Approximation of Ensemble Boundary Using Spectral Coefficients ispublished: pub divisions: UCL divisions: B04 divisions: C05 divisions: F48 note: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. abstract: IEEE A spectral analysis of a Boolean function is proposed for approximating the decision boundary of an ensemble of classifiers, and an intuitive explanation of computing Walsh coefficients for the functional approximation is provided. It is shown that the difference between the first- and third-order coefficient approximations is a good indicator of optimal base classifier complexity. When combining neural networks, the experimental results on a variety of artificial and real two-class problems demonstrate under what circumstances ensemble performance can be improved. For tuned base classifiers, the first-order coefficients provide performance similar to the majority vote. However, for weak/fast base classifiers, higher order coefficient approximation may give better performance. It is also shown that higher order coefficient approximation is superior to the Adaboost logarithmic weighting rule when boosting weak decision tree base classifiers. date: 2019-04 date_type: published official_url: http://doi.org/10.1109/TNNLS.2018.2861579 oa_status: green full_text_type: other language: eng primo: open primo_central: open_green verified: verified_manual elements_id: 1629763 doi: 10.1109/TNNLS.2018.2861579 lyricists_name: Zor, Cemre lyricists_id: CZORX93 actors_name: Flynn, Bernadette actors_id: BFFLY94 actors_role: owner full_text_status: public publication: IEEE Transactions on Neural Networks and Learning Systems volume: 30 number: 4 pagerange: 1272-1277 issn: 2162-2388 citation: Windeatt, T; Zor, C; Camgoz, NC; (2019) Approximation of Ensemble Boundary Using Spectral Coefficients. IEEE Transactions on Neural Networks and Learning Systems , 30 (4) pp. 1272-1277. 10.1109/TNNLS.2018.2861579 <https://doi.org/10.1109/TNNLS.2018.2861579>. Green open access document_url: https://discovery.ucl.ac.uk/id/eprint/10068290/1/windeattTNNLS-2013-P-0123.pdf