UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Deep InterBoost networks for small-sample image classification

Li, X; Chang, D; Ma, Z; Tan, Z-H; Xue, J; Cao, J; Guo, J; (2021) Deep InterBoost networks for small-sample image classification. Neurocomputing , 456 pp. 492-503. 10.1016/j.neucom.2020.06.135. Green open access

[thumbnail of NEUCOM-D-20-00602R1-accepted.pdf]
Preview
Text
NEUCOM-D-20-00602R1-accepted.pdf - Accepted Version

Download (9MB) | Preview

Abstract

Deep neural networks have recently shown excellent performance on numerous image classification tasks. These networks often need to estimate a large number of parameters and require much training data. When the amount of training data is small, however, a network with high flexibility quickly overfits the training data, resulting in a large model variance and poor generalization. To address this problem, we propose a new, simple yet effective ensemble method called InterBoost for small-sample image classification. In the training phase, InterBoost first randomly generates two sets of complementary weights for training data, which are used for separately training two base networks of the same structure, and then the two sets of complementary weights are updated for refining the training of the networks through interaction between the two base networks previously trained. This interactive training process continues iteratively until a stop criterion is met. In the testing phase, the outputs of the two networks are combined to obtain one final score for classification. Experimental results on four small-sample datasets, UIUC-Sports, LabelMe, 15Scenes and Caltech101, demonstrate that the proposed ensemble method outperforms existing ones. Moreover, results from the Wilcoxon signed-rank tests show that our method is statistically significantly better than the methods compared. Detailed analysis is also provided for an in-depth understanding of the proposed method.

Type: Article
Title: Deep InterBoost networks for small-sample image classification
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.neucom.2020.06.135
Publisher version: https://doi.org/10.1016/j.neucom.2020.06.135
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Ensemble learning, Deep neural network, Small-sample image classification, Overfitting
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/10106585
Downloads since deposit
105Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item