Liu, Xiaoke;
(2020)
Discriminative principal component analysis for high dimensional classification with applications in NIR spectroscopy.
Doctoral thesis (Ph.D), UCL (University College London).
Preview |
Text
Xiaoke_Thesis_0813.pdf Download (1MB) | Preview |
Abstract
Principal component analysis (PCA) has been widely applied in various fields such as bioscience, chemistry, computer science and social science as a signal processing, dimension reduction or feature extraction tool. Regardless of its popularity, when PCA is used as a preliminary dimension reduction step in developing classification rules with high-dimensional data it has a drawback that as an unsupervised method PCA fails to use the class labels when constructing the components. As a result, its maximization of the variance of the projected patterns is not necessarily in favour of discrimination among classes. To address this problem, in this thesis we propose five methods from three perspectives: 1) We propose two methods, reweighted PCA and between PCA, which combine supervised information in the feature generation step of PCA, so that more discriminating features are constructed within the classic PCA framework. 2) We propose two feature filtering methods, reordered PCA and stepwise-reordered PCA. In these methods, principal components are generated with the classic PCA framework, but re-ranked and selected according to their discriminating power with quadratic discriminant analysis (QDA). 3) We propose a penalised QDA based supervised feature extraction method to replace PCA, which can use the label information to generate more discriminating features. We use two near infrared (NIR) spectroscopic data sets, a wheat data set and a paddy rice data set to evaluate our methods in both binary and multi-class classification. We compare our methods with the classic principal component discriminant analysis (PCDA) and partial least squares discriminant analysis (PLS-DA). Enhancements in classification accuracy are witnessed for all our modified methods in all examples compared with the classic PCDA. Four simulations have been constructed to help understanding the mechanism and evaluating the performance of our penalised QDA based feature extraction method in Chapter 3.
Type: | Thesis (Doctoral) |
---|---|
Qualification: | Ph.D |
Title: | Discriminative principal component analysis for high dimensional classification with applications in NIR spectroscopy |
Event: | UCL (University College London) |
Open access status: | An open access version is available from UCL Discovery |
Language: | English |
Additional information: | Copyright © The Author 2020. Original content in this thesis is licensed under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/). Any third-party copyright material present remains the property of its respective owner(s) and is licensed under its existing terms. Access may initially be restricted at the author’s request. |
UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10107869 |
Archive Staff Only
View Item |