Lv, Yuanling;
Yan, Yan;
Xue, Jing-Hao;
Chen, Si;
Wang, Hanzi;
(2024)
Relationship-Guided Knowledge Transfer for Class-Incremental Facial Expression Recognition.
IEEE Transactions on Image Processing
, 33
pp. 2293-2304.
10.1109/tip.2024.3374116.
Preview |
PDF
YuanlingLv-TIP-2024.pdf - Accepted Version Download (3MB) | Preview |
Abstract
Human emotions contain both basic and compound facial expressions. In many practical scenarios, it is difficult to access all the compound expression categories at one time. In this paper, we investigate comprehensive facial expression recognition (FER) in the class-incremental learning paradigm, where we define well-studied and easily-accessible basic expressions as initial classes and learn new compound expressions incrementally. To alleviate the stability-plasticity dilemma in our incremental task, we propose a novel Relationship-Guided Knowledge Transfer (RGKT) method for class-incremental FER. Specifically, we develop a multi-region feature learning (MFL) module to extract fine-grained features for capturing subtle differences in expressions. Based on the MFL module, we further design a basic expression-oriented knowledge transfer (BET) module and a compound expression-oriented knowledge transfer (CET) module, by effectively exploiting the relationship across expressions. The BET module initializes the new compound expression classifiers based on expression relevance between basic and compound expressions, improving the plasticity of our model to learn new classes. The CET module transfers expression-generic knowledge learned from new compound expressions to enrich the feature set of old expressions, facilitating the stability of our model against forgetting old classes. Extensive experiments on three facial expression databases show that our method achieves superior performance in comparison with several state-of-the-art methods.
| Type: | Article |
|---|---|
| Title: | Relationship-Guided Knowledge Transfer for Class-Incremental Facial Expression Recognition |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/tip.2024.3374116 |
| Publisher version: | http://dx.doi.org/10.1109/tip.2024.3374116 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Compounds , Task analysis , Knowledge transfer , Representation learning , Feature extraction , Training , Face recognition |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10189814 |
Archive Staff Only
 |
View Item |
