Zhang, Xuan;
Chin, Sinchee;
Xue, Jing-Hao;
Yang, Xiaochen;
Yang, Wenming;
(2025)
DARL: Mitigating Gradient Conflicts in Long-Tailed Out-of-Distribution Learning.
In:
MM '25: Proceedings of the 33rd ACM International Conference on Multimedia.
(pp. pp. 6868-6877).
ACM (Association for Computing Machinery): New York, NY, USA.
Preview |
Text
3746027.3755127.pdf - Published Version Download (4MB) | Preview |
Abstract
Long-tailed out-of-distribution learning aims to reduce performance bias in long-tailed in-distribution (ID) data while rejecting out-of-distribution (OOD) samples, which are often mistaken for under-represented tail classes. To achieve OOD detection, existing methods incorporate an outlier exposure (OE) term into the long-tailed recognition (LTR) loss. However, as we prove in this paper, the OE term induces a gradient conflict with the ID objectives, especially for tail classes, thereby contradicting the core motivation of LTR. To avoid the ID-OOD dilemma, we propose Dynamic Ambiguity-aware Recalibration for Logits (DARL), an ambiguity-guided long-tailed OOD learning approach, grounded on two theoretical insights. First, we show that the mixed ID data can mitigate the conflict in OE training and exhibits higher intrinsic ambiguity than the original ID data, thus able to serve as a surrogate for real OOD data. Second, we introduce an ambiguity-aware logit adjustment that can dynamically calibrate the class margins using energy-based ambiguity metrics, effectively reducing early-stage bias while avoiding late-stage overfitting. Extensive experiments show that DARL achieves the overall state-of-the-art performance of long-tailed OOD learning. Moreover, compared with the OE methods, DARL trains solely on the ID data, which can reduce the data requirements by 80%. The code is available in https://github.com/XuanZhang-A/DARL.
| Type: | Proceedings paper |
|---|---|
| Title: | DARL: Mitigating Gradient Conflicts in Long-Tailed Out-of-Distribution Learning |
| Event: | MM '25: The 33rd ACM International Conference on Multimedia |
| ISBN-13: | 979-8-4007-2035-2 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3746027.3755127 |
| Publisher version: | https://doi.org/10.1145/3746027.3755127 |
| Language: | English |
| Additional information: | Copyright © 2025. Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution 4.0 International License, https://creativecommons.org/licenses/by/4.0/. |
| Keywords: | ID-OOD gradient conflicts; ambiguity-aware logit adjustment; long-tailed recognition; out-of-distribution detection |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10217249 |
Archive Staff Only
 |
View Item |
