Papers › Robust Long-Tailed Learning under Label Noise

Robust Long-Tailed Learning under Label Noise

26 Aug 2021arXiv:2108.11569archive 2025-07-28

Tong Wei, Jiang-Xin Shi, Wei-Wei Tu, Yu-Feng Li

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move long-tailed learning towards more realistic scenarios, this work investigates the label noise problem under long-tailed label distribution. We first observe the negative impact of noisy labels on the performance of existing methods, revealing the intrinsic challenges of this problem. As the most commonly used approach to cope with noisy labels in previous literature, we then find that the small-loss trick fails under long-tailed label distribution. The reason is that deep neural networks cannot distinguish correctly-labeled and mislabeled examples on tail classes. To overcome this limitation, we establish a new prototypical noise detection method by designing a distance-based metric that is resistant to label noise. Based on the above findings, we propose a robust framework,~\algo, that realizes noise detection for long-tailed learning, followed by soft pseudo-labeling via both label smoothing and diverse label guessing. Moreover, our framework can naturally leverage semi-supervised learning algorithms to further improve the generalisation. Extensive experiments on benchmark and real-world datasets demonstrate the superiority of our methods over existing baselines. In particular, our method outperforms DivideMix by 3\% in test accuracy. Source code will be released soon.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification mini WebVision 1.0 ROLT+ (Inception-ResNet-v2) ImageNet Top-1 Accuracy 74.64 #27 of 47 Archive leaderboard report
Image Classification mini WebVision 1.0 ROLT+ (Inception-ResNet-v2) ImageNet Top-5 Accuracy 92.48 #27 of 47 Archive leaderboard report
Image Classification mini WebVision 1.0 ROLT+ (Inception-ResNet-v2) Top-1 Accuracy 77.64 #27 of 47 Archive leaderboard report
Image Classification mini WebVision 1.0 ROLT+ (Inception-ResNet-v2) Top-5 Accuracy 92.44 #27 of 47 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Label Smoothing

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections