Papers › Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised...

Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition

7 Dec 2021arXiv:2112.03590archive 2025-07-28

Tianyu Guo, Hong Liu, Zhan Chen, Mengyuan Liu, Tao Wang, Runwei Ding

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to construct similar positive samples, which limits the ability to explore novel movement patterns. In this paper, to make better use of the movement patterns introduced by extreme augmentations, a Contrastive Learning framework utilizing Abundant Information Mining for self-supervised action Representation (AimCLR) is proposed. First, the extreme augmentations and the Energy-based Attention-guided Drop Module (EADM) are proposed to obtain diverse positive samples, which bring novel movement patterns to improve the universality of the learned representations. Second, since directly using extreme augmentations may not be able to boost the performance due to the drastic changes in original identity, the Dual Distributional Divergence Minimization Loss (D³M Loss) is proposed to minimize the distribution divergence in a more gentle way. Third, the Nearest Neighbors Mining (NNM) is proposed to further expand positive samples to make the abundant information mining process more reasonable. Exhaustive experiments on NTU RGB+D 60, PKU-MMD, NTU RGB+D 120 datasets have verified that our AimCLR can significantly perform favorably against state-of-the-art methods under a variety of evaluation protocols with observed higher quality action representations. Our code is available at https://github.com/Levigty/AimCLR.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

levigty/aimclr officialmentioned in paperpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action RecognitionContrastive LearningFew-Shot Skeleton-Based Action RecognitionRepresentation LearningSelf-Supervised Action RecognitionSelf-Supervised Human Action RecognitionSelf-supervised Skeleton-based Action RecognitionSkeleton Based Action Recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Self-Supervised Human Action Recognition NTU RGB+D 120 3s-AimCLR Classifier FC #2 of 8 Archive leaderboard report
Self-Supervised Human Action Recognition NTU RGB+D 120 3s-AimCLR Encoder ST-GCN #2 of 8 Archive leaderboard report
Self-Supervised Human Action Recognition NTU RGB+D 120 3s-AimCLR xset (%) 68.8 #2 of 8 Archive leaderboard report
Self-Supervised Human Action Recognition NTU RGB+D 120 3s-AimCLR xsub (%) 68.2 #2 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Contrastive Learning

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections