Papers › Graph Contrastive Learning for Skeleton-based Action Recognition

Graph Contrastive Learning for Skeleton-based Action Recognition

26 Jan 2023arXiv:2301.10900archive 2025-07-28

Xiaohu Huang, Hao Zhou, Jian Wang, Haocheng Feng, Junyu Han, Errui Ding, Jingdong Wang, Xinggang Wang, Wenyu Liu, Bin Feng

In the field of skeleton-based action recognition, current top-performing graph convolutional networks (GCNs) exploit intra-sequence context to construct adaptive graphs for feature aggregation. However, we argue that such context is still \textit{local} since the rich cross-sequence relations have not been explicitly investigated. In this paper, we propose a graph contrastive learning framework for skeleton-based action recognition (\textit{SkeletonGCL}) to explore the \textit{global} context across all sequences. In specific, SkeletonGCL associates graph learning across sequences by enforcing graphs to be class-discriminative, \emph{i.e.,} intra-class compact and inter-class dispersed, which improves the GCN capacity to distinguish various action patterns. Besides, two memory banks are designed to enrich cross-sequence context from two complementary levels, \emph{i.e.,} instance and semantic levels, enabling graph contrastive learning in multiple context scales. Consequently, SkeletonGCL establishes a new training paradigm, and it can be seamlessly incorporated into current GCNs. Without loss of generality, we combine SkeletonGCL with three GCNs (2S-ACGN, CTR-GCN, and InfoGCN), and achieve consistent improvements on NTU60, NTU120, and NW-UCLA benchmarks. The source code will be available at \url{https://github.com/OliverHxh/SkeletonGCL}.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

oliverhxh/skeletongcl officialmentioned in papermentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action RecognitionContrastive LearningGraph LearningSkeleton Based Action Recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Skeleton Based Action Recognition NTU RGB+D SkeletonGCL (based on CTR-GCN) Accuracy (CS) 93.1 #19 of 135 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D SkeletonGCL (based on CTR-GCN) Accuracy (CV) 97.0 #19 of 135 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D SkeletonGCL (based on CTR-GCN) Ensembled Modalities 4 #19 of 135 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D 120 SkeletonGCL (based on CTR-GCN) Accuracy (Cross-Setup) 91.0 #18 of 83 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D 120 SkeletonGCL (based on CTR-GCN) Accuracy (Cross-Subject) 89.5 #18 of 83 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D 120 SkeletonGCL (based on CTR-GCN) Ensembled Modalities 4 #18 of 83 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Contrastive LearningGCN

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections