Browse State-of-the-Art › Skeleton Based Action Recognition

Skeleton Based Action Recognition

219 papers with code · 34 benchmarks · 30 datasets archive 2025-07-28

Computer VisionNatural Language ProcessingTime Series

Skeleton-based Action Recognition is a computer vision task that involves recognizing human actions from a sequence of 3D skeletal joint data captured from sensors such as Microsoft Kinect, Intel RealSense, and wearable devices. The goal of skeleton-based action recognition is to develop algorithms that can understand and classify human actions from skeleton data, which can be used in various applications such as human-computer interaction, sports analysis, and surveillance.

( Image credit: View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition )

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

34 leaderboard tables shown for this task, 34 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 34 until expanded.

DatasetBest model (first row in archive order)PaperCodeSyntologyCompare
NTU RGB+D (135 rows) Hulk(Finetune, ViT-L) Hulk: A Universal Knowledge Translator for Human-Centric Tasks code Syntology ran 12 of 24 samples · 12 unverified Compare
NTU RGB+D 120 (83 rows) ProtoGCN Revealing Key Details to See Differences: A Novel Prototypical... code — Compare
Kinetics-Skeleton dataset (42 rows) Structured Keypoint Pooling (PPNv2 skeletons+objects) Unified Keypoint-based Action Recognition Framework via Structured... — — Compare
N-UCLA (25 rows) DSCNet (RGB + Pose) A Dense-Sparse Complementary Network for Human Action Recognition... code — Compare
J-HMDB (13 rows) Potion PoTion: Pose MoTion Representation for Action Recognition — — Compare
SBU / SBU-Refine (9 rows) Joint Line Distance On Geometric Features for Skeleton-Based Action Recognition using... code — Compare
SYSU 3D (9 rows) SGN Semantics-Guided Neural Networks for Efficient Skeleton-Based... code Syntology ran 3 of 13 samples · 10 unverified Compare
UAV-Human (9 rows) HDBN HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based... code — Compare
CAD-120 (8 rows) NGM (5-shot) Neural Graph Matching Networks for Fewshot 3D Action Recognition — — Compare
Florence 3D (7 rows) Deep STGC_K Spatio-Temporal Graph Convolution for Skeleton Based Action Recognition — — Compare
SHREC 2017 track on 3D Hand Gesture Recognition (7 rows) RE-TCN Action Recognition in Real-World Ambient Assisted Living Environment code — Compare
UT-Kinect (7 rows) Temporal Subspace Clustering Subspace Clustering for Action Recognition with Covariance... code — Compare
Varying-view RGB-D Action-Skeleton (7 rows) VS-CNN A Large-scale Varying-view RGB-D Action Dataset for Arbitrary-view... — — Compare
JHMDB (2D poses only) (6 rows) HT-ConvNet Hierarchical Temporal Convolution Network:Towards Privacy-Centric... code — Compare
First-Person Hand Action Benchmark (4 rows) TCN-Summ Domain and View-point Agnostic Hand Action Recognition code — Compare
Gaming 3D (G3D) (4 rows) CNN Action Recognition Based on Joint Trajectory Maps with... — — Compare
H2O (2 Hands and Objects) (4 rows) CHASE(STSA-Net) CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based... code Syntology ran 2 of 2 samples · 0 unverified Compare
MSR Action3D (4 rows) Distribution of Action Movements + SVM Distribution of Action Movements (DAM): A Descriptor for Human... — — Compare
PKU-MMD (4 rows) RF-Action Making the Invisible Visible: Action Recognition Through Walls and... — — Compare
JHMDB Pose Tracking (3 rows) mgPFF+ft 1st Multigrid Predictive Filter Flow for Unsupervised Learning on Videos code Syntology ran 4 of 5 samples · 1 unverified Compare
NTU60-X (3 rows) 4s-ShiftGCN NTU-X: An Enhanced Large-scale Dataset for Improving Pose-based... code — Compare
UPenn Action (3 rows) UNIK UNIK: A Unified Framework for Real-world Skeleton-based Action Recognition code — Compare
UWA3D (3 rows) VA-fusion (aug.) View Adaptive Neural Networks for High Performance Skeleton-based... code Syntology ran 6 of 12 samples · 6 unverified Compare
Drive&Act (2 rows) dyalyt Do You Act Like You Talk? Exploring Pose-based Driver Action... code — Compare
HMDB51 (2 rows) Structured Keypoint Pooling Unified Keypoint-based Action Recognition Framework via Structured... — — Compare
J-HMBD Early Action (2 rows) DR^2N Relational Autoencoder for Feature Extraction code — Compare
MSRC-12 (2 rows) Temporal Subspace Clustering Subspace Clustering for Action Recognition with Covariance... code — Compare
TCG-dataset (2 rows) Bidirectional LSTM Traffic Control Gesture Recognition for Autonomous Vehicles code — Compare
Skeletics-152 (1 row) 4s-ShiftGCN Quo Vadis, Skeleton Action Recognition ? code — Compare
HDM05 (1 row) Temporal Subspace Clustering Subspace Clustering for Action Recognition with Covariance... code — Compare
Kinetics-400 (1 row) STGAT Spatial Temporal Graph Attention Network for Skeleton-Based Action... code — Compare
MSR ActionPairs (1 row) Temporal Subspace Clustering Subspace Clustering for Action Recognition with Covariance... code — Compare
Skeleton-Mimetics (1 row) MS-G3D Quo Vadis, Skeleton Action Recognition ? code — Compare
UCF101 (1 row) Structured Keypoint Pooling Unified Keypoint-based Action Recognition Framework via Structured... — — Compare

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

30 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 219 papers with code (419 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections