Datasets › NTU RGB+D

NTU RGB+D

Introduced by Amir Shahroudy et al. in NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis1 Jan 2016 archive 2025-07-28

NTU RGB+D is a large-scale dataset for RGB-D human action recognition. It involves 56,880 samples of 60 action classes collected from 40 subjects. The actions can be generally divided into three categories: 40 daily actions (e.g., drinking, eating, reading), nine health-related actions (e.g., sneezing, staggering, falling down), and 11 mutual actions (e.g., punching, kicking, hugging). These actions take place under 17 different scene conditions corresponding to 17 video sequences (i.e., S001–S017). The actions were captured using three cameras with different horizontal imaging viewpoints, namely, −45∘,0∘, and +45∘. Multi-modality information is provided for action characterization, including depth maps, 3D skeleton joint position, RGB frames, and infrared sequences. The performance evaluation is performed by a cross-subject test that split the 40 subjects into training and test groups, and by a cross-view test that employed one camera (+45∘) for testing, and the other two cameras for training.

Source: Action Recognition for Depth Video using Multi-view Dynamic Images

Benchmarks archive 2025-07-28

All 9 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 1 newer paper was judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Skeleton Based Action Recognition · NTU RGB+D (1 judged, 0 placed), Action Recognition · NTU RGB+D (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

First row (archive order)PaperCode
Skeleton Based Action Recognition NTU RGB+D Hulk(Finetune, ViT-L) Accuracy (CS) 94.3 Hulk: A Universal Knowledge Translator for Human-Centric Tasks opengvlab/humanbench +1 135 Compare
Action Recognition NTU RGB+D DSCNet (RGB + Pose) Accuracy (CS) 97.4 A Dense-Sparse Complementary Network for Human Action... Maxchengqin/DSCNet 28 Compare
Zero Shot Skeletal Action Recognition NTU RGB+D TDSM Accuracy (12 unseen classes) 56.03 TDSM: Triplet Diffusion for Skeleton-Text Matching in... KAIST-VICLab/TDSM 9 Compare
3D Action Recognition NTU RGB+D Kinet Cross Subject Accuracy 92.3 No Pain, Big Gain: Classify Dynamic Point Cloud... jx-zhong-for-academic-purpose/kinet 5 Compare
Human Interaction Recognition NTU RGB+D SkateFormer Accuracy (Cross-Subject) 97.1 SkateFormer: Skeletal-Temporal Transformer for Human... KAIST-VICLab/SkateFormer 5 Compare
Generalized Zero Shot skeletal action recognition NTU RGB+D MSF-GZSSAR Harmonic Mean (5 unseen classes) 68.83 Multi-Semantic Fusion Model for Generalized Zero-Shot... EHZ9NIWI7/MSF-GZSSAR 4 Compare
Human action generation NTU RGB+D Kinetic-GAN FID (CS) 3.618 Generative Adversarial Graph Convolutional Networks for... degardinbruno/kinetic-gan 3 Compare
Pose Prediction Filtered NTU RGB+D PISEP^2 (L1 norm) MSE 0.1210 PISEP^2: Pseudo Image Sequence Evolution based 3D Pose Prediction — 3 Compare
Action Recognition In Videos NTU RGB+D 2D-3D-Softargmax (RGB only) Accuracy (CS) 85.5 2D/3D Pose Estimation and Action Recognition using... dluvizon/deephar +1 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 162 · with a code link: 106 · where Syntology ran a sample: 30 (26 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (30 of 162 with a benchmark row: 26 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)

Page 1 of 2: papers 1 to 100 of 162 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 476. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Zero-shot Skeleton-based Action Recognition with Prototype-guided Feature Alignment 1 1 1 Jul 2025 not harvested
DSTSA-GCN: Advancing Skeleton-Based Gesture Recognition with Semantic-Aware Spatio-Temporal Topology Modeling 1 2 21 Jan 2025 not harvested
MSA-GCN: Exploiting Multi-Scale Temporal Dynamics With Adaptive Graph Convolution for Skeleton-Based Action Recognition 0 1 19 Dec 2024 not harvested
USDRL: Unified Skeleton-Based Dense Representation Learning with Multi-Grained Feature Decorrelation 1 1 12 Dec 2024 not harvested
Revealing Key Details to See Differences: A Novel Prototypical Perspective for Skeleton-based Action Recognition 1 1 28 Nov 2024 not harvested
TDSM: Triplet Diffusion for Skeleton-Text Matching in Zero-Shot Action Recognition 1 1 16 Nov 2024 not harvested
Joint Mixing Data Augmentation for Skeleton-based Action Recognition 1 1 13 Oct 2024 not harvested
CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action Recognition 1 1 9 Oct 2024 official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Action Recognition for Privacy-Preserving Ambient Assisted Living 1 1 15 Aug 2024 not harvested
EPAM-Net: An Efficient Pose-driven Attention-guided Multimodal Network for Video Action Recognition 1 1 10 Aug 2024 not harvested
Joint-Partition Group Attention for skeleton-based action recognition 1 2 30 Jul 2024 not harvested
Multi-Modality Co-Learning for Efficient Skeleton-based Action Recognition 1 1 22 Jul 2024 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (10 pointer-only for licence)
SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoders 1 4 18 Jul 2024 not harvested
Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformer 1 1 17 Jul 2024 not harvested
Shap-Mix: Shapley Value Guided Mixing for Long-Tailed Skeleton Based Action Recognition 1 1 17 Jul 2024 not harvested
Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognition 1 1 19 Jun 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognition 0 1 11 Apr 2024 not harvested
DeGCN: Deformable Graph Convolutional Networks for Skeleton-Based Action Recognition 1 1 25 Mar 2024 not harvested
SkateFormer: Skeletal-Temporal Transformer for Human Action Recognition 1 2 14 Mar 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
AutoGCN -- Towards Generic Human Activity Recognition with Neural Architecture Search 1 1 2 Feb 2024 not harvested
Explore Human Parsing Modality for Action Recognition 1 1 4 Jan 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (10 pointer-only for licence)
BlockGCN: Redefine Topology Awareness for Skeleton-Based Action Recognition 1 1 1 Jan 2024 not harvested
MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning 0 1 1 Jan 2024 not harvested
A Dense-Sparse Complementary Network for Human Action Recognition based on RGB and Skeleton Modalities 1 1 28 Dec 2023 not harvested
DVANet: Disentangling View and Action Features for Multi-View Action Recognition 1 1 10 Dec 2023 not harvested
STEP CATFormer: Spatial-Temporal Effective Body-Part Cross Attention Transformer for Skeleton-based Action Recognition 1 1 6 Dec 2023 official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (6 pointer-only for licence)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks 2 2 4 Dec 2023 official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 9 where Syntology's instrument failed) · 11 unverified (11 pointer-only for licence)
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily Living 1 2 30 Nov 2023 not harvested
Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognition 1 1 18 Sep 2023 not harvested
B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition 1 1 30 Aug 2023 not harvested
Masked Motion Predictors are Strong 3D Action Representation Learners 1 1 14 Aug 2023 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (4 pointer-only for licence)
Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximization 1 1 7 Aug 2023 not harvested
Integrating Human Parsing and Pose Network for Human Action Recognition 1 1 16 Jul 2023 not harvested
Action Recognition with Multi-stream Motion Modeling and Mutual Information Maximization 0 1 13 Jun 2023 not harvested
Language Knowledge-Assisted Representation Learning for Skeleton-Based Action Recognition 1 1 21 May 2023 not harvested
Multi-scale spatial–temporal convolutional neural network for skeleton-based action recognition 1 1 12 May 2023 not harvested
Temporal Decoupling Graph Convolutional Network for Skeleton-based Gesture Recognition 1 1 1 May 2023 not harvested
Actionlet-Dependent Contrastive Learning for Unsupervised Skeleton-Based Action Recognition 0 1 20 Mar 2023 not harvested
HYperbolic Self-Paced Learning for Self-Supervised Skeleton-based Action Representations 1 2 10 Mar 2023 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified
Action Capsules: Human Skeleton Action Recognition 0 1 30 Jan 2023 not harvested
Graph Contrastive Learning for Skeleton-based Action Recognition 1 1 26 Jan 2023 not harvested
Multi-View Action Recognition Using Contrastive Learning 1 1 3 Jan 2023 not harvested
SkeleTR: Towards Skeleton-based Action Recognition in the Wild 0 1 1 Jan 2023 not harvested
Cross-Modal Learning with 3D Deformable Attention for Action Recognition 0 1 12 Dec 2022 not harvested
Hypergraph Transformer for Skeleton-based Action Recognition 1 1 17 Nov 2022 official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 1 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (9 pointer-only for licence)
A Unified Multimodal De- and Re-coupling Framework for RGB-D Motion Recognition 1 1 16 Nov 2022 not harvested
STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition 0 1 14 Oct 2022 not harvested
DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action Recognition 3 1 12 Oct 2022 not harvested
MotionBERT: A Unified Perspective on Learning Human Motion Representations 1 1 12 Oct 2022 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (4 pointer-only for licence)
Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognition 1 1 23 Aug 2022 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 1 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (7 pointer-only for licence)
Spatial Temporal Graph Attention Network for Skeleton-Based Action Recognition 1 1 18 Aug 2022 not harvested
PSUMNet: Unified Modality Part Streams are All You Need for Efficient Pose-based Action Recognition 1 1 11 Aug 2022 not harvested
Generative Action Description Prompts for Skeleton-based Action Recognition 3 1 10 Aug 2022 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
IGFormer: Interaction Graph Transformer for Skeleton-based Human Interaction Recognition 0 1 25 Jul 2022 not harvested
Skeleton-based Action Recognition via Temporal-Channel Aggregation 1 1 31 May 2022 not harvested
PSTNet: Point Spatio-Temporal Convolution on Point Cloud Sequences 1 1 27 May 2022 not harvested
MMNet: A Model-Based Multimodal Network for Human Action Recognition in RGB-D Videos 1 1 26 May 2022 not harvested
PYSKL: Towards Good Practices for Skeleton Action Recognition 1 2 19 May 2022 not harvested
No Pain, Big Gain: Classify Dynamic Point Cloud Sequences with Static Models by Fitting Feature-level Space-time Surfaces 1 1 21 Mar 2022 not harvested
Continual Spatio-Temporal Graph Convolutional Networks 1 7 21 Mar 2022 not harvested
InfoGCN: Representation Learning for Human Skeleton-Based Action Recognition 1 1 1 Jan 2022 not harvested
Deep Hierarchical Representation of Point Cloud Videos via Spatio-Temporal Decomposition 1 1 14 Dec 2021 not harvested
3DVNet: Multi-View Depth Prediction and Volumetric Refinement 1 1 1 Dec 2021 not harvested
Generative Adversarial Graph Convolutional Networks for Human Action Synthesis 1 1 21 Oct 2021 not harvested
Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation 0 1 16 Aug 2021 not harvested
Learning Multi-Granular Spatio-Temporal Graph Network for Skeleton-based Action Recognition 1 1 10 Aug 2021 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence)
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition 2 1 26 Jul 2021 official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (3 pointer-only for licence)
Constructing Stronger and Faster Baselines for Skeleton-based Action Recognition 4 3 29 Jun 2021 not harvested
Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos 1 1 19 Jun 2021 not harvested
Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition 1 1 18 May 2021 not harvested
Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action Recognition 1 1 4 May 2021 not harvested
Revisiting Skeleton-based Action Recognition 4 2 28 Apr 2021 not harvested
Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognition 1 2 27 Jan 2021 not harvested
Tensor Representations for Action Recognition 1 1 28 Dec 2020 not harvested
MSAF: Multimodal Split Attention Fusion 1 1 13 Dec 2020 not harvested
Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognition 1 1 20 Oct 2020 not harvested
Pose Refinement Graph Convolutional Network for Skeleton-based Action Recognition 0 1 14 Oct 2020 not harvested
Skeleton-based Action Recognition via Spatial and Temporal Transformer Networks 1 1 17 Aug 2020 not harvested
Richly Activated Graph Convolutional Network for Robust Skeleton-based Action Recognition 3 1 9 Aug 2020 not harvested
Hierarchical Action Classification with Network Pruning 0 1 30 Jul 2020 not harvested
Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition 0 1 30 Jul 2020 not harvested
Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognition 1 1 29 Jul 2020 not harvested
Decoupled Spatial-Temporal Attention Network for Skeleton-Based Action Recognition 1 1 7 Jul 2020 not harvested
VPN: Learning Video-Pose Embedding for Activities of Daily Living 1 1 6 Jul 2020 not harvested
Skeleton-Based Action Recognition With Shift Graph Convolutional Network 1 1 1 Jun 2020 not harvested
A Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition 0 1 1 May 2020 not harvested
Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition 3 1 31 Mar 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Temporal Extension Module for Skeleton-Based Action Recognition 0 1 19 Mar 2020 not harvested
Feedback Graph Convolutional Network for Skeleton-based Action Recognition 0 1 17 Mar 2020 not harvested
Predictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition 1 1 17 Mar 2020 not harvested
Unifying Graph Embedding Features with Graph Convolutional Networks for Skeleton-based Action Recognition 0 1 6 Mar 2020 not harvested
Infrared and 3D skeleton feature fusion for RGB-D action recognition 1 1 28 Feb 2020 not harvested
Context-Aware Cross-Attention for Skeleton-Based Human Action Recognition 0 1 20 Jan 2020 not harvested
PGCN-TCA: Pseudo Graph Convolutional Network With Temporal and Channel-Wise Attention for Skeleton-Based Action Recognition 0 1 6 Jan 2020 not harvested
Focusing and Diffusion: Bidirectional Attentive Graph Convolutional Networks for Skeleton-based Action Recognition 0 1 24 Dec 2019 not harvested
Vertex Feature Encoding and Hierarchical Temporal Modeling in a Spatial-Temporal Graph Convolutional Network for Action Recognition 0 1 20 Dec 2019 not harvested
Self-Attention Network for Skeleton-based Human Action Recognition 0 1 18 Dec 2019 not harvested
Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networks 2 2 15 Dec 2019 not harvested
An Attention-Enhanced Recurrent Graph Convolutional Network for Skeleton-Based Action Recognition 0 1 27 Nov 2019 not harvested
MMTM: Multimodal Transfer Module for CNN Fusion 1 1 20 Nov 2019 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Custom (research-only, non-commercial, attribution)

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • NTU RGB+D
  • Filtered NTU RGB+D

2 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections