Datasets › JHMDB

JHMDB (Joint-annotated Human Motion Data Base)

Introduced in Towards Understanding Action Recognition1 Jan 2013 archive 2025-07-28

JHMDB is an action recognition dataset that consists of 960 video sequences belonging to 21 actions. It is a subset of the larger HMDB51 dataset collected from digitized movies and YouTube videos. The dataset contains video and annotation for puppet flow per frame (approximated optimal flow on the person), puppet mask per frame, joint positions per frame, action label per clip and meta label per clip (camera motion, visible body parts, camera viewpoint, number of people, video quality).

Source: Unsupervised Deep Metric Learning via Orthogonality based Probabilistic Loss Image Source: https://arxiv.org/pdf/1712.06316.pdf

Benchmarks archive 2025-07-28

All 9 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

papers with a benchmark row: 53 · with a code link: 34 · where Syntology ran a sample: 11 (9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (11 of 53 with a benchmark row: 9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 53 of 53 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 249. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Scaling Open-Vocabulary Action Detection 1 2 4 Apr 2025 not harvested
Poseidon: A ViT-based Architecture for Multi-Frame Pose Estimation with Adaptive Frame Weighting and Multi-Scale Feature Fusion 1 1 14 Jan 2025 not harvested
Hierarchical Temporal Convolution Network:Towards Privacy-Centric Activity Recognition 1 2 21 Dec 2024 not harvested
Spectrum-guided Multi-granularity Referring Video Object Segmentation 1 1 25 Jul 2023 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (9 pointer-only for licence)
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation 1 2 26 May 2023 not harvested
Kinematic-aware Hierarchical Attention Network for Human Pose Estimation in Videos 1 1 29 Nov 2022 not harvested
Holistic Interaction Transformer Network for Action Detection 1 1 23 Oct 2022 not harvested
Deeply Interleaved Two-Stream Encoder for Referring Video Segmentation 0 1 30 Mar 2022 not harvested
DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimation 1 2 16 Mar 2022 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
End-to-End Referring Video Object Segmentation with Multimodal Transformers 2 2 29 Nov 2021 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (6 pointer-only for licence)
Hierarchical interaction network for video object segmentation from referring expressions 0 2 22 Nov 2021 not harvested
Do Different Tracking Tasks Require Different Appearance Models? 1 1 5 Jul 2021 official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 11 unverified
Cross-Modal Progressive Comprehension for Referring Segmentation 1 1 15 May 2021 not harvested
Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentation 0 1 14 May 2021 not harvested
ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation 0 1 19 Mar 2021 not harvested
Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network 0 1 9 Feb 2021 not harvested
Actor and Action Modular Network for Text-based Video Segmentation 0 1 2 Nov 2020 not harvested
Pose And Joint-Aware Action Recognition 1 1 16 Oct 2020 not harvested
Finding Action Tubes with a Sparse-to-Dense Framework 0 1 30 Aug 2020 not harvested
Polar Relative Positional Encoding for Video-Language Segmentation 0 1 20 Jul 2020 not harvested
Visual-Textual Capsule Routing for Text-Based Video Segmentation 0 1 1 Jun 2020 not harvested
Context Modulated Dynamic Networks for Actor and Action Video Segmentation with Language Queries 0 1 3 Apr 2020 not harvested
Actions as Moving Points 2 1 14 Jan 2020 official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (3 pointer-only for licence)
You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localization 5 2 15 Nov 2019 community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (2 pointer-only for licence)
Asymmetric Cross-Guided Attention Network for Actor and Action Video Segmentation From Natural Language Query 1 1 1 Oct 2019 not harvested
Hierarchical Self-Attention Network for Action Localization in Videos 0 2 1 Oct 2019 not harvested
Dynamic Kernel Distillation for Efficient Pose Estimation in Videos 0 1 24 Aug 2019 not harvested
Make Skeleton-based Action Recognition Model Smaller, Faster and Better 3 2 23 Jul 2019 not harvested
PA3D: Pose-Action 3D Machine for Video Recognition 0 2 1 Jun 2019 not harvested
TACNet: Transition-Aware Context Network for Spatio-Temporal Action Detection 0 1 31 May 2019 not harvested
Simple yet efficient real-time pose-based action recognition 1 2 19 Apr 2019 not harvested
Multigrid Predictive Filter Flow for Unsupervised Learning on Videos 2 1 2 Apr 2019 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (5 pointer-only for licence)
Dance with Flow: Two-in-One Stream Action Detection 1 2 1 Apr 2019 not harvested
STAR-Net: Action Recognition using Spatio-Temporal Activation Reprojection 0 1 26 Feb 2019 not harvested
Tracking Emerges by Colorizing Videos 1 1 25 Jun 2018 not harvested
PoTion: Pose MoTion Representation for Action Recognition 0 3 1 Jun 2018 not harvested
Simple Baselines for Human Pose Estimation and Tracking 27 1 17 Apr 2018 not harvested
Actor and Action Video Segmentation from a Sentence 1 2 20 Mar 2018 not harvested
Relational Autoencoder for Feature Extraction 2 1 9 Feb 2018 not harvested
LSTM Pose Machines 1 2 18 Dec 2017 not harvested
Graph Attention Networks 93 1 30 Oct 2017 community repositories only · 61 ran (of which 28 constructed an object rather than computing a result; 52 with no instrument failure: 1 honoured, 2 violated, 49 with no contract checked; 9 where Syntology's instrument failed) · 45 unverified (46 pointer-only for licence)
RPAN: An End-to-End Recurrent Pose-Attention Network for Action Recognition in Videos 1 1 22 Oct 2017 not harvested
Tracking by Natural Language Specification 0 1 1 Jul 2017 not harvested
AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions 9 1 23 May 2017 not harvested
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset 34 1 22 May 2017 16 ran (of which 7 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 6 where Syntology's instrument failed) · 12 unverified (7 pointer-only for licence)
Chained Multi-stream Networks Exploiting Pose, Motion, and Appearance for Action Classification and Detection 1 2 3 Apr 2017 not harvested
Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos 1 1 30 Mar 2017 not harvested
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks 12 1 6 Dec 2016 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (3 pointer-only for licence)
Multi-region two-stream R-CNN for action detection 0 3 17 Sep 2016 not harvested
Actionness Estimation Using Hybrid Fully Convolutional Networks 0 2 25 Apr 2016 not harvested
Segmentation from Natural Language Expressions 4 1 20 Mar 2016 not harvested
Convolutional Pose Machines 50 1 30 Jan 2016 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (3 pointer-only for licence)
Finding Action Tubes 1 2 21 Nov 2014 not harvested

Dataset loaders archive 2025-07-28

2 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • JHMDB (2D poses only)
  • J-HMDB
  • J-HMBD Early Action
  • JHMDB Pose Tracking
  • J-HMDB-21
  • JHMDB

6 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections