Datasets › Something-Something V2

Something-Something V2

Introduced by Raghav Goyal et al. in The "something something" video database for learning and evaluating visual common sense1 Jan 2017 archive 2025-07-28

The 20BN-SOMETHING-SOMETHING V2 dataset is a large collection of labeled video clips that show humans performing pre-defined basic actions with everyday objects. The dataset was created by a large number of crowd workers. It allows machine learning models to develop fine-grained understanding of basic actions that occur in the physical world. It contains 220,847 videos, with 168,913 in the training set, 24,777 in the validation set and 27,157 in the test set. There are 174 labels.

Source

Image Source

Benchmarks archive 2025-07-28

All 7 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Action Recognition Something-Something V2 MVD (Kinetics400 pretrain, ViT-H, 16 frame) Top-1 Accuracy 77.3 Masked Video Distillation: Rethinking Masked Feature... ruiwang2021/mvd +3 123 Compare
Action Recognition In Videos Something-Something V2 STM (16 frames, ImageNet pretraining) Top-1 Accuracy 64.2 STM: SpatioTemporal and Motion Encoding for Action Recognition — 4 Compare
General Action Video Anomaly Detection Something-Something V2 Pooled Image Level kNN Avg. ROC-AUC 0.58 Approaches Toward Physical and General Video Anomaly Detection laurarkart/Physical-Anomalous-Trajectory-or-Motion-PHANTOM-Dataset 3 Compare
Action Classification Something-Something V2 AdaMAE Acc@1 70.04 AdaMAE: Adaptive Masking for Efficient Spatiotemporal... wgcban/adamae +1 1 Compare
Text-to-Video Generation Something-Something V2 MAGVIT FVD 79.1 MAGVIT: Masked Generative Video Transformer google-research/magvit 1 Compare
Video Classification Something-Something V2 MSNet-R50En (ours) Top-5 Accuracy 91 MotionSqueeze: Neural Motion Feature Learning for Video... arunos728/MotionSqueeze +1 1 Compare
Video Prediction Something-Something V2 MAGVIT FVD 28.5 MAGVIT: Masked Generative Video Transformer google-research/magvit 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 85 · with a code link: 66 · where Syntology ran a sample: 38 (34 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (38 of 85 with a benchmark row: 34 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 85 of 85 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 290. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
DejaVid: Encoder-Agnostic Learned Temporal Matching for Video Classification 1 1 1 Jan 2025 not harvested
TDS-CLIP: Temporal Difference Side Network for Image-to-Video Transfer Learning 1 1 20 Aug 2024 not harvested
Learning Correlation Structures for Vision Transformers 0 1 5 Apr 2024 not harvested
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding 2 2 22 Mar 2024 not harvested
CAST: Cross-Attention in Space and Time for Video Action Recognition 1 1 30 Nov 2023 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (17 pointer-only for licence)
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning 2 1 27 Nov 2023 not harvested
Asymmetric Masked Distillation for Pre-Training Small Foundation Models 0 2 6 Nov 2023 not harvested
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video 2 1 2 Oct 2023 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Temporally-Adaptive Models for Efficient Video Understanding 1 2 10 Aug 2023 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
What Can Simple Arithmetic Operations Do for Temporal Modeling? 2 1 18 Jul 2023 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles 4 1 1 Jun 2023 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
SCP: Soft Conditional Prompt Learning for Aerial Video Action Recognition 0 1 21 May 2023 not harvested
Implicit Temporal Modeling with Learnable Alignment for Video Recognition 1 2 20 Apr 2023 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking 1 1 29 Mar 2023 official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 2 samples that ran constructed an object rather than computing a result
The effectiveness of MAE pre-pretraining for billion-scale pretraining 1 1 23 Mar 2023 not harvested
ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked Autoencoders 2 1 21 Mar 2023 not harvested
Maximizing Spatio-Temporal Entropy of Deep 3D CNNs for Efficient Video Recognition 1 1 5 Mar 2023 not harvested
Multi-scale Motion-Aware Module for Video Action Recognition 0 1 19 Feb 2023 not harvested
MAGVIT: Masked Generative Video Transformer 1 2 10 Dec 2022 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning 4 4 8 Dec 2022 not harvested
InternVideo: General Video Foundation Models via Generative and Discriminative Learning 2 1 6 Dec 2022 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning 1 1 6 Dec 2022 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Global Temporal Difference Network for Action Recognition 0 1 23 Nov 2022 not harvested
AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders 2 1 16 Nov 2022 official (archive's flag): 14 ran · 18 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (6 pointer-only for licence)
UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer 2 1 22 Sep 2022 not harvested
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks 0 1 15 Sep 2022 not harvested
Spatial-Temporal Pyramid Graph Reasoning for Action Recognition 0 1 9 Aug 2022 not harvested
Spatiotemporal Self-attention Modeling with Temporal Patch Shift for Action Recognition 1 1 27 Jul 2022 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result
MAR: Masked Autoencoders for Efficient Action Recognition 1 4 24 Jul 2022 not harvested
Action Recognition With Motion Diversification and Dynamic Selection 0 1 15 Jul 2022 not harvested
ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning 1 1 27 Jun 2022 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Stand-Alone Inter-Frame Attention in Video Models 1 1 14 Jun 2022 not harvested
MLP-3D: A MLP-like 3D Architecture with Grouped Time Mixing 0 1 13 Jun 2022 not harvested
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training 9 3 23 Mar 2022 official (archive's flag): 9 ran · 10 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (12 pointer-only for licence)
DirecFormer: A Directed Attention in Transformer Approach to Robust Action Recognition 1 1 19 Mar 2022 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (8 pointer-only for licence)
Group Contextualization for Video Recognition 1 1 18 Mar 2022 official (archive's flag): 5 ran · 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 5 samples that ran constructed an object rather than computing a result
Motion-driven Visual Tempo Learning for Video-based Action Recognition 2 1 24 Feb 2022 not harvested
Omnivore: A Single Model for Many Visual Modalities 2 1 20 Jan 2022 official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (1 pointer-only for licence)
Action Keypoint Network for Efficient Video Recognition 0 1 17 Jan 2022 not harvested
Multiview Transformers for Video Recognition 1 1 12 Jan 2022 not harvested
Masked Feature Prediction for Self-Supervised Visual Pre-Training 6 1 16 Dec 2021 not harvested
Approaches Toward Physical and General Video Anomaly Detection 1 2 14 Dec 2021 not harvested
Co-training Transformer with Videos and Images Improves Action Recognition 0 2 14 Dec 2021 not harvested
BEVT: BERT Pretraining of Video Transformers 1 1 2 Dec 2021 not harvested
MViTv2: Improved Multiscale Vision Transformers for Classification and Detection 9 4 2 Dec 2021 not harvested
Self-supervised Video Transformer 1 1 2 Dec 2021 official: harvested, nothing ran · 0 ran · 1 unverified
MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation Learning 2 1 24 Nov 2021 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
Relational Self-Attention: What's Missing in Attention for Video Understanding 1 5 2 Nov 2021 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (1 pointer-only for licence)
Object-Region Video Transformers 1 2 13 Oct 2021 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (7 pointer-only for licence)
TAda! Temporally-Adaptive Convolutions for Video Understanding 2 4 12 Oct 2021 official: not harvested · 0 ran · 1 unverified
UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning 3 2 29 Sep 2021 not harvested
Video Swin Transformer 15 1 24 Jun 2021 official (archive's flag): 3 ran · 19 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 0 violated, 13 with no contract checked; 5 where Syntology's instrument failed) · 13 unverified (7 pointer-only for licence)
VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning 1 1 21 Jun 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Space-time Mixing Attention for Video Transformer 1 1 10 Jun 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers 2 3 9 Jun 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence)
CT-Net: Channel Tensorization Network for Video Classification 1 1 3 Jun 2021 official (archive's flag): 11 ran · 11 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified
VidTr: Video Transformer Without Convolutions 0 1 23 Apr 2021 not harvested
Multiscale Vision Transformers 8 3 22 Apr 2021 community repositories only · 13 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 13 unverified (5 pointer-only for licence)
ViViT: A Video Vision Transformer 10 1 29 Mar 2021 official: no sample here; runs from other or unrecorded repositories · 14 ran (of which 10 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (1 pointer-only for licence)
MoViNets: Mobile Video Networks for Efficient Video Recognition 3 4 21 Mar 2021 community repositories only · 9 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified
Learning Self-Similarity in Space and Time as Generalized Motion for Video Action Recognition 1 3 14 Feb 2021 official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (4 pointer-only for licence)
Is Space-Time Attention All You Need for Video Understanding? 16 3 9 Feb 2021 official: no sample here; runs from other or unrecorded repositories · 35 ran (of which 17 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 1 violated, 20 with no contract checked; 14 where Syntology's instrument failed) · 8 unverified (14 pointer-only for licence)
TDN: Temporal Difference Networks for Efficient Action Recognition 1 2 18 Dec 2020 official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
MVFNet: Multi-View Fusion Network for Efficient Video Recognition 3 1 13 Dec 2020 not harvested
Diverse Temporal Aggregation and Depthwise Spatiotemporal Factorization for Efficient Video Classification 1 6 1 Dec 2020 not harvested
Mutual Modality Learning for Video Action Classification 1 2 4 Nov 2020 not harvested
PAN: Towards Fast Action Recognition via Learning Persistence of Appearance 2 1 8 Aug 2020 not harvested
MotionSqueeze: Neural Motion Feature Learning for Video Understanding 2 4 20 Jul 2020 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence)
Temporal Pyramid Network for Action Recognition 3 1 7 Apr 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Knowing What, Where and When to Look: Efficient Video Action Modeling with Attention 0 1 2 Apr 2020 not harvested
Learning Memory-guided Normality for Anomaly Detection 2 1 30 Mar 2020 not harvested
A Multigrid Method for Efficiently Training Video Models 3 1 2 Dec 2019 community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (3 pointer-only for licence)
More Is Less: Learning Efficient Video Representations by Big-Little Network and Depthwise Temporal Aggregation 1 1 2 Dec 2019 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
Comparative Analysis of CNN-based Spatiotemporal Reasoning in Videos 1 1 11 Sep 2019 not harvested
Cooperative Cross-Stream Network for Discriminative Action Representation 0 1 27 Aug 2019 not harvested
Temporal Reasoning Graph for Activity Recognition 0 2 27 Aug 2019 not harvested
STM: SpatioTemporal and Motion Encoding for Action Recognition 0 1 7 Aug 2019 not harvested
Few-Shot Video Classification via Temporal Alignment 0 1 27 Jun 2019 not harvested
Learning Video Representations from Correspondence Proposals 2 1 20 May 2019 not harvested
Attention Distillation for Learning Video Representations 0 1 5 Apr 2019 not harvested
SlowFast Networks for Video Recognition 15 1 10 Dec 2018 community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
TSM: Temporal Shift Module for Efficient Video Understanding 13 1 20 Nov 2018 official: harvested, nothing ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (6 pointer-only for licence)
DenseImage Network: Video Spatial-Temporal Evolution Encoding and Understanding 0 1 19 May 2018 not harvested
Temporal Relational Reasoning in Videos 5 1 22 Nov 2017 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence)
The "something something" video database for learning and evaluating visual common sense 5 1 13 Jun 2017 not harvested

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Custom

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Something-Something V2

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections