Browse State-of-the-Art › Action Recognition In Videos
Action Recognition In Videos
71 papers with code · 17 benchmarks · 17 datasets archive 2025-07-28
Action Recognition in Videos is a task in computer vision and pattern recognition where the goal is to identify and categorize human actions performed in a video sequence. The task involves analyzing the spatiotemporal dynamics of the actions and mapping them to a predefined set of action classes, such as running, jumping, or swimming.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
17 leaderboard tables shown for this task, 17 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 17 until expanded.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): PKU-MMD (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
17 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 124 · with a code link: 71 · where Syntology ran a sample: 23 (22 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (23 of 124 tagged: 22 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 124, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
2 Dec 2014 29 repositories listedWe propose a simple, yet effective approach for spatiotemporal feature learning using deep 3-dimensional convolutional networks (3D ConvNets) trained on a large scale supervised video dataset.
-
2 Aug 2016 22 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified (of 24 harvested samples) · 3 pointer-only (licence)The other contribution is our study on a series of good practices in learning ConvNets on video data with the help of temporal segment network.
-
10 Dec 2018 15 repositories listed Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 1 pointer-only (licence)We present SlowFast networks for video recognition.
-
8 May 2017 11 repositories listedFurthermore, based on the temporal segment networks, we won the video classification track at the ActivityNet challenge 2016 among 24 teams, which demonstrates the effectiveness of TSN and the proposed good practices.
-
27 Sep 2016 7 repositories listed Syntology 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)Despite the size of the dataset, some of our models train to convergence in less than a day on a single machine using TensorFlow.
-
9 Jun 2014 7 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)Our architecture is trained and evaluated on the standard video actions benchmarks of UCF-101 and HMDB-51, where it is competitive with the state of the art.
-
3 Dec 2012 7 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)To the best of our knowledge, UCF101 is currently the most challenging dataset of actions due to its large number of classes, large number of clips and also unconstrained nature of such clips.
-
22 Apr 2021 5 repositories listed Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)We train VATT end-to-end from scratch using multimodal contrastive losses and evaluate its performance by the downstream tasks of video action recognition, audio event classification, image classification, and…
-
15 Nov 2019 5 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 2 pointer-only (licence)YOWO is a single-stage architecture with two branches to extract temporal and spatial information concurrently and predict bounding boxes and action probabilities directly from video clips in one evaluation.
-
2 Oct 2018 5 repositories listedOur representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel within a convolutional neural network for action recognition.
-
22 Nov 2017 5 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)Temporal relational reasoning, the ability to link meaningful transformations of objects or entities over time, is a fundamental property of intelligent species.
-
8 Jul 2015 5 repositories listedHowever, for action recognition in videos, the improvement of deep convolutional networks is not so evident.
-
1 Jun 2023 4 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Modern hierarchical vision transformers have added several vision-specific components in the pursuit of supervised classification performance.
-
11 Apr 2024 3 repositories listedThese spatial features then undergo intermediate temporal modeling facilitated by the Mamba block before progressing to the encoder section, which comprises vanilla upsampling Shift S-GCN blocks.
-
25 Nov 2019 3 repositories listedWe propose a new STAckable Recurrent cell (STAR) for recurrent neural networks (RNNs), which has fewer parameters than widely used LSTM and GRU while being more robust against vanishing or exploding gradients.
-
29 May 2019 3 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples)Consider end-to-end training of a multi-modal vs. a single-modal network on a task with multiple input modalities: the multi-modal network receives more information, so it should match or outperform its single-modal…
-
22 Mar 2017 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)We address the problem of activity detection in continuous, untrimmed video streams.
-
17 Feb 2023 2 repositories listedTo extend our approach to video, we integrate ConvNets with state-of-the-art temporal methods such as Transformer and Recurrent Neural Networks.
-
22 Nov 2021 2 repositories listedComputer vision foundation models, which are trained on diverse, large-scale dataset and can be adapted to a wide range of downstream tasks, are critical for this mission to solve real-world computer vision applications.
-
17 Sep 2021 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 4 pointer-only (licence)Moreover, to handle the deficiency of label texts and make use of tremendous web data, we propose a new paradigm based on this multimodal learning framework for action recognition, which we dub "pre-train, prompt and…
-
29 Mar 2021 2 repositories listedWe design a trainable Motion Band-Pass Module (MBPM) for separating busy information from quiet information in raw video data.
-
6 Aug 2020 2 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)With the proposed Inter-Intra Contrastive (IIC) framework, we can train spatio-temporal convolutional networks to learn video representations.
-
13 Jul 2020 2 repositories listedMost current action recognition methods heavily rely on appearance information by taking an RGB sequence of entire image regions as input.
-
20 May 2019 2 repositories listedIn particular, it can effectively learn representations for videos by mixing appearance and long-range motion with an RGB-only input.
-
4 Apr 2019 2 repositories listedRecently, convolutional neural networks with 3D kernels (3D CNNs) have been very popular in computer vision community as a result of their superior ability of extracting spatio-temporal features within video frames…
-
26 Feb 2018 2 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 20 unverified (of 25 harvested samples)Action recognition and human pose estimation are closely related but both problems are generally handled as distinct tasks in the literature.
-
22 Apr 2016 2 repositories listedRecent applications of Convolutional Neural Networks (ConvNets) for human action recognition in videos have proposed different solutions for incorporating the appearance and motion information.
-
12 Nov 2015 2 repositories listedWe propose a soft attention based model for the task of action recognition in videos.
-
19 Mar 2025 1 repository listedIn this paper, we propose BHaRNet (Body-Hand action Recognition Network), a novel framework that augments a typical body-expert model with a hand-expert model.
-
10 Aug 2024 1 repository listedIn this work, we present an efficient pose-driven attention-guided multimodal network (EPAM-Net) for action recognition in videos.
-
9 Apr 2024 1 repository listed
-
10 Jan 2024 1 repository listed
-
28 Dec 2023 1 repository listed
-
10 Dec 2023 1 repository listed
-
30 Nov 2023 1 repository listed Syntology 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
20 Jul 2023 1 repository listed
-
29 Mar 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 6 harvested samples)
-
17 Mar 2023 1 repository listed
-
6 Dec 2022 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
21 Sep 2022 1 repository listed
-
26 May 2022 1 repository listed
-
19 Mar 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
7 Feb 2022 1 repository listed
-
2 Dec 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
25 Oct 2021 1 repository listed
-
18 Jun 2021 1 repository listed
-
10 Jun 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
18 May 2021 1 repository listed
-
11 May 2021 1 repository listed
-
1 Feb 2021 1 repository listed
-
28 Dec 2020 1 repository listed
-
18 Dec 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
15 Dec 2020 1 repository listed
-
8 Nov 2020 1 repository listed
-
16 Oct 2020 1 repository listed
-
17 Aug 2020 1 repository listed
-
17 Jul 2020 1 repository listed
-
29 Jun 2020 1 repository listed
-
28 Jun 2020 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
15 Jun 2020 1 repository listed
-
3 Apr 2020 1 repository listed
-
1 Jun 2019 1 repository listed
-
18 Apr 2019 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
27 Mar 2019 1 repository listed
-
4 Mar 2019 1 repository listed
-
29 Nov 2017 1 repository listed
-
22 Oct 2017 1 repository listed
-
30 Aug 2017 1 repository listed
-
7 Nov 2016 1 repository listed
-
26 May 2016 1 repository listed
-
The impact of Compositionality in Zero-shot Multi-label action recognition for Object-based tasks14 May 2024 0 repositories listed
-
Deep Learning Approaches for Human Action Recognition in Video Data11 Mar 2024 0 repositories listed
-
Action Class Relation Detection and Classification Across Multiple Video Datasets15 Aug 2023 0 repositories listed
-
Knowledge Prompting for Few-shot Action Recognition22 Nov 2022 0 repositories listed
-
3 Nov 2022 0 repositories listed
-
25 Mar 2022 0 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
14 Dec 2021 0 repositories listed
-
Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing5 Nov 2021 0 repositories listed
-
Class incremental learning for video action classification19 Sep 2021 0 repositories listed
-
NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition17 Mar 2021 0 repositories listed
-
Temporal Difference Networks for Action Recognition1 Jan 2021 0 repositories listed
-
Developing Motion Code Embedding for Action Recognition in Videos10 Dec 2020 0 repositories listed
-
Toward Accurate Person-level Action Recognition in Videos of Crowded Scenes16 Oct 2020 0 repositories listed
-
1 Aug 2020 0 repositories listed
-
28 Jun 2020 0 repositories listed
-
Spatiotemporal Fusion in 3D CNNs: A Probabilistic View10 Apr 2020 0 repositories listed
-
Dynamic Inference: A New Approach Toward Efficient Video Action Recognition9 Feb 2020 0 repositories listed
-
An Information-rich Sampling Technique over Spatio-Temporal CNN for Classification of Human Actions in Videos6 Feb 2020 0 repositories listed
-
Skeleton based Activity Recognition by Fusing Part-wise Spatio-temporal and Attention Driven Residues2 Dec 2019 0 repositories listed
-
Deep Image-to-Video Adaptation and Fusion Networks for Action Recognition25 Nov 2019 0 repositories listed
-
Zero-Shot Action Recognition in Videos: A Survey13 Sep 2019 0 repositories listed
-
Discriminative Video Representation Learning Using Support Vector Classifiers5 Sep 2019 0 repositories listed
-
7 Aug 2019 0 repositories listed
-
Where and when to look? Spatial-temporal attention for action recognition in videos1 May 2019 0 repositories listed
-
Learning Transferable Self-attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision20 Feb 2019 0 repositories listed
-
11 Jan 2019 0 repositories listed
-
Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks26 Dec 2018 0 repositories listed
-
Coupled Recurrent Network (CRN)25 Dec 2018 0 repositories listed
-
26 Nov 2018 0 repositories listed
Syntology lines on 25 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections