Browse State-of-the-Art › Temporal Action Localization
Temporal Action Localization
493 papers with code · 14 benchmarks · 42 datasets archive 2025-07-28
Temporal Action Localization aims to detect activities in the video stream and output beginning and end timestamps. It is closely related to Temporal Action Proposal Generation.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
14 leaderboard tables shown for this task, 14 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 14 until expanded.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
42 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 42 until expanded.
Subtasks archive 2025-07-28
8 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 1,477 · with a code link: 493 · where Syntology ran a sample: 87 (66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (87 of 1,477 tagged: 66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument)
Page 1 of 15: papers 1 to 100 of 1,477, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Jan 2018 24 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Dynamics of human body skeletons convey significant information for human action recognition.
-
30 Nov 2017 24 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition.
-
30 Oct 2017 24 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems.
-
2 Aug 2016 22 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified (of 24 harvested samples) · 3 pointer-only (licence)The other contribution is our study on a series of good practices in learning ConvNets on video data with the help of temporal segment network.
-
8 Jun 2018 17 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)Temporal action proposal generation is an important yet challenging problem, since temporal proposals with rich action content are indispensable for analysing real-world videos with long duration and high proportion…
-
23 Jul 2019 15 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 2 pointer-only (licence)To address these difficulties, we introduce the Boundary-Matching (BM) mechanism to evaluate confidence scores of densely distributed proposals, which denote a proposal as a matching pair of starting and ending…
-
16 Feb 2015 12 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets.
-
8 May 2017 11 repositories listedFurthermore, based on the temporal segment networks, we won the video classification track at the ActivityNet challenge 2016 among 24 teams, which demonstrates the effectiveness of TSN and the proposed good practices.
-
30 Nov 2018 9 repositories listed Syntology official (archive's flag): 1 ran · 15 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples) · 7 pointer-only (licence)In this work, we propose a new approach for reasoning globally in which a set of features are globally aggregated over the coordinate space and then projected to an interaction space where relational reasoning can be…
-
23 May 2017 9 repositories listedThe AVA dataset densely annotates 80 atomic visual actions in 430 15-minute video clips, where actions are localized in space and time, resulting in 1.
-
5 Nov 2018 8 repositories listedIn this paper, in contrast to the existing CNN+RNN or pure 3D convolution based approaches, we explore a novel spatial temporal network (StNet) architecture for both local and global spatial-temporal modeling in videos.
-
26 Nov 2019 7 repositories listed Syntology official (archive's flag): 11 ran · 15 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 2 pointer-only (licence)In this work, we propose a graph convolutional network (GCN) model to adaptively incorporate multi-level semantic context into video features and cast temporal action detection as a sub-graph localization problem.
-
14 Jan 2018 7 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Over the past decade, multivariate time series classification has received great attention.
-
9 Jun 2014 7 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)Our architecture is trained and evaluated on the standard video actions benchmarks of UCF-101 and HMDB-51, where it is competitive with the state of the art.
-
3 Dec 2012 7 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)To the best of our knowledge, UCF101 is currently the most challenging dataset of actions due to its large number of classes, large number of clips and also unconstrained nature of such clips.
-
14 Nov 2022 6 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)We launch EVA, a vision-centric foundation model to explore the limits of visual representation at scale using only publicly accessible data.
-
17 Apr 2018 6 repositories listed Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 4 pointer-only (licence)Skeleton-based human action recognition has recently drawn increasing attentions with the availability of large-scale skeleton datasets.
-
19 Nov 2015 6 repositories listedWe propose an approach to learn spatio-temporal features in videos from intermediate visual representations we call "percepts" using Gated-Recurrent-Unit Recurrent Networks (GRUs).
-
21 Dec 2021 5 repositories listedWeakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available.
-
22 Apr 2021 5 repositories listed Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)We train VATT end-to-end from scratch using multimodal contrastive losses and evaluate its performance by the downstream tasks of video action recognition, audio event classification, image classification, and…
-
8 Apr 2019 5 repositories listedCan performance on the task of action quality assessment (AQA) be improved by exploiting a description of the action and its quality?
-
2 Oct 2018 5 repositories listedOur representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel within a convolutional neural network for action recognition.
-
23 May 2017 5 repositories listedShot boundary detection (SBD) is an important component of many video analysis tasks, such as action recognition, video indexing, summarization and editing.
-
8 Jul 2015 5 repositories listedHowever, for action recognition in videos, the improvement of deep convolutional networks is not so evident.
-
27 Feb 2015 5 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)In this context, we propose an approach that successfully takes into account both the local and global temporal structure of videos to produce descriptions.
-
1 Jul 2021 4 repositories listedDeep neural networks based purely on attention have been successful across several domains, relying on minimal architectural priors from the designer.
-
20 May 2018 4 repositories listedIn addition, the second-order information (the lengths and directions of bones) of the skeleton data, which is naturally more informative and discriminative for action recognition, is rarely investigated in existing…
-
9 Jan 2018 4 repositories listedWe present the Moments in Time Dataset, a large-scale human-annotated collection of one million short videos corresponding to dynamic events unfolding within three seconds.
-
12 Dec 2017 4 repositories listedSecond, we show the power of hallucinated flow for recognition, successfully transferring the learned motion into a standard two-stream network for activity recognition.
-
30 Mar 2017 4 repositories listedWe demonstrate that using both RNNs (using LSTMs) and Temporal-ConvNets on spatiotemporal feature matrices are able to exploit spatiotemporal dynamics to improve the overall performance.
-
8 Dec 2015 4 repositories listed Syntology 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
11 Sep 2023 3 repositories listed
-
13 Jul 2023 3 repositories listed Syntology official (archive's flag): 17 ran · 23 ran (of which 7 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 7 where Syntology's instrument failed) · 9 unverified (of 32 harvested samples) · 21 pointer-only (licence)
-
21 Mar 2021 3 repositories listed Syntology community repositories only · 9 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples)
-
13 Dec 2020 3 repositories listed
-
1 Sep 2020 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
9 Aug 2020 3 repositories listed
-
16 Jun 2020 3 repositories listed
-
14 Jun 2020 3 repositories listed Syntology official (archive's flag): 12 ran · 17 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified (of 27 harvested samples) · 4 pointer-only (licence)
-
11 Nov 2019 3 repositories listed
-
16 May 2019 3 repositories listed
-
6 Dec 2018 3 repositories listed
-
22 Jul 2018 3 repositories listed
-
7 Mar 2018 3 repositories listed
-
14 Dec 2017 3 repositories listed
-
22 Nov 2017 3 repositories listed
-
2 Apr 2017 3 repositories listed
-
2 Dec 2016 3 repositories listed
-
31 May 2024 2 repositories listed
-
22 May 2024 2 repositories listed
-
15 Apr 2024 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
22 Mar 2024 2 repositories listed
-
6 Feb 2024 2 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
28 Nov 2023 2 repositories listed
-
15 Jul 2023 2 repositories listed
-
18 May 2023 2 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
24 Apr 2023 2 repositories listed
-
30 Mar 2023 2 repositories listed
-
17 Feb 2023 2 repositories listed
-
6 Dec 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
16 Nov 2022 2 repositories listed
-
14 Jul 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
22 Jun 2022 2 repositories listed
-
20 May 2022 2 repositories listed
-
5 May 2022 2 repositories listed
-
16 Mar 2022 2 repositories listed
-
9 Dec 2021 2 repositories listed
-
12 Oct 2021 2 repositories listed Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample)
-
28 Sep 2021 2 repositories listed
-
17 Sep 2021 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
27 Jul 2021 2 repositories listed
-
9 Jun 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
7 Apr 2021 2 repositories listed
-
1 Oct 2020 2 repositories listed
-
18 Aug 2020 2 repositories listed
-
13 Jul 2020 2 repositories listed
-
12 Jun 2020 2 repositories listed
-
13 May 2020 2 repositories listed
-
10 Apr 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
23 Dec 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
15 Dec 2019 2 repositories listed
-
8 Dec 2019 2 repositories listed
-
22 Nov 2019 2 repositories listed
-
20 Aug 2019 2 repositories listed
-
22 May 2019 2 repositories listed
-
2 Apr 2019 2 repositories listed Syntology official (archive's flag): 3 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples)
-
14 Dec 2018 2 repositories listed
-
1 Dec 2018 2 repositories listed
-
29 Nov 2018 2 repositories listed
-
20 Nov 2018 2 repositories listed
-
6 Nov 2018 2 repositories listed
-
20 Apr 2018 2 repositories listed Syntology official (archive's flag): 2 ran · 6 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples) · 9 pointer-only (licence)
-
27 Jul 2017 2 repositories listed
-
4 May 2017 2 repositories listed
-
9 Mar 2017 2 repositories listed
Syntology lines on 38 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections