Papers › Graph Convolutional Networks for Temporal Action Localization

Graph Convolutional Networks for Temporal Action Localization

7 Sep 2019ICCV 2019 10arXiv:1909.03252archive 2025-07-28

Runhao Zeng, Wenbing Huang, Mingkui Tan, Yu Rong, Peilin Zhao, Junzhou Huang, Chuang Gan

Most state-of-the-art action localization systems process each action proposal individually, without explicitly exploiting their relations during learning. However, the relations between proposals actually play an important role in action localization, since a meaningful action always consists of multiple proposals in a video. In this paper, we propose to exploit the proposal-proposal relations using Graph Convolutional Networks (GCNs). First, we construct an action proposal graph, where each proposal is represented as a node and their relations between two proposals as an edge. Here, we use two types of relations, one for capturing the context information for each proposal and the other one for characterizing the correlations between distinct actions. Then we apply the GCNs over the graph to model the relations among different proposals and learn powerful representations for the action classification and localization. Experimental results show that our approach significantly outperforms the state-of-the-art on THUMOS14 (49.1% versus 42.8%). Moreover, augmentation experiments on ActivityNet also verify the efficacy of modeling action proposal relationships. Codes are available at https://github.com/Alvin-Zeng/PGCN.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Alvin-Zeng/PGCN officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action ClassificationAction LocalizationTemporal Action Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Temporal Action Localization ActivityNet-1.3 P-GCN mAP 31.11 #31 of 33 Archive leaderboard report
Temporal Action Localization ActivityNet-1.3 P-GCN mAP IOU@0.5 48.26 #31 of 33 Archive leaderboard report
Temporal Action Localization ActivityNet-1.3 P-GCN mAP IOU@0.75 33.16 #31 of 33 Archive leaderboard report
Temporal Action Localization ActivityNet-1.3 P-GCN mAP IOU@0.95 3.27 #31 of 33 Archive leaderboard report
Temporal Action Localization THUMOS’14 P-GCN mAP IOU@0.1 69.5 #32 of 42 Archive leaderboard report
Temporal Action Localization THUMOS’14 P-GCN mAP IOU@0.2 67.8 #32 of 42 Archive leaderboard report
Temporal Action Localization THUMOS’14 P-GCN mAP IOU@0.3 63.6 #32 of 42 Archive leaderboard report
Temporal Action Localization THUMOS’14 P-GCN mAP IOU@0.4 57.8 #32 of 42 Archive leaderboard report
Temporal Action Localization THUMOS’14 P-GCN mAP IOU@0.5 49.1 #32 of 42 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Graph Convolutional Networks

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections