Papers › PivoTAL: Prior-Driven Supervision for Weakly-Supervised Temporal Action Localization
PivoTAL: Prior-Driven Supervision for Weakly-Supervised Temporal Action Localization
Mamshad Nayeem Rizve, Gaurav Mittal, Ye Yu, Matthew Hall, Sandra Sajeev, Mubarak Shah, Mei Chen
Weakly-supervised Temporal Action Localization (WTAL) attempts to localize the actions in untrimmed videos using only video-level supervision. Most recent works approach WTAL from a localization-by-classification perspective where these methods try to classify each video frame followed by a manually-designed post-processing pipeline to aggregate these per-frame action predictions into action snippets. Due to this perspective, the model lacks any explicit understanding of action boundaries and tends to focus only on the most discriminative parts of the video resulting in incomplete action localization. To address this, we present PivoTAL, Prior-driven Supervision for Weakly-supervised Temporal Action Localization, to approach WTAL from a localization-by-localization perspective by learning to localize the action snippets directly. To this end, PivoTAL leverages the underlying spatio-temporal regularities in videos in the form of action-specific scene prior, action snippet generation prior, and learnable Gaussian prior to supervise the localization-based training. PivoTAL shows significant improvement (of at least 3% avg mAP) over all existing methods on the benchmark datasets, THUMOS-14 and ActivitNet-v1.3.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Weakly Supervised Action Localization | ActivityNet-1.3 | PivoTAL | mAP@0.5 | 45.1 | #2 of 17 | Archive leaderboard | report |
| Weakly Supervised Action Localization | ActivityNet-1.3 | PivoTAL | mAP@0.5:0.95 | 28.1 | #2 of 17 | Archive leaderboard | report |
| Weakly Supervised Action Localization | THUMOS 2014 | PivoTAL | mAP@0.1:0.5 | 60.1 | #4 of 30 | Archive leaderboard | report |
| Weakly Supervised Action Localization | THUMOS 2014 | PivoTAL | mAP@0.1:0.7 | 49.6 | #4 of 30 | Archive leaderboard | report |
| Weakly Supervised Action Localization | THUMOS 2014 | PivoTAL | mAP@0.5 | 42.8 | #4 of 30 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections