Papers › Weakly-supervised Temporal Action Localization by Uncertainty Modeling

Weakly-supervised Temporal Action Localization by Uncertainty Modeling

12 Jun 2020arXiv:2006.07006archive 2025-07-28

Pilhyeon Lee, Jinglu Wang, Yan Lu, Hyeran Byun

Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e., frames not belonging to any action classes). In this paper, we present a new perspective on background frames where they are modeled as out-of-distribution samples regarding their inconsistency. Then, background frames can be detected by estimating the probability of each frame being out-of-distribution, known as uncertainty, but it is infeasible to directly learn uncertainty without frame-level labels. To realize the uncertainty learning in the weakly-supervised setting, we leverage the multiple instance learning formulation. Moreover, we further introduce a background entropy loss to better discriminate background frames by encouraging their in-distribution (action) probabilities to be uniformly distributed over all action classes. Experimental results show that our uncertainty modeling is effective at alleviating the interference of background frames and brings a large performance gain without bells and whistles. We demonstrate that our model significantly outperforms state-of-the-art methods on the benchmarks, THUMOS'14 and ActivityNet (1.2 & 1.3). Our code is available at https://github.com/Pilhyeon/WTAL-Uncertainty-Modeling.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Pilhyeon/WTAL-Uncertainty-Modeling officialmentioned in papermentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AAAI id aaai_16280 (that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
Pilhyeon/Learning-Action-Completeness-from-Points mentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action ClassificationAction LocalizationMultiple Instance LearningOut-of-Distribution DetectionTemporal Action LocalizationWeakly Supervised Action LocalizationWeakly-supervised Temporal Action Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Weakly Supervised Action Localization ActivityNet-1.2 Lee et al. Mean mAP 25.9 #9 of 19 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.2 Lee et al. mAP@0.5 41.2 #9 of 19 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.3 Lee et al. mAP@0.5 37 #11 of 17 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.3 Lee et al. mAP@0.5:0.95 23.7 #11 of 17 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 Lee et al. mAP@0.1:0.5 51.6 #14 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 Lee et al. mAP@0.1:0.7 41.9 #14 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 Lee et al. mAP@0.5 33.7 #14 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 Lee et al. avg-mAP (0.1-0.5) 51.6 #6 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 Lee et al. avg-mAP (0.1:0.7) 41.9 #6 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 Lee et al. avg-mAP (0.3-0.7) 32.9 #6 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS’14 Lee et al. mAP@0.5 33.7 #7 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections