Papers › Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action Localization

Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action Localization

29 May 2023CVPR 2023 1arXiv:2305.17861archive 2025-07-28

Huan Ren, Wenfei Yang, Tianzhu Zhang, Yongdong Zhang

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the Segment-based Multiple Instance Learning (S-MIL) framework, where the predictions of segments are supervised by the labels of videos. However, the objective for acquiring segment-level scores during training is not consistent with the target for acquiring proposal-level scores during testing, leading to suboptimal results. To deal with this problem, we propose a novel Proposal-based Multiple Instance Learning (P-MIL) framework that directly classifies the candidate proposals in both the training and testing stages, which includes three key designs: 1) a surrounding contrastive feature extraction module to suppress the discriminative short proposals by considering the surrounding contrastive information, 2) a proposal completeness evaluation module to inhibit the low-quality proposals with the guidance of the completeness pseudo labels, and 3) an instance-level rank consistency loss to achieve robust detection by leveraging the complementarity of RGB and FLOW modalities. Extensive experimental results on two challenging benchmarks including THUMOS14 and ActivityNet demonstrate the superior performance of our method.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

RenHuan1999/CVPR2023_P-MIL officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action LocalizationMultiple Instance LearningTemporal Action LocalizationWeakly Supervised Action LocalizationWeakly-supervised Temporal Action Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Weakly Supervised Action Localization ActivityNet-1.2 P-MIL Mean mAP 26.5 #6 of 19 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.2 P-MIL mAP@0.5 44.2 #6 of 19 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.3 P-MIL mAP@0.5 41.8 #8 of 17 Archive leaderboard report
Weakly Supervised Action Localization ActivityNet-1.3 P-MIL mAP@0.5:0.95 25.5 #8 of 17 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 P-MIL mAP@0.1:0.5 57.4 #7 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 P-MIL mAP@0.1:0.7 47.0 #7 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS 2014 P-MIL mAP@0.5 40.0 #7 of 30 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 P-MIL avg-mAP (0.1-0.5) 57.4 #3 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 P-MIL avg-mAP (0.1:0.7) 47.0 #3 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS14 P-MIL avg-mAP (0.3-0.7) 38.0 #3 of 12 Archive leaderboard report
Weakly Supervised Action Localization THUMOS’14 P-MIL mAP@0.5 40.0 #3 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections