Papers › Action Sensitivity Learning for Temporal Action Localization
Action Sensitivity Learning for Temporal Action Localization
Jiayi Shao, Xiaohan Wang, Ruijie Quan, Junjun Zheng, Jiang Yang, Yi Yang
Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while overlooking the discrepant importance of each frame. In this paper, we propose an Action Sensitivity Learning framework (ASL) to tackle this task, which aims to assess the value of each frame and then leverage the generated action sensitivity to recalibrate the training procedure. We first introduce a lightweight Action Sensitivity Evaluator to learn the action sensitivity at the class level and instance level, respectively. The outputs of the two branches are combined to reweight the gradient of the two sub-tasks. Moreover, based on the action sensitivity of each frame, we design an Action Sensitive Contrastive Loss to enhance features, where the action-aware frames are sampled as positive pairs to push away the action-irrelevant frames. The extensive studies on various action localization benchmarks (i.e., MultiThumos, Charades, Ego4D-Moment Queries v1.0, Epic-Kitchens 100, Thumos14 and ActivityNet1.3) show that ASL surpasses the state-of-the-art in terms of average-mAP under multiple types of scenarios, e.g., single-labeled, densely-labeled and egocentric.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | Avg mAP (0.3:0.7) | 67.9 | #10 of 42 | Archive leaderboard | report |
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | mAP IOU@0.3 | 83.1 | #10 of 42 | Archive leaderboard | report |
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | mAP IOU@0.4 | 79.0 | #10 of 42 | Archive leaderboard | report |
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | mAP IOU@0.5 | 71.7 | #10 of 42 | Archive leaderboard | report |
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | mAP IOU@0.6 | 59.7 | #10 of 42 | Archive leaderboard | report |
| Temporal Action Localization | THUMOS’14 | ASL(I3D features) | mAP IOU@0.7 | 45.8 | #10 of 42 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections