{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/actionness-inconsistency-guided-contrastive","title":"Actionness Inconsistency-guided Contrastive Learning for Weakly-supervised Temporal Action Localization","arxiv_id":null,"date":"2023-06-26","proceeding":"AAAI 2023 6","authors":["Zhilin Li","Zilei Wang","Qinying Liu"],"abstract":"Weakly-supervised temporal action localization (WTAL) aims to detect action instances given only video-level labels. To address the challenge, recent methods commonly employ a two-branch framework, consisting of a class-aware branch and a class-agnostic branch. In principle, the two branches are supposed to produce the same actionness activation. However, we observe that there are actually many inconsistent activation regions. These inconsistent regions usually contain some challenging segments whose semantic information (action or background) is ambiguous. In this work, we propose a novel Actionness Inconsistency-guided Contrastive Learning (AICL) method which utilizes the consistent segments to boost the representation learning of the inconsistent segments. Specifically, we first define the consistent and inconsistent segments by comparing the predictions of two branches and then construct positive and negative pairs between consistent segments and inconsistent segments for contrastive learning. In addition, to avoid the trivial case where there is no consistent sample, we introduce an action consistency constraint to control the difference between the two branches. We conduct extensive experiments on THUMOS14, ActivityNet v1.2, and ActivityNet v1.3 datasets, and the results show the effectiveness of AICL with state-of-the-art performance. Our code is available at https://github.com/lizhilin-ustc/AAAI2023-AICL.","url_abs":"https://ojs.aaai.org/index.php/AAAI/article/view/25237","url_pdf":"https://ojs.aaai.org/index.php/AAAI/article/view/25237","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"actionness-inconsistency-guided-contrastive","repo_url":"https://github.com/lizhilin-ustc/AAAI2023-AICL","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"action-localization","task_name":"Action Localization"},{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"},{"task_slug":"weakly-supervised-action-localization","task_name":"Weakly Supervised Action Localization"},{"task_slug":"weakly-supervised-temporal-action","task_name":"Weakly-supervised Temporal Action Localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/weakly-supervised-action-localization-on-2","task":"Weakly Supervised Action Localization","dataset":"ActivityNet-1.2","model":"AICL","rank_in_archive_order":2,"of":19,"metrics":{"Mean mAP":"29.9","mAP@0.5":"49.6"},"uses_additional_data":false},{"leaderboard":"/sota/weakly-supervised-action-localization-on-1","task":"Weakly Supervised Action Localization","dataset":"ActivityNet-1.3","model":"AICL","rank_in_archive_order":3,"of":17,"metrics":{"mAP@0.5":"44.2","mAP@0.5:0.95":"27.6"},"uses_additional_data":false},{"leaderboard":"/sota/weakly-supervised-action-localization-on","task":"Weakly Supervised Action Localization","dataset":"THUMOS 2014","model":"AICL","rank_in_archive_order":8,"of":30,"metrics":{"mAP@0.1:0.5":"56.9","mAP@0.1:0.7":"46.4","mAP@0.5":"36.9"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}