{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/action-anticipation-with-goal-consistency","title":"Action Anticipation with Goal Consistency","arxiv_id":"2306.15045","date":"2023-06-26","proceeding":null,"authors":["Olga Zatsarynna","Juergen Gall"],"abstract":"In this paper, we address the problem of short-term action anticipation, i.e., we want to predict an upcoming action one second before it happens. We propose to harness high-level intent information to anticipate actions that will take place in the future. To this end, we incorporate an additional goal prediction branch into our model and propose a consistency loss function that encourages the anticipated actions to conform to the high-level goal pursued in the video. In our experiments, we show the effectiveness of the proposed approach and demonstrate that our method achieves state-of-the-art results on two large-scale datasets: Assembly101 and COIN.","url_abs":"https://arxiv.org/abs/2306.15045v1","url_pdf":"https://arxiv.org/pdf/2306.15045v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"action-anticipation-with-goal-consistency","repo_url":"https://github.com/olga-zats/goal_consistency","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"action-anticipation","task_name":"Action Anticipation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-anticipation-on-assembly101","task":"Action Anticipation","dataset":"Assembly101","model":"Goal Consistency","rank_in_archive_order":1,"of":2,"metrics":{"Actions Recall@5":"12.07","Objects Recall@5":"28.38","Verbs Recall@5":"60.04"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.15045","atlas_url":"https://app.syntology.ai/?focus=2306.15045","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}