{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/guided-attention-for-next-active-object-ego4d","title":"Guided Attention for Next Active Object @ EGO4D STA Challenge","arxiv_id":"2305.16066","date":"2023-05-25","proceeding":null,"authors":["Sanket Thakur","Cigdem Beyan","Pietro Morerio","Vittorio Murino","Alessio Del Bue"],"abstract":"In this technical report, we describe the Guided-Attention mechanism based solution for the short-term anticipation (STA) challenge for the EGO4D challenge. It combines the object detections, and the spatiotemporal features extracted from video clips, enhancing the motion and contextual information, and further decoding the object-centric and motion-centric information to address the problem of STA in egocentric videos. For the challenge, we build our model on top of StillFast with Guided Attention applied on fast network. Our model obtains better performance on the validation set and also achieves state-of-the-art (SOTA) results on the challenge test set for EGO4D Short-Term Object Interaction Anticipation Challenge.","url_abs":"https://arxiv.org/abs/2305.16066v3","url_pdf":"https://arxiv.org/pdf/2305.16066v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"guided-attention-for-next-active-object-ego4d","repo_url":"https://github.com/sanketsans/ganov2","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"object","task_name":"Object"},{"task_slug":"short-term-object-interaction-anticipation","task_name":"Short-term Object Interaction Anticipation"}],"methods":[{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/short-term-object-interaction-anticipation-on","task":"Short-term Object Interaction Anticipation","dataset":"Ego4D","model":"GANOv2","rank_in_archive_order":3,"of":4,"metrics":{"Noun (Top5 mAP)":"20.52","Noun+TTC (Top5 mAP)":"7.28","Noun+Verb(Top5 mAP)":"10.42","Overall (Top5 mAP)":"3.99"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2305.16066","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}