{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/goal-aware-cross-entropy-for-multi-target","title":"Goal-Aware Cross-Entropy for Multi-Target Reinforcement Learning","arxiv_id":"2110.12985","date":"2021-10-25","proceeding":"NeurIPS 2021 12","authors":["Kibeom Kim","Min Whoo Lee","Yoonsung Kim","Je-Hwan Ryu","Minsu Lee","Byoung-Tak Zhang"],"abstract":"Learning in a multi-target environment without prior knowledge about the targets requires a large amount of samples and makes generalization difficult. To solve this problem, it is important to be able to discriminate targets through semantic understanding. In this paper, we propose goal-aware cross-entropy (GACE) loss, that can be utilized in a self-supervised way using auto-labeled goal states alongside reinforcement learning. Based on the loss, we then devise goal-discriminative attention networks (GDAN) which utilize the goal-relevant information to focus on the given instruction. We evaluate the proposed methods on visual navigation and robot arm manipulation tasks with multi-target environments and show that GDAN outperforms the state-of-the-art methods in terms of task success ratio, sample efficiency, and generalization. Additionally, qualitative analyses demonstrate that our proposed method can help the agent become aware of and focus on the given instruction clearly, promoting goal-directed behavior.","url_abs":"https://arxiv.org/abs/2110.12985v2","url_pdf":"https://arxiv.org/pdf/2110.12985v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"goal-aware-cross-entropy-for-multi-target","repo_url":"https://github.com/kibeomkim/gace-gdan","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[{"method_slug":"aware","method_name":"AWARE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2110.12985","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.12985"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kibeomkim/gace-gdan","reach":null}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b25b0b4bdba58c8f","entry":"Actor_Critic","repo":"kibeomkim/gace-gdan","repo_kind":"official","path":"GACE_GDAN/models.py","file_url":"https://github.com/kibeomkim/gace-gdan/blob/HEAD/GACE_GDAN/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b25b0b4bdba58c8f"}},{"code_sha256_prefix":"486178b159d9a858","entry":"Feature_Extractor","repo":"kibeomkim/gace-gdan","repo_kind":"official","path":"GACE_GDAN/models.py","file_url":"https://github.com/kibeomkim/gace-gdan/blob/HEAD/GACE_GDAN/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"486178b159d9a858"}},{"code_sha256_prefix":"2eb8379568cea70d","entry":"GDAN","repo":"kibeomkim/gace-gdan","repo_kind":"official","path":"GACE_GDAN/models.py","file_url":"https://github.com/kibeomkim/gace-gdan/blob/HEAD/GACE_GDAN/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2eb8379568cea70d"}},{"code_sha256_prefix":"e3410ab0605200d8","entry":"Goal_discriminator","repo":"kibeomkim/gace-gdan","repo_kind":"official","path":"GACE_GDAN/models.py","file_url":"https://github.com/kibeomkim/gace-gdan/blob/HEAD/GACE_GDAN/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3410ab0605200d8"}},{"code_sha256_prefix":"5f451cdfc6e5e92b","entry":"postprocess","repo":"kibeomKim/GACE-GDAN","repo_kind":"official","path":"GACE_GDAN/agent.py","file_url":"https://github.com/kibeomKim/GACE-GDAN/blob/HEAD/GACE_GDAN/agent.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f451cdfc6e5e92b"}},{"code_sha256_prefix":"c579940fb7d7687f","entry":"preprocess","repo":"kibeomKim/GACE-GDAN","repo_kind":"official","path":"GACE_GDAN/agent.py","file_url":"https://github.com/kibeomKim/GACE-GDAN/blob/HEAD/GACE_GDAN/agent.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c579940fb7d7687f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}