{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/opponent-modelling-with-local-information","title":"Agent Modelling under Partial Observability for Deep Reinforcement Learning","arxiv_id":"2006.09447","date":"2020-06-16","proceeding":"NeurIPS 2021 12","authors":["Georgios Papoudakis","Filippos Christianos","Stefano V. Albrecht"],"abstract":"Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the modelled agents during execution. To eliminate this assumption, we extract representations from the local information of the controlled agent using encoder-decoder architectures. Using the observations and actions of the modelled agents during training, our models learn to extract representations about the modelled agents conditioned only on the local observations of the controlled agent. The representations are used to augment the controlled agent's decision policy which is trained via deep reinforcement learning; thus, during execution, the policy does not require access to other agents' information. We provide a comprehensive evaluation and ablations studies in cooperative, competitive and mixed multi-agent environments, showing that our method achieves higher returns than baseline methods which do not use the learned representations.","url_abs":"https://arxiv.org/abs/2006.09447v4","url_pdf":"https://arxiv.org/pdf/2006.09447v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"opponent-modelling-with-local-information","repo_url":"https://github.com/uoe-agents/LIAM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.09447","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.09447"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/uoe-agents/LIAM","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran":1,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9de355e93051e4ad","entry":"init","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/utils.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9de355e93051e4ad"}},{"code_sha256_prefix":"046b92243aae4f76","entry":"onehot_from_logits","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/misc.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/misc.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"046b92243aae4f76"}},{"code_sha256_prefix":"43c7e814609746ee","entry":"sample_gumbel","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/misc.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/misc.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43c7e814609746ee"}},{"code_sha256_prefix":"108dc9c41448855e","entry":"get_render_func","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/utils.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"108dc9c41448855e"}},{"code_sha256_prefix":"3d973efdd0cf8e2b","entry":"gumbel_softmax_sample","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/misc.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/misc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d973efdd0cf8e2b"}},{"code_sha256_prefix":"18e0a66e6b370f75","entry":"speaker_output","repo":"uoe-agents/LIAM","repo_kind":"official","path":"double_speaker_listener/speaker_output.py","file_url":"https://github.com/uoe-agents/LIAM/blob/HEAD/double_speaker_listener/speaker_output.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"18e0a66e6b370f75"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}