{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/pecan-leveraging-policy-ensemble-for-context","title":"PECAN: Leveraging Policy Ensemble for Context-Aware Zero-Shot Human-AI Coordination","arxiv_id":"2301.06387","date":"2023-01-16","proceeding":null,"authors":["Xingzhou Lou","Jiaxian Guo","Junge Zhang","Jun Wang","Kaiqi Huang","Yali Du"],"abstract":"Zero-shot human-AI coordination holds the promise of collaborating with humans without human data. Prevailing methods try to train the ego agent with a population of partners via self-play. However, these methods suffer from two problems: 1) The diversity of a population with finite partners is limited, thereby limiting the capacity of the trained ego agent to collaborate with a novel human; 2) Current methods only provide a common best response for every partner in the population, which may result in poor zero-shot coordination performance with a novel partner or humans. To address these issues, we first propose the policy ensemble method to increase the diversity of partners in the population, and then develop a context-aware method enabling the ego agent to analyze and identify the partner's potential policy primitives so that it can take different actions accordingly. In this way, the ego agent is able to learn more universal cooperative behaviors for collaborating with diverse partners. We conduct experiments on the Overcooked environment, and evaluate the zero-shot human-AI coordination performance of our method with both behavior-cloned human proxies and real humans. The results demonstrate that our method significantly increases the diversity of partners and enables ego agents to learn more diverse behaviors than baselines, thus achieving state-of-the-art performance in all scenarios. We also open-source a human-AI coordination study framework on the Overcooked for the convenience of future studies.","url_abs":"https://arxiv.org/abs/2301.06387v4","url_pdf":"https://arxiv.org/pdf/2301.06387v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"pecan-leveraging-policy-ensemble-for-context","repo_url":"https://github.com/LxzGordon/pecan_human_AI_coordination","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2301.06387","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.06387"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/LxzGordon/pecan_human_AI_coordination","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":6},"by_repo_kind":{"official":{"samples":7,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a44574392d168384","entry":"register","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/baselines/baselines/common/models.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/baselines/baselines/common/models.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a44574392d168384"}},{"code_sha256_prefix":"9ed8cfc43ed32bfd","entry":"cross_entropy","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/human_aware_rl/utils.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/human_aware_rl/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ed8cfc43ed32bfd"}},{"code_sha256_prefix":"3a08670f59f30530","entry":"get_max_iter","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/human_aware_rl/utils.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/human_aware_rl/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a08670f59f30530"}},{"code_sha256_prefix":"206b32402a1b9e7a","entry":"get_trailing_number","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/human_aware_rl/utils.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/human_aware_rl/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"206b32402a1b9e7a"}},{"code_sha256_prefix":"817d5caf0e3d3706","entry":"make_output_format","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/baselines/baselines/logger.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/baselines/baselines/logger.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"817d5caf0e3d3706"}},{"code_sha256_prefix":"8455885a0d199802","entry":"profile","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/baselines/baselines/logger.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/baselines/baselines/logger.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8455885a0d199802"}},{"code_sha256_prefix":"88ef5a17fc986d9a","entry":"read_json","repo":"LxzGordon/pecan_human_AI_coordination","repo_kind":"official","path":"overcookedgym/human_aware_rl/baselines/baselines/logger.py","file_url":"https://github.com/LxzGordon/pecan_human_AI_coordination/blob/HEAD/overcookedgym/human_aware_rl/baselines/baselines/logger.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88ef5a17fc986d9a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}