{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/llm-based-agent-society-investigation","title":"LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay","arxiv_id":"2310.14985","date":"2023-10-23","proceeding":null,"authors":["Yihuai Lan","Zhiqiang Hu","Lei Wang","Yang Wang","Deheng Ye","Peilin Zhao","Ee-Peng Lim","Hui Xiong","Hao Wang"],"abstract":"This paper explores the open research problem of understanding the social behaviors of LLM-based agents. Using Avalon as a testbed, we employ system prompts to guide LLM agents in gameplay. While previous studies have touched on gameplay with LLM agents, research on their social behaviors is lacking. We propose a novel framework, tailored for Avalon, features a multi-agent system facilitating efficient communication and interaction. We evaluate its performance based on game success and analyze LLM agents' social behaviors. Results affirm the framework's effectiveness in creating adaptive agents and suggest LLM-based agents' potential in navigating dynamic social interactions. By examining collaboration and confrontation behaviors, we offer insights into this field's research and applications. Our code is publicly available at https://github.com/3DAgentWorld/LLM-Game-Agent.","url_abs":"https://arxiv.org/abs/2310.14985v4","url_pdf":"https://arxiv.org/pdf/2310.14985v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"llm-based-agent-society-investigation","repo_url":"https://github.com/3DAgentWorld/LLM-Game-Agent","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2310.14985","atlas_url":"https://app.syntology.ai/?focus=2310.14985","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.14985"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/3DAgentWorld/LLM-Game-Agent","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"f1cce130a89079a8","entry":"im","repo":"3DAgentWorld/LLM-Game-Agent","repo_kind":"official","path":"evaluation/Identify_merlin.py","file_url":"https://github.com/3DAgentWorld/LLM-Game-Agent/blob/HEAD/evaluation/Identify_merlin.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f1cce130a89079a8"}},{"code_sha256_prefix":"9ca898eecc6043ff","entry":"read_json","repo":"3DAgentWorld/LLM-Game-Agent","repo_kind":"official","path":"evaluation/Identify_merlin.py","file_url":"https://github.com/3DAgentWorld/LLM-Game-Agent/blob/HEAD/evaluation/Identify_merlin.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9ca898eecc6043ff"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}