{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/self-organized-agents-a-llm-multi-agent","title":"Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization","arxiv_id":"2404.02183","date":"2024-04-02","proceeding":null,"authors":["Yoichi Ishibashi","Yoshimasa Nishimura"],"abstract":"Recent advancements in automatic code generation using large language model (LLM) agent have brought us closer to the future of automated software development. However, existing single-agent approaches face limitations in generating and improving large-scale, complex codebases due to constraints in context length. To tackle this challenge, we propose Self-Organized multi-Agent framework (SoA), a novel multi-agent framework that enables the scalable and efficient generation and optimization of large-scale code. In SoA, self-organized agents operate independently to generate and modify code components while seamlessly collaborating to construct the overall codebase. A key feature of our framework is the automatic multiplication of agents based on problem complexity, allowing for dynamic scalability. This enables the overall code volume to be increased indefinitely according to the number of agents, while the amount of code managed by each agent remains constant. We evaluate SoA on the HumanEval benchmark and demonstrate that, compared to a single-agent system, each agent in SoA handles significantly less code, yet the overall generated code is substantially greater. Moreover, SoA surpasses the powerful single-agent baseline by 5% in terms of Pass@1 accuracy.","url_abs":"https://arxiv.org/abs/2404.02183v1","url_pdf":"https://arxiv.org/pdf/2404.02183v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"self-organized-agents-a-llm-multi-agent","repo_url":"https://github.com/tsukushiai/self-organized-agent","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"code-generation","task_name":"Code Generation"},{"task_slug":"humaneval","task_name":"HumanEval"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.02183","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.02183"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tsukushiai/self-organized-agent","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":6,"unverified":5},"by_repo_kind":{"official":{"samples":11,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8e4c36e8b56b0026","entry":"count_test_cases","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/validate_py_results.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/validate_py_results.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e4c36e8b56b0026"}},{"code_sha256_prefix":"02656b1924cbfdfb","entry":"function_with_timeout","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/executors/executor_utils.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/executors/executor_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02656b1924cbfdfb"}},{"code_sha256_prefix":"405659bf95a96f60","entry":"green_text","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/validate_py_results.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/validate_py_results.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"405659bf95a96f60"}},{"code_sha256_prefix":"b2c53dc3cc9993aa","entry":"make_printv","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/utils.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2c53dc3cc9993aa"}},{"code_sha256_prefix":"ff9702cd987f980c","entry":"read_jsonl_gz","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/utils.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff9702cd987f980c"}},{"code_sha256_prefix":"588974da3369998d","entry":"red_text","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/validate_py_results.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/validate_py_results.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"588974da3369998d"}},{"code_sha256_prefix":"c4c0bb9c81930ee1","entry":"generate_code","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/soas/agent.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/soas/agent.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4c0bb9c81930ee1"}},{"code_sha256_prefix":"fa0e7ed5f7388f5e","entry":"generate_skeleton","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/soas/agent.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/soas/agent.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa0e7ed5f7388f5e"}},{"code_sha256_prefix":"3f8d840db9fde8b2","entry":"get_subtasks","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/soas/agent.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/soas/agent.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f8d840db9fde8b2"}},{"code_sha256_prefix":"a067a230397d97aa","entry":"message_to_str","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/generators/model.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/generators/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a067a230397d97aa"}},{"code_sha256_prefix":"4e0f76b9ec8bd13a","entry":"messages_to_str","repo":"tsukushiai/self-organized-agent","repo_kind":"official","path":"programming_runs/generators/model.py","file_url":"https://github.com/tsukushiai/self-organized-agent/blob/HEAD/programming_runs/generators/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e0f76b9ec8bd13a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}