{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/autokaggle-a-multi-agent-framework-for","title":"AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions","arxiv_id":"2410.20424","date":"2024-10-27","proceeding":null,"authors":["Ziming Li","Qianbo Zang","David Ma","Jiawei Guo","Tuney Zheng","Minghao Liu","Xinyao Niu","Yue Wang","Jian Yang","Jiaheng Liu","Wanjun Zhong","Wangchunshu Zhou","Wenhao Huang","Ge Zhang"],"abstract":"Data science tasks involving tabular data present complex challenges that require sophisticated problem-solving approaches. We propose AutoKaggle, a powerful and user-centric framework that assists data scientists in completing daily data pipelines through a collaborative multi-agent system. AutoKaggle implements an iterative development process that combines code execution, debugging, and comprehensive unit testing to ensure code correctness and logic consistency. The framework offers highly customizable workflows, allowing users to intervene at each phase, thus integrating automated intelligence with human expertise. Our universal data science toolkit, comprising validated functions for data cleaning, feature engineering, and modeling, forms the foundation of this solution, enhancing productivity by streamlining common tasks. We selected 8 Kaggle competitions to simulate data processing workflows in real-world application scenarios. Evaluation results demonstrate that AutoKaggle achieves a validation submission rate of 0.85 and a comprehensive score of 0.82 in typical data science pipelines, fully proving its effectiveness and practicality in handling complex data science tasks.","url_abs":"https://arxiv.org/abs/2410.20424v3","url_pdf":"https://arxiv.org/pdf/2410.20424v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"autokaggle-a-multi-agent-framework-for","repo_url":"https://github.com/multimodal-art-projection/AutoKaggle","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"feature-engineering","task_name":"Feature Engineering"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.20424","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.20424"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/multimodal-art-projection/AutoKaggle","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"44bf2cebd4c77920","entry":"generate_response","repo":"multimodal-art-projection/AutoKaggle","repo_kind":"official","path":"api_handler.py","file_url":"https://github.com/multimodal-art-projection/AutoKaggle/blob/HEAD/api_handler.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"44bf2cebd4c77920"}},{"code_sha256_prefix":"471336f7e3c8e9c2","entry":"load_config","repo":"multimodal-art-projection/AutoKaggle","repo_kind":"official","path":"utils.py","file_url":"https://github.com/multimodal-art-projection/AutoKaggle/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"471336f7e3c8e9c2"}},{"code_sha256_prefix":"85c8a669541e5326","entry":"read_file","repo":"multimodal-art-projection/AutoKaggle","repo_kind":"official","path":"utils.py","file_url":"https://github.com/multimodal-art-projection/AutoKaggle/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"85c8a669541e5326"}},{"code_sha256_prefix":"13b6e52ec0e82cc7","entry":"split_sklearn","repo":"multimodal-art-projection/AutoKaggle","repo_kind":"official","path":"multi_agents/memory.py","file_url":"https://github.com/multimodal-art-projection/AutoKaggle/blob/HEAD/multi_agents/memory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"13b6e52ec0e82cc7"}},{"code_sha256_prefix":"5b0027e8cd0d5a6f","entry":"split_tools","repo":"multimodal-art-projection/AutoKaggle","repo_kind":"official","path":"multi_agents/memory.py","file_url":"https://github.com/multimodal-art-projection/AutoKaggle/blob/HEAD/multi_agents/memory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5b0027e8cd0d5a6f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}