{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/qwen2-5-coder-technical-report","title":"Qwen2.5-Coder Technical Report","arxiv_id":"2409.12186","date":"2024-09-18","proceeding":null,"authors":["Binyuan Hui","Jian Yang","Zeyu Cui","Jiaxi Yang","Dayiheng Liu","Lei Zhang","Tianyu Liu","Jiajun Zhang","Bowen Yu","Keming Lu","Kai Dang","Yang Fan","Yichang Zhang","An Yang","Rui Men","Fei Huang","Bo Zheng","Yibo Miao","Shanghaoran Quan","Yunlong Feng","Xingzhang Ren","Xuancheng Ren","Jingren Zhou","Junyang Lin"],"abstract":"In this report, we introduce the Qwen2.5-Coder series, a significant upgrade from its predecessor, CodeQwen1.5. This series includes six models: Qwen2.5-Coder-(0.5B/1.5B/3B/7B/14B/32B). As a code-specific model, Qwen2.5-Coder is built upon the Qwen2.5 architecture and continues pretrained on a vast corpus of over 5.5 trillion tokens. Through meticulous data cleaning, scalable synthetic data generation, and balanced data mixing, Qwen2.5-Coder demonstrates impressive code generation capabilities while retaining general and math skills. These models have been evaluated on a wide range of code-related tasks, achieving state-of-the-art (SOTA) performance across more than 10 benchmarks, including code generation, completion, reasoning, and repair, consistently outperforming larger models of the same model size. We believe that the release of the Qwen2.5-Coder series will advance research in code intelligence and, with its permissive licensing, support wider adoption by developers in real-world applications.","url_abs":"https://arxiv.org/abs/2409.12186v3","url_pdf":"https://arxiv.org/pdf/2409.12186v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"qwen2-5-coder-technical-report","repo_url":"https://github.com/qwenlm/qwen2.5-coder","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"qwen2-5-coder-technical-report","repo_url":"https://github.com/MindCode-4/code-2/tree/main/qwen2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"code-generation","task_name":"Code Generation"},{"task_slug":"math","task_name":"Math"},{"task_slug":"synthetic-data-generation","task_name":"Synthetic Data Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.12186","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.12186"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-2/tree/main/qwen2","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qwenlm/qwen2.5-coder","reach":{"status":"ok"}}],"summary":{"ran":8,"unverified":1},"by_repo_kind":{"official":{"samples":9,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"ff18ac4c2768b8bd","entry":"chatml_format_preprocess","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/binarize_data.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/binarize_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff18ac4c2768b8bd"}},{"code_sha256_prefix":"b860ed2b7cc4439e","entry":"get_n_gram","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/utils/decont.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/utils/decont.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b860ed2b7cc4439e"}},{"code_sha256_prefix":"5d1b657d307372a4","entry":"guess_lang","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/utils/code_utils.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/utils/code_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d1b657d307372a4"}},{"code_sha256_prefix":"1b3ec7f68086db8f","entry":"has_n_gram_overlap","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/utils/decont.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/utils/decont.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1b3ec7f68086db8f"}},{"code_sha256_prefix":"31bfe3db240c5ef4","entry":"has_n_gram_overlap_with_testset","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/utils/decont.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/utils/decont.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"31bfe3db240c5ef4"}},{"code_sha256_prefix":"d66f3bbe198174ce","entry":"init_logger","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/dpo/utils.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/dpo/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d66f3bbe198174ce"}},{"code_sha256_prefix":"642419c5846f4b55","entry":"remove_irrelevant_code","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/prepare_code_execution_data.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/prepare_code_execution_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"642419c5846f4b55"}},{"code_sha256_prefix":"fead32e84c51031d","entry":"setup_tokenizer","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/binarize_data.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/binarize_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fead32e84c51031d"}},{"code_sha256_prefix":"84a1f677ca1a90e6","entry":"check_correctness_multiple","repo":"qwenlm/qwen2.5-coder","repo_kind":"official","path":"finetuning/sft/utils/code_execute_multiple.py","file_url":"https://github.com/qwenlm/qwen2.5-coder/blob/HEAD/finetuning/sft/utils/code_execute_multiple.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"84a1f677ca1a90e6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}