{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-12857","title":"ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation","arxiv_id":"2605.12857","date":"2026-05-13","proceeding":null,"authors":["Zhongkai Yu","Yichen Lin","Chenyang Zhou","Yuwei Zhang","Kun Zhou","Junxia Cui","Haotian Ye","Zhengding Hu","Zaifeng Pan","Ruiyi Wang","Yujie Zhao","Hejia Zhang","Jingbo Shang","Jishen Zhao","Yufei Ding"],"abstract":"Existing API-based agentic systems for RTL code generation are fundamentally misaligned with industrial practice: they assume a golden testbench is available at generation time, rely on closed-source APIs incompatible with chip vendors' air-gapped security requirements, and cannot be trained on vendors' proprietary RTL codebases, leaving valuable internal data unused. Recent self-trained models address the deployment constraint but remain single-turn generators that overlook the critical role of verification in real industrial flows. To bridge these gaps, we present ChipMATE, the first self-trained multi-agent framework for RTL generation. Inspired by industrial practice where correctness emerges from cross-comparison between independently written RTL modules and reference models, ChipMATE pairs a Verilog agent with a Python reference-model agent that mutually verify each other's outputs without any golden oracle. We design a backtrack-based inference workflow to prevent error propagation across turns, and a two-stage training pipeline that first trains each agent individually to saturate its code-generation capability, then trains the team jointly to collaborate effectively. To support the training, we further build a hybrid data-generation framework that produces 64.4K high-quality reference model training samples. ChipMATE achieves 75.0\\% and 80.1\\% pass@1 on VerilogEval V2 with 4B and 9B base models, outperforming all existing self-trained models and even DeepSeek V4 with 1600B parameters. Our code and model weights are publicly available in https://github.com/zhongkaiyu/ChipMATE.","url_abs":"https://arxiv.org/abs/2605.12857","url_pdf":"https://arxiv.org/pdf/2605.12857","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.12857","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.12857"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/zhongkaiyu/ChipMATE","reach":null}],"summary":{"ran":21,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":24,"ran":21,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":24,"samples":[{"code_sha256_prefix":"c95ba7fe77d98208","entry":"build_v_prompt","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/prompts.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c95ba7fe77d98208"}},{"code_sha256_prefix":"0e89135a0e9e80a5","entry":"extract_ports","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/cvdp_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/cvdp_framework.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0e89135a0e9e80a5"}},{"code_sha256_prefix":"6145ac08d72c728c","entry":"extract_verilog","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/prompts.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6145ac08d72c728c"}},{"code_sha256_prefix":"57627a4f24b97ebb","entry":"extract_verilog","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/eval_cvdp_verilog.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/eval_cvdp_verilog.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"57627a4f24b97ebb"}},{"code_sha256_prefix":"a5858131feb92ac9","entry":"extract_verilog_from_completion","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/extract_cvdp_refsv.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/extract_cvdp_refsv.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a5858131feb92ac9"}},{"code_sha256_prefix":"fe8b9eedb715dbf7","entry":"format_p_feedback","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/feedback.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/feedback.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"fe8b9eedb715dbf7"}},{"code_sha256_prefix":"2925bc7ff5b91683","entry":"format_v_feedback","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/feedback.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/feedback.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2925bc7ff5b91683"}},{"code_sha256_prefix":"2b7d16ce4d409a44","entry":"is_reset","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/cross_verify.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/cross_verify.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2b7d16ce4d409a44"}},{"code_sha256_prefix":"029539b69969f69d","entry":"make_backend","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/backends.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/backends.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"029539b69969f69d"}},{"code_sha256_prefix":"abe7113de30dec5b","entry":"normalize_module_name","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/cross_verify.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/cross_verify.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"abe7113de30dec5b"}},{"code_sha256_prefix":"996185da245327c0","entry":"parse_parameters","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/extract_cvdp_refsv.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/extract_cvdp_refsv.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"996185da245327c0"}},{"code_sha256_prefix":"65bb15941510f9cc","entry":"parse_ports","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/cross_verify.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/cross_verify.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"65bb15941510f9cc"}},{"code_sha256_prefix":"d0446d5216e0a4d8","entry":"parse_results_xml","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/eval_cvdp_verilog.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/eval_cvdp_verilog.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d0446d5216e0a4d8"}},{"code_sha256_prefix":"bb8454d85d59ff9c","entry":"parse_spec_widths","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/cvdp_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/cvdp_framework.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bb8454d85d59ff9c"}},{"code_sha256_prefix":"20ddcd5d4d0bd416","entry":"passk","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/chipbench/chipbench_score.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/chipbench/chipbench_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"20ddcd5d4d0bd416"}},{"code_sha256_prefix":"30564b7ce5f76fe1","entry":"passk","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/chipbench/chipbench_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/chipbench/chipbench_framework.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"30564b7ce5f76fe1"}},{"code_sha256_prefix":"96908a11cb5ff89a","entry":"remap_source_path","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/eval_cvdp_verilog.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/eval_cvdp_verilog.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"96908a11cb5ff89a"}},{"code_sha256_prefix":"dd0f65afa280200f","entry":"score","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/chipbench/chipbench_score.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/chipbench/chipbench_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"dd0f65afa280200f"}},{"code_sha256_prefix":"1f245641293bae22","entry":"strict_check_fail","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/chipbench/chipbench_score.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/chipbench/chipbench_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1f245641293bae22"}},{"code_sha256_prefix":"4b98a764bbfa0f60","entry":"strip_py_comments","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/cvdp/cvdp_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/cvdp/cvdp_framework.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4b98a764bbfa0f60"}},{"code_sha256_prefix":"0a848150fd4dc447","entry":"synth_tb","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/rtllm/rtllm_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/rtllm/rtllm_framework.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0a848150fd4dc447"}},{"code_sha256_prefix":"702fc22189642c32","entry":"build_p_prompt","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"chipmate/prompts.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/chipmate/prompts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"702fc22189642c32"}},{"code_sha256_prefix":"c6869481cba9dde6","entry":"score","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/chipbench/chipbench_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/chipbench/chipbench_framework.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c6869481cba9dde6"}},{"code_sha256_prefix":"a222280252a2db47","entry":"score","repo":"zhongkaiyu/ChipMATE","repo_kind":"found_in_text","path":"paper_repro/rtllm/rtllm_framework.py","file_url":"https://github.com/zhongkaiyu/ChipMATE/blob/HEAD/paper_repro/rtllm/rtllm_framework.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a222280252a2db47"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}