{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-20215","title":"Multi-Agent Debate with Memory Masking","arxiv_id":"2603.20215","date":"2026-03-03","proceeding":null,"authors":["Hongduan Tian","Xiao Feng","Ziyuan Zhao","Xiangyu Zhu","Rolan Yan","Bo Han"],"abstract":"Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In particular, among all LLM reasoning frameworks, *multi-agent debate* (MAD), which employs multiple LLMs as agents to perform reasoning in the way of multi-round debate, has emerged as a powerful reasoning paradigm since it allows agents to access previous memories to alleviate fallacious content and refine their reasoning iteratively in each debate round. However, although MAD significantly improves the reasoning capabilities of LLMs, in this paper, we observe that there remain erroneous memories, and LLM agents are vulnerable to these erroneous memories. To explore this phenomenon, we provide a theoretical insight that the performance of MAD is highly dependent on the quality of memories derived from the previous debate, indicating that the existence of erroneous memories poses a threat to the performance of MAD. To address this problem, we introduce a simple yet effective multi-agent debate framework, *multi-agent debate with memory masking* (MAD-M$^2$), to improve the robustness of MAD by allowing LLM agents to mask erroneous memories from the previous debate round at the beginning of each debate round. In this way, MAD-M$^2$ can polish the contextual information before each debate round by preserving informative and meaningful memories while discarding the erroneous memories. Extensive experiments and analyses on mainstream mathematical and logical reasoning benchmarks demonstrate that MAD-M$^2$ can identify the erroneous memories and achieve better performance in reasoning than MAD.","url_abs":"https://arxiv.org/abs/2603.20215","url_pdf":"https://arxiv.org/pdf/2603.20215","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.20215","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.20215"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/tmlr-group/MAD-MM","reach":null}],"summary":{"unverified":6},"by_repo_kind":{"found_in_text":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"69c0f52e607086d3","entry":"compute_score","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"src/qwen_math.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/src/qwen_math.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"69c0f52e607086d3"}},{"code_sha256_prefix":"9b95409a2ed8e81e","entry":"find_box","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"src/qwen_math.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/src/qwen_math.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9b95409a2ed8e81e"}},{"code_sha256_prefix":"c7dae76cd3edf4c7","entry":"load_configs_from_yaml","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"src/config_utils.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/src/config_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c7dae76cd3edf4c7"}},{"code_sha256_prefix":"2eac4ac9ec895159","entry":"load_data_from_json","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"prepare_data.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/prepare_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2eac4ac9ec895159"}},{"code_sha256_prefix":"5983f446aa569e81","entry":"parse_digits","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"src/evaluator.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/src/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5983f446aa569e81"}},{"code_sha256_prefix":"f41d597c152eab12","entry":"strip_string","repo":"tmlr-group/MAD-MM","repo_kind":"found_in_text","path":"src/evaluator.py","file_url":"https://github.com/tmlr-group/MAD-MM/blob/HEAD/src/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f41d597c152eab12"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}