{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-20640","title":"Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention","arxiv_id":"2603.20640","date":"2026-03-21","proceeding":null,"authors":["Manh Nguyen","Anh Nguyen","Dung Nguyen","Svetha Venkatesh","Hung Le"],"abstract":"Multi-Agent Debate has emerged as a promising framework for improving the reasoning quality of large language models through iterative inter-agent communication. However, broadcasting all agent messages at every round introduces noise and redundancy that can degrade debate quality and waste computational resources. Current approaches rely on uncertainty estimation to filter low-confidence responses before broadcasting, but this approach is unreliable due to miscalibrated confidence scores and sensitivity to threshold selection. To address this, we propose Diversity-Aware Retention (DAR), a lightweight debate framework that, at each debate round, selects the subset of agent responses that maximally disagree with each other and with the majority vote before broadcasting. Through an explicit index-based retention mechanism, DAR preserves the original messages without modification, ensuring that retained disagreements remain authentic. Experiments on diverse reasoning and question answering benchmarks demonstrate that our selective message propagation consistently improves debate performance, particularly as the number of agents scales, where noise accumulation is most severe. Our results highlight that what agents hear is as important as what agents say in multi-agent reasoning systems. Code is publicly available at https://github.com/DA2I2-SLM/DAR.","url_abs":"https://arxiv.org/abs/2603.20640","url_pdf":"https://arxiv.org/pdf/2603.20640","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.20640","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.20640"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/DA2I2-SLM/DAR","reach":null}],"summary":{"unverified":11},"by_repo_kind":{"found_in_text":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c638b2060503f8fd","entry":"build_normal_msg","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/dev.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/dev.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c638b2060503f8fd"}},{"code_sha256_prefix":"ef1c573d03500e54","entry":"build_normal_msg_with_ids","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/dev.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/dev.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef1c573d03500e54"}},{"code_sha256_prefix":"b7f8ce776f3eb615","entry":"create_zero_shot_prompt","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/model/falcon.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/model/falcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b7f8ce776f3eb615"}},{"code_sha256_prefix":"7b4d0821e8c46c22","entry":"engine_hf","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/model/model_utils.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/model/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b4d0821e8c46c22"}},{"code_sha256_prefix":"a72d68a37728a783","entry":"evaluate_arithmetics","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/evaluator.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a72d68a37728a783"}},{"code_sha256_prefix":"073596ca49ad3ad6","entry":"evaluate_mcq","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/evaluator.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"073596ca49ad3ad6"}},{"code_sha256_prefix":"8dfbcae9b1f4de30","entry":"gather_last_token","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/model/falcon.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/model/falcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8dfbcae9b1f4de30"}},{"code_sha256_prefix":"ec5050de1f9e05c4","entry":"get_instruction_suffix","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/evaluator.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ec5050de1f9e05c4"}},{"code_sha256_prefix":"4d100dfac04c76f7","entry":"get_peers","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/dev.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/dev.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4d100dfac04c76f7"}},{"code_sha256_prefix":"83f5d8fd4615419d","entry":"load_model","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/model/falcon.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/model/falcon.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"83f5d8fd4615419d"}},{"code_sha256_prefix":"f8d90d67f4aad3ad","entry":"load_model","repo":"DA2I2-SLM/DAR","repo_kind":"found_in_text","path":"src/model/llama.py","file_url":"https://github.com/DA2I2-SLM/DAR/blob/HEAD/src/model/llama.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8d90d67f4aad3ad"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}