{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-06557","title":"Coordination Matters: Evaluation of Cooperative Multi-Agent Reinforcement Learning","arxiv_id":"2605.06557","date":"2026-05-07","proceeding":null,"authors":["Maria Ana Cardei","Matthew Landers","Afsaneh Doryab"],"abstract":"Cooperative multi-agent reinforcement learning (MARL) benchmarks commonly emphasize aggregate outcomes such as return, success rate, or completion time. While essential, these metrics often fail to reveal how agents coordinate, particularly in settings where agents, tasks, and joint assignment choices scale combinatorially. We propose a coordination-aware evaluation perspective that supplements return with process-level diagnostics. We instantiate this perspective using STAT, a controlled commitment-constrained spatial task-allocation testbed that systematically varies agents, tasks, and environment size while holding observation access and task rules fixed. We evaluate six representative value-based MARL methods across varying levels of centralization. Our results show that similar return trends can reflect distinct coordination mechanisms, including differences in redundant assignment, assignment diversity, and task-completion efficiency. We find that in commitment-constrained task allocation, performance under scale is shaped not only by nominal action-space size, but also by assignment pressure, sparse decision opportunities, and redundant choices among interdependent agents. Our findings motivate coordination-aware evaluation as a necessary complement to return-based benchmarking for cooperative MARL.","url_abs":"https://arxiv.org/abs/2605.06557","url_pdf":"https://arxiv.org/pdf/2605.06557","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.06557","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.06557"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mariacardei/coordination_aware_MARL","reach":null}],"summary":{"ran":8,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":11,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d3fa5e5acb47f542","entry":"compute_completed","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/stat_env/stat_model.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/stat_env/stat_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3fa5e5acb47f542"}},{"code_sha256_prefix":"f44e5d5a2251a9c8","entry":"extract_env_from_config","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/fdqn/eval_fdqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/fdqn/eval_fdqn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f44e5d5a2251a9c8"}},{"code_sha256_prefix":"40bd9356590d7058","entry":"extract_env_from_filename","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/dqn/eval_dqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/dqn/eval_dqn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40bd9356590d7058"}},{"code_sha256_prefix":"e6aeb129ca653517","entry":"extract_train_seed_from_path","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/dqn/eval_dqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/dqn/eval_dqn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e6aeb129ca653517"}},{"code_sha256_prefix":"638b62b4310416b3","entry":"find_run_dir","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/fdqn/eval_fdqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/fdqn/eval_fdqn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"638b62b4310416b3"}},{"code_sha256_prefix":"e905b5905d875150","entry":"find_trained_model","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/dqn/eval_dqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/dqn/eval_dqn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e905b5905d875150"}},{"code_sha256_prefix":"560f29de1e064604","entry":"get_distance","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/stat_env/stat_model.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/stat_env/stat_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"560f29de1e064604"}},{"code_sha256_prefix":"15a58d2465e21e51","entry":"infer_metrics_from_csv","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/dqn/run_all_evals.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/dqn/run_all_evals.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15a58d2465e21e51"}},{"code_sha256_prefix":"a698f6a10eefce1e","entry":"calc_move","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/stat_env/stat_model.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/stat_env/stat_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a698f6a10eefce1e"}},{"code_sha256_prefix":"cf8c34d90dbdd3de","entry":"make_dqn_agent","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/dqn/train_dqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/dqn/train_dqn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf8c34d90dbdd3de"}},{"code_sha256_prefix":"6fd79f8e5f3fee61","entry":"make_fdqn_agent","repo":"mariacardei/coordination_aware_MARL","repo_kind":"found_in_text","path":"src/fdqn/train_fdqn.py","file_url":"https://github.com/mariacardei/coordination_aware_MARL/blob/HEAD/src/fdqn/train_fdqn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6fd79f8e5f3fee61"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}