{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-24088","title":"CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems","arxiv_id":"2509.24088","date":"2025-09-28","proceeding":"ICML","authors":["Yifan Yu","Moyan Li","Shaoyuan Xu","Jinmiao Fu","Xinhai Hou","Fan Lai","Bryan Wang"],"abstract":"Multi-agent systems (MAS) are increasingly capable of tackling complex real-world tasks, yet their reliance on inter-agent coordination, tool use, and long-horizon reasoning makes error recognition particularly challenging. Minor errors can propagate across agents, escalating into task failures while producing long, intertwined execution trajectories that impose significant costs for both human developers and automated systems to debug and analyze. Our key insight is that, despite surface differences in failure trajectories (e.g., logs), MAS errors often recur with similar structural patterns. This paper presents CORRECT, the first lightweight, training-free framework that leverages an online cache of distilled error schemata to recognize and transfer knowledge of failure structures across new requests. This cache-based reuse allows LLMs to perform targeted error localization at inference time, avoiding the need for expensive retraining while adapting to dynamic MAS deployments in subseconds. To support rigorous study in this domain, we also introduce CORRECT-Error, a large-scale dataset of over 2,000 annotated trajectories collected through a novel error-injection pipeline guided by real-world distributions, and further validated through human evaluation to ensure alignment with natural failure patterns. Experiments across seven diverse MAS applications show that CORRECT improves step-level error localization up to 19.8% over existing advances while at near-zero overhead, substantially narrowing the gap between automated and human-level error recognition.","url_abs":"https://arxiv.org/abs/2509.24088","url_pdf":"https://arxiv.org/pdf/2509.24088","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.24088","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.24088"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/UIUC-MLSys/CORRECT","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"unverified":22},"by_repo_kind":{"found_in_text":{"samples":22,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":22,"samples":[{"code_sha256_prefix":"15569da03b75f0a9","entry":"all_at_once_baseline_parallel","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/cloud_paper.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/cloud_paper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"15569da03b75f0a9"}},{"code_sha256_prefix":"e40ecf0918fb5052","entry":"all_at_once_with_schemata","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/utils.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e40ecf0918fb5052"}},{"code_sha256_prefix":"f6f8f547e2c47f02","entry":"all_at_once_with_schemata_gemini","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/utils.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f6f8f547e2c47f02"}},{"code_sha256_prefix":"bf55923066bb8924","entry":"analyze_all_at_once_cloud_with_schemata_parallel","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/cloud_paper.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/cloud_paper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bf55923066bb8924"}},{"code_sha256_prefix":"18f2cdd35c9ac991","entry":"clean_text","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/cloud_paper.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/cloud_paper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"18f2cdd35c9ac991"}},{"code_sha256_prefix":"112a1056fe290fc3","entry":"compute_trajectory_similarities","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/generate_trajectory_similarities.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/generate_trajectory_similarities.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"112a1056fe290fc3"}},{"code_sha256_prefix":"4e0a44a338e3f88e","entry":"create_prompt","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/error_schema_generator_cloud.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/error_schema_generator_cloud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4e0a44a338e3f88e"}},{"code_sha256_prefix":"dae296eb6fedbbee","entry":"evaluate_accuracy","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/evaluate.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"dae296eb6fedbbee"}},{"code_sha256_prefix":"d8713ffdb148722b","entry":"generate_schema_gpt","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/error_schema_generator_cloud.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/error_schema_generator_cloud.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d8713ffdb148722b"}},{"code_sha256_prefix":"1e5e91786e60a1d3","entry":"get_json_number","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_whoandwhen.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_whoandwhen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1e5e91786e60a1d3"}},{"code_sha256_prefix":"4be6f57b3ad00321","entry":"load_error_schemata","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_whoandwhen.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_whoandwhen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4be6f57b3ad00321"}},{"code_sha256_prefix":"239cd36280f88974","entry":"load_error_schemata_for_dataset","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_correct_error.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_correct_error.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"239cd36280f88974"}},{"code_sha256_prefix":"2ca759932c4174c6","entry":"load_trajectory_similarities","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_whoandwhen.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_whoandwhen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2ca759932c4174c6"}},{"code_sha256_prefix":"c1ef5172b5348107","entry":"load_trajectory_similarities_for_dataset","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_correct_error.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_correct_error.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c1ef5172b5348107"}},{"code_sha256_prefix":"223eb1ddf722c450","entry":"make_openai_client","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/Lib/utils.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/Lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"223eb1ddf722c450"}},{"code_sha256_prefix":"972474c3a3186d59","entry":"mean_pooling","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/generate_trajectory_similarities.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/generate_trajectory_similarities.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"972474c3a3186d59"}},{"code_sha256_prefix":"77a00911d05aa11b","entry":"read_actual_data","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/evaluate.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"77a00911d05aa11b"}},{"code_sha256_prefix":"bae9a32d2cb23f25","entry":"read_error_logs","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/error_schema_generator.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/error_schema_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bae9a32d2cb23f25"}},{"code_sha256_prefix":"d7e23813e9b7b1b0","entry":"read_predictions","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/evaluate.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d7e23813e9b7b1b0"}},{"code_sha256_prefix":"71ef2fc32f694208","entry":"read_trajectory_json","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/generate_trajectory_similarities.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/generate_trajectory_similarities.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"71ef2fc32f694208"}},{"code_sha256_prefix":"5c88eda8b39859f6","entry":"setup_tokenizer","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/error_schema_generator.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/error_schema_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5c88eda8b39859f6"}},{"code_sha256_prefix":"ba4052d14f6915b6","entry":"str_to_bool","repo":"UIUC-MLSys/CORRECT","repo_kind":"found_in_text","path":"src/inference_correct_error.py","file_url":"https://github.com/UIUC-MLSys/CORRECT/blob/HEAD/src/inference_correct_error.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ba4052d14f6915b6"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.MA","source":"arxiv_api"},"syntology_extracted_results":null}