{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-21064","title":"Textual Equilibrium Propagation for Deep Compound AI Systems","arxiv_id":"2601.21064","date":"2026-01-28","proceeding":null,"authors":["Minghui Chen","Wenlong Deng","James Zou","Han Yu","Xiaoxiao Li"],"abstract":"Large language models (LLMs) are increasingly deployed as part of compound AI systems that coordinate multiple modules (e.g., retrievers, tools, verifiers) over long-horizon workflows. Recent approaches that propagate textual feedback globally (e.g., TextGrad) make it feasible to optimize such pipelines, but we find that performance degrades as system depth grows. In particular, long-horizon agentic workflows exhibit two depth-scaling failure modes: 1) exploding textual gradient, where textual feedback grows exponentially with depth, leading to prohibitively long message and amplifies evaluation biases; and 2) vanishing textual gradient, where limited long-context ability causes models overemphasize partial feedback and compression of lengthy feedback causes downstream messages to lose specificity gradually as they propagate many hops upstream. To mitigate these issues, we introduce Textual Equilibrium Propagation (TEP), a local learning principle inspired by Equilibrium Propagation in energy-based models. TEP includes two phases: 1) a free phase where a local LLM critics iteratively refine prompts until reaching equilibrium (no further improvements are suggested); and 2) a nudged phase which applies proximal prompt edits with bounded modification intensity, using task-level objectives that propagate via forward signaling rather than backward feedback chains. This design supports local prompt optimization followed by controlled adaptation toward global goals without the computational burden and signal degradation of global textual backpropagation. Across long-horizon QA benchmarks and multi-agent tool-use dataset, TEP consistently improves accuracy and efficiency over global propagation methods such as TextGrad. The gains grows with depth, while preserving the practicality of black-box LLM components in deep compound AI system.","url_abs":"https://arxiv.org/abs/2601.21064","url_pdf":"https://arxiv.org/pdf/2601.21064","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2601.21064","atlas_url":"https://app.syntology.ai/?focus=2601.21064","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.21064"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/MinghuiChen43/TEP","reach":null}],"summary":{"unverified":15},"by_repo_kind":{"found_in_text":{"samples":15,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"10499876ed9a8c47","entry":"collect_trainable_components","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/prompt_state.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/prompt_state.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"10499876ed9a8c47"}},{"code_sha256_prefix":"f20e933a9a8baf2a","entry":"describe_prompt_state_coverage","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/prompt_state.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/prompt_state.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f20e933a9a8baf2a"}},{"code_sha256_prefix":"30ab1ccfd5eb254b","entry":"eval_system","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/core.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"30ab1ccfd5eb254b"}},{"code_sha256_prefix":"6ce524d71a9b9d78","entry":"f1_score","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/metrics/f1.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/metrics/f1.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6ce524d71a9b9d78"}},{"code_sha256_prefix":"c0b4b62f55624b7a","entry":"get_llm_output","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/core.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c0b4b62f55624b7a"}},{"code_sha256_prefix":"cf41f610b0f11103","entry":"load_prompt_state_dict","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/prompt_state.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/prompt_state.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cf41f610b0f11103"}},{"code_sha256_prefix":"51412732efc5c512","entry":"make_raw_chat_prompt","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/tasks/bigcodebench/common.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/tasks/bigcodebench/common.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"51412732efc5c512"}},{"code_sha256_prefix":"af9c48b788c853d4","entry":"mrr","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/metrics/mrr.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/metrics/mrr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"af9c48b788c853d4"}},{"code_sha256_prefix":"03171efd2aab7e80","entry":"normalize_answer","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/metrics/f1.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/metrics/f1.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"03171efd2aab7e80"}},{"code_sha256_prefix":"0d9d167c2aabf1f8","entry":"parse_k_grid","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/split_utils.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/split_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0d9d167c2aabf1f8"}},{"code_sha256_prefix":"9b813f8c08247898","entry":"read_json","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/split_utils.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/split_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9b813f8c08247898"}},{"code_sha256_prefix":"aa2bc40da3858a9d","entry":"run_untrusted_check","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/tasks/bigcodebench/common.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/tasks/bigcodebench/common.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa2bc40da3858a9d"}},{"code_sha256_prefix":"81b735d03866d49a","entry":"sanitize_code","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/tasks/bigcodebench/common.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/tasks/bigcodebench/common.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"81b735d03866d49a"}},{"code_sha256_prefix":"cb199a9c59c7dbb3","entry":"setup_logger","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/core.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cb199a9c59c7dbb3"}},{"code_sha256_prefix":"5e56946e001d6e4c","entry":"split_ids_for_examples","repo":"MinghuiChen43/TEP","repo_kind":"found_in_text","path":"src/tep/runtime/split_utils.py","file_url":"https://github.com/MinghuiChen43/TEP/blob/HEAD/src/tep/runtime/split_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5e56946e001d6e4c"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}