{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/large-language-model-as-autonomous-decision","title":"Rational Decision-Making Agent with Internalized Utility Judgment","arxiv_id":"2308.12519","date":"2023-08-24","proceeding":null,"authors":["Yining Ye","Xin Cong","Shizuo Tian","Yujia Qin","Chong Liu","Yankai Lin","Zhiyuan Liu","Maosong Sun"],"abstract":"Large language models (LLMs) have demonstrated remarkable advancements and have attracted significant efforts to develop LLMs into agents capable of executing intricate multi-step decision-making tasks beyond traditional NLP applications. Existing approaches to LLM-based decision-making predominantly build upon the manually-designed external performance metrics to guide the decision-making process. However, reliance on the external performance metrics as prior is problematic in real-world scenarios, where such prior may be unavailable, flawed, or even erroneous. For genuine autonomous decision making, it is imperative for the agent to develop its rationality from its posterior experiences to judge decisions independently. Central to the development of rationality is the construction of an internalized utility judgment, capable of assigning numerical utilities to each decision. This paper proposes RadAgent (Rational Decision-Making Agent), which fosters the development of its rationality through an iterative framework involving Experience Exploration and Utility Learning. Within this framework, Elo-based Utility Construction is devised to assign Elo scores to individual decision steps to judge their utilities via pairwise comparisons. Consequently, these Elo scores guide the decision-making process to derive optimal outcomes. Experimental results on the ToolBench dataset demonstrate RadAgent's superiority over baselines, achieving over 10% improvement in Pass Rate on diverse tasks. It offers higher-quality solutions and reduces costs (ChatGPT API calls), highlighting its effectiveness and efficiency.","url_abs":"https://arxiv.org/abs/2308.12519v2","url_pdf":"https://arxiv.org/pdf/2308.12519v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.12519","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.12519"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/OpenBMB/RaD-Agent","reach":null}],"summary":{"ran":3,"ran_honours":4,"ran_fixture":1,"ran_draft_wrong":2,"ran_violates":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":15,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":15,"samples":[{"code_sha256_prefix":"f9dce67a905b431e","entry":"base_search_method","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9dce67a905b431e"}},{"code_sha256_prefix":"d02010abc3fe6b74","entry":"compute_epsilon_new_node","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d02010abc3fe6b74"}},{"code_sha256_prefix":"efef06c7ccff256a","entry":"elo_match","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"efef06c7ccff256a"}},{"code_sha256_prefix":"6c1b447bb175cf1d","entry":"elo_rank","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c1b447bb175cf1d"}},{"code_sha256_prefix":"2d522169c96708ab","entry":"parse_json","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2d522169c96708ab"}},{"code_sha256_prefix":"187ac72c168ec9df","entry":"rank2Thread","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"187ac72c168ec9df"}},{"code_sha256_prefix":"d0dbd64d8b428bc2","entry":"rank2_single","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d0dbd64d8b428bc2"}},{"code_sha256_prefix":"3ba5c5c1671b80cb","entry":"rank2symmetry","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ba5c5c1671b80cb"}},{"code_sha256_prefix":"6fb94827dfecb503","entry":"softmax_bias","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6fb94827dfecb503"}},{"code_sha256_prefix":"126ff06e838dad06","entry":"sum_based_rankn","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"126ff06e838dad06"}},{"code_sha256_prefix":"8eb516b51af146fb","entry":"tree_node","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8eb516b51af146fb"}},{"code_sha256_prefix":"b522d93fd1c261a7","entry":"ETS_tree_search","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b522d93fd1c261a7"}},{"code_sha256_prefix":"3061a63e603aba3d","entry":"my_tree","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3061a63e603aba3d"}},{"code_sha256_prefix":"fdf89c1241fc960f","entry":"rank2_allchain","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fdf89c1241fc960f"}},{"code_sha256_prefix":"2bf35d86ccf86b29","entry":"rank2_subfix","repo":"OpenBMB/RaD-Agent","repo_kind":"found_in_text","path":"Algorithms/ETS.py","file_url":"https://github.com/OpenBMB/RaD-Agent/blob/HEAD/Algorithms/ETS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2bf35d86ccf86b29"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}