{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/position-foundation-agents-as-the-paradigm","title":"Position: Foundation Agents as the Paradigm Shift for Decision Making","arxiv_id":"2405.17009","date":"2024-05-27","proceeding":null,"authors":["Xiaoqian Liu","Xingzhou Lou","Jianbin Jiao","Junge Zhang"],"abstract":"Decision making demands intricate interplay between perception, memory, and reasoning to discern optimal policies. Conventional approaches to decision making face challenges related to low sample efficiency and poor generalization. In contrast, foundation models in language and vision have showcased rapid adaptation to diverse new tasks. Therefore, we advocate for the construction of foundation agents as a transformative shift in the learning paradigm of agents. This proposal is underpinned by the formulation of foundation agents with their fundamental characteristics and challenges motivated by the success of large language models (LLMs). Moreover, we specify the roadmap of foundation agents from large interactive data collection or generation, to self-supervised pretraining and adaptation, and knowledge and value alignment with LLMs. Lastly, we pinpoint critical research questions derived from the formulation and delineate trends for foundation agents supported by real-world use cases, addressing both technical and theoretical aspects to propel the field towards a more comprehensive and impactful future.","url_abs":"https://arxiv.org/abs/2405.17009v3","url_pdf":"https://arxiv.org/pdf/2405.17009v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"position-foundation-agents-as-the-paradigm","repo_url":"https://github.com/microsoft/smart","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":null,"task_name":"Position"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.17009","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.17009"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/microsoft/smart","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"ecc68c1b68e3604f","entry":"build_mlp","repo":"microsoft/smart","repo_kind":"official","path":"src/models/components/mingpt.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/models/components/mingpt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ecc68c1b68e3604f"}},{"code_sha256_prefix":"996019272061f3e2","entry":"get_exp_return_dmc","repo":"microsoft/smart","repo_kind":"official","path":"src/models/utils.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/models/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"996019272061f3e2"}},{"code_sha256_prefix":"c31278549879cb7a","entry":"get_min_action_dmc","repo":"microsoft/smart","repo_kind":"official","path":"src/models/utils.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/models/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c31278549879cb7a"}},{"code_sha256_prefix":"c559a25c7787a92b","entry":"mask_inverse","repo":"microsoft/smart","repo_kind":"official","path":"src/models/components/mingpt.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/models/components/mingpt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c559a25c7787a92b"}},{"code_sha256_prefix":"0f0021cdea13e4da","entry":"top_k_logits","repo":"microsoft/smart","repo_kind":"official","path":"src/models/utils.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/models/utils.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f0021cdea13e4da"}},{"code_sha256_prefix":"e95b0f8b29a6c4a4","entry":"instantiate_callbacks","repo":"microsoft/smart","repo_kind":"official","path":"src/utils/pl_utils.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/utils/pl_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e95b0f8b29a6c4a4"}},{"code_sha256_prefix":"1a2d1c7ac64dc5c6","entry":"instantiate_class","repo":"microsoft/smart","repo_kind":"official","path":"src/utils/pl_utils.py","file_url":"https://github.com/microsoft/smart/blob/HEAD/src/utils/pl_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1a2d1c7ac64dc5c6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}