{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/large-language-models-assume-people-are-more","title":"Large Language Models Assume People are More Rational than We Really are","arxiv_id":"2406.17055","date":"2024-06-24","proceeding":null,"authors":["Ryan Liu","Jiayi Geng","Joshua C. Peterson","Ilia Sucholutsky","Thomas L. Griffiths"],"abstract":"In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language Models (LLMs) must account for this. Previous empirical evidence seems to suggest that these implicit models are accurate -- LLMs offer believable proxies of human behavior, acting how we expect humans would in everyday interactions. However, by comparing LLM behavior and predictions to a large dataset of human decisions, we find that this is actually not the case: when both simulating and predicting people's choices, a suite of cutting-edge LLMs (GPT-4o & 4-Turbo, Llama-3-8B & 70B, Claude 3 Opus) assume that people are more rational than we really are. Specifically, these models deviate from human behavior and align more closely with a classic model of rational choice -- expected value theory. Interestingly, people also tend to assume that other people are rational when interpreting their behavior. As a consequence, when we compare the inferences that LLMs and people draw from the decisions of others using another psychological dataset, we find that these inferences are highly correlated. Thus, the implicit decision-making models of LLMs appear to be aligned with the human expectation that other people will act rationally, rather than with how people actually act.","url_abs":"https://arxiv.org/abs/2406.17055v4","url_pdf":"https://arxiv.org/pdf/2406.17055v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"large-language-models-assume-people-are-more","repo_url":"https://github.com/theryanl/llm-rationality","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"}],"methods":[{"method_slug":"align","method_name":"ALIGN"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.17055","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.17055"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/theryanl/llm-rationality","reach":{"status":"ok"}}],"summary":{"ran":11,"unverified":1},"by_repo_kind":{"official":{"samples":12,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"2181d983af1c1290","entry":"cal_expected_value","repo":"theryanl/llm-rationality","repo_kind":"official","path":"analysis/forward_corr_analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/analysis/forward_corr_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2181d983af1c1290"}},{"code_sha256_prefix":"3f82d5901871e676","entry":"cal_pearson_corr","repo":"theryanl/llm-rationality","repo_kind":"official","path":"analysis/forward_corr_analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/analysis/forward_corr_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3f82d5901871e676"}},{"code_sha256_prefix":"beb172ab0db0d783","entry":"get_choices","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/utils.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"beb172ab0db0d783"}},{"code_sha256_prefix":"5a42f27200bf67dc","entry":"get_credentials","repo":"theryanl/llm-rationality","repo_kind":"official","path":"forward_model/openai_utils.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/forward_model/openai_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5a42f27200bf67dc"}},{"code_sha256_prefix":"313eeb6e3c36d5de","entry":"get_largest_numbers_path","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"313eeb6e3c36d5de"}},{"code_sha256_prefix":"20e3021ef275724c","entry":"get_numbers_list","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"20e3021ef275724c"}},{"code_sha256_prefix":"bd89ef2cb1df222b","entry":"get_numbers_lists","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bd89ef2cb1df222b"}},{"code_sha256_prefix":"b032be28c8410e08","entry":"make_batch_item","repo":"theryanl/llm-rationality","repo_kind":"official","path":"forward_model/forward_model_batch.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/forward_model/forward_model_batch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b032be28c8410e08"}},{"code_sha256_prefix":"67239456c847e080","entry":"make_batch_item","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/batch.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/batch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"67239456c847e080"}},{"code_sha256_prefix":"041becd33cebca5c","entry":"parse_batch_response","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/batch.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/batch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"041becd33cebca5c"}},{"code_sha256_prefix":"17dca0c8f4beccb8","entry":"shuffle_context","repo":"theryanl/llm-rationality","repo_kind":"official","path":"inverse_model/utils.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/inverse_model/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"17dca0c8f4beccb8"}},{"code_sha256_prefix":"b1a514c1519e1d89","entry":"load_data","repo":"theryanl/llm-rationality","repo_kind":"official","path":"analysis/forward_corr_analysis.py","file_url":"https://github.com/theryanl/llm-rationality/blob/HEAD/analysis/forward_corr_analysis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b1a514c1519e1d89"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}