{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/moral-foundations-of-large-language-models","title":"Moral Foundations of Large Language Models","arxiv_id":"2310.15337","date":"2023-10-23","proceeding":null,"authors":["Marwa Abdulhai","Gregory Serapio-Garcia","Clément Crepy","Daria Valter","John Canny","Natasha Jaques"],"abstract":"Moral foundations theory (MFT) is a psychological assessment tool that decomposes human moral reasoning into five factors, including care/harm, liberty/oppression, and sanctity/degradation (Graham et al., 2009). People vary in the weight they place on these dimensions when making moral decisions, in part due to their cultural upbringing and political ideology. As large language models (LLMs) are trained on datasets collected from the internet, they may reflect the biases that are present in such corpora. This paper uses MFT as a lens to analyze whether popular LLMs have acquired a bias towards a particular set of moral values. We analyze known LLMs and find they exhibit particular moral foundations, and show how these relate to human moral foundations and political affiliations. We also measure the consistency of these biases, or whether they vary strongly depending on the context of how the model is prompted. Finally, we show that we can adversarially select prompts that encourage the moral to exhibit a particular set of moral foundations, and that this can affect the model's behavior on downstream tasks. These findings help illustrate the potential risks and unintended consequences of LLMs assuming a particular moral stance.","url_abs":"https://arxiv.org/abs/2310.15337v1","url_pdf":"https://arxiv.org/pdf/2310.15337v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"moral-foundations-of-large-language-models","repo_url":"https://github.com/abdulhaim/moral_foundations_llm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2310.15337","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.15337"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/abdulhaim/moral_foundations_llm","reach":{"status":"ok"}}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"b17a775a9e828059","entry":"compute_mfq","repo":"abdulhaim/moral_foundations_llm","repo_kind":"official","path":"utils/questionnaire_utils.py","file_url":"https://github.com/abdulhaim/moral_foundations_llm/blob/HEAD/utils/questionnaire_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b17a775a9e828059"}},{"code_sha256_prefix":"c9c1693f4efb3b71","entry":"logprob_to_prob","repo":"abdulhaim/moral_foundations_llm","repo_kind":"official","path":"utils/gpt3_utils.py","file_url":"https://github.com/abdulhaim/moral_foundations_llm/blob/HEAD/utils/gpt3_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c9c1693f4efb3b71"}},{"code_sha256_prefix":"0f6ba13b6fc5cda6","entry":"parse_response","repo":"abdulhaim/moral_foundations_llm","repo_kind":"official","path":"utils/gpt3_utils.py","file_url":"https://github.com/abdulhaim/moral_foundations_llm/blob/HEAD/utils/gpt3_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f6ba13b6fc5cda6"}},{"code_sha256_prefix":"3a92356811bd3dc4","entry":"prob_for_label","repo":"abdulhaim/moral_foundations_llm","repo_kind":"official","path":"utils/gpt3_utils.py","file_url":"https://github.com/abdulhaim/moral_foundations_llm/blob/HEAD/utils/gpt3_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3a92356811bd3dc4"}},{"code_sha256_prefix":"e4b96025ec3029ce","entry":"run_prompts","repo":"abdulhaim/moral_foundations_llm","repo_kind":"official","path":"1-political_gpt3engines/haidt_political.py","file_url":"https://github.com/abdulhaim/moral_foundations_llm/blob/HEAD/1-political_gpt3engines/haidt_political.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e4b96025ec3029ce"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}