{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/large-language-models-reflect-the-ideology-of","title":"Large Language Models Reflect the Ideology of their Creators","arxiv_id":"2410.18417","date":"2024-10-24","proceeding":null,"authors":["Maarten Buyl","Alexander Rogiers","Sander Noels","Guillaume Bied","Iris Dominguez-Catena","Edith Heiter","Iman Johary","Alexandru-Cristian Mara","Raphaël Romero","Jefrey Lijffijt","Tijl De Bie"],"abstract":"Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI) assistants like ChatGPT and already play an influential role in how humans access information. However, the behavior of LLMs varies depending on their design, training, and use. In this paper, we prompt a diverse panel of popular LLMs to describe a large number of prominent personalities with political relevance, in all six official languages of the United Nations. By identifying and analyzing moral assessments reflected in their responses, we find normative differences between LLMs from different geopolitical regions, as well as between the responses of the same LLM when prompted in different languages. Among only models in the United States, we find that popularly hypothesized disparities in political views are reflected in significant normative differences related to progressive values. Among Chinese models, we characterize a division between internationally- and domestically-focused models. Our results show that the ideological stance of an LLM appears to reflect the worldview of its creators. This poses the risk of political instrumentalization and raises concerns around technological and regulatory efforts with the stated aim of making LLMs ideologically 'unbiased'.","url_abs":"https://arxiv.org/abs/2410.18417v2","url_pdf":"https://arxiv.org/pdf/2410.18417v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"large-language-models-reflect-the-ideology-of","repo_url":"https://github.com/aida-ugent/llm-ideology-analysis","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"text-summarization","task_name":"Text Summarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.18417","atlas_url":"https://app.syntology.ai/?focus=2410.18417","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.18417"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aida-ugent/llm-ideology-analysis","reach":null}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"efde6c9a51f02cd6","entry":"process_question","repo":"aida-ugent/llm-ideology-analysis","repo_kind":"official","path":"src/run_questions_through_unified_api.py","file_url":"https://github.com/aida-ugent/llm-ideology-analysis/blob/HEAD/src/run_questions_through_unified_api.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"efde6c9a51f02cd6"}},{"code_sha256_prefix":"296b2d920260a8ac","entry":"verify_tag_data","repo":"aida-ugent/llm-ideology-analysis","repo_kind":"official","path":"src/run_manifesto_tagger.py","file_url":"https://github.com/aida-ugent/llm-ideology-analysis/blob/HEAD/src/run_manifesto_tagger.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"296b2d920260a8ac"}},{"code_sha256_prefix":"a86980223490a0a0","entry":"wrap_question_as_message","repo":"aida-ugent/llm-ideology-analysis","repo_kind":"official","path":"src/run_questions_through_unified_api.py","file_url":"https://github.com/aida-ugent/llm-ideology-analysis/blob/HEAD/src/run_questions_through_unified_api.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a86980223490a0a0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}