{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/randomness-not-representation-the","title":"Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMs","arxiv_id":"2503.08688","date":"2025-03-11","proceeding":null,"authors":["Ariba Khan","Stephen Casper","Dylan Hadfield-Menell"],"abstract":"Research on the 'cultural alignment' of Large Language Models (LLMs) has emerged in response to growing interest in understanding representation across diverse stakeholders. Current approaches to evaluating cultural alignment through survey-based assessments that borrow from social science methodologies often overlook systematic robustness checks. Here, we identify and test three assumptions behind current survey-based evaluation methods: (1) Stability: that cultural alignment is a property of LLMs rather than an artifact of evaluation design, (2) Extrapolability: that alignment with one culture on a narrow set of issues predicts alignment with that culture on others, and (3) Steerability: that LLMs can be reliably prompted to represent specific cultural perspectives. Through experiments examining both explicit and implicit preferences of leading LLMs, we find a high level of instability across presentation formats, incoherence between evaluated versus held-out cultural dimensions, and erratic behavior under prompt steering. We show that these inconsistencies can cause the results of an evaluation to be very sensitive to minor variations in methodology. Finally, we demonstrate in a case study on evaluation design that narrow experiments and a selective assessment of evidence can be used to paint an incomplete picture of LLMs' cultural alignment properties. Overall, these results highlight significant limitations of current survey-based approaches to evaluating the cultural alignment of LLMs and highlight a need for systematic robustness checks and red-teaming for evaluation results. Data and code are available at https://huggingface.co/datasets/akhan02/cultural-dimension-cover-letters and https://github.com/ariba-k/llm-cultural-alignment-evaluation, respectively.","url_abs":"https://arxiv.org/abs/2503.08688v2","url_pdf":"https://arxiv.org/pdf/2503.08688v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"randomness-not-representation-the","repo_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.08688","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.08688"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation","reach":null}],"summary":{"ran_draft_wrong":6,"ran_honours":1,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"c9ff479d96e5f207","entry":"format_question","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"extrapolability/run_extrapolability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/extrapolability/run_extrapolability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c9ff479d96e5f207"}},{"code_sha256_prefix":"5691118162d4c8e5","entry":"load_data","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"stability/explicit/run_explicit_stability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/stability/explicit/run_explicit_stability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5691118162d4c8e5"}},{"code_sha256_prefix":"757d6c27fbe8738b","entry":"load_data","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"steerability/run_steerability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/steerability/run_steerability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"757d6c27fbe8738b"}},{"code_sha256_prefix":"0ff1ce9943438838","entry":"parse_response_identifier_only","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"stability/explicit/run_explicit_stability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/stability/explicit/run_explicit_stability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0ff1ce9943438838"}},{"code_sha256_prefix":"b28f357d240a60e7","entry":"parse_response_option_text","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"stability/explicit/run_explicit_stability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/stability/explicit/run_explicit_stability.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b28f357d240a60e7"}},{"code_sha256_prefix":"2cc45c3ce708c71b","entry":"process_batch","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"steerability/run_steerability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/steerability/run_steerability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2cc45c3ce708c71b"}},{"code_sha256_prefix":"f8b212f56c3563ac","entry":"process_question","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"steerability/run_steerability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/steerability/run_steerability.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f8b212f56c3563ac"}},{"code_sha256_prefix":"d097e29cb56b8d1c","entry":"load_data","repo":"ariba-k/llm-cultural-alignment-evaluation","repo_kind":"official","path":"extrapolability/run_extrapolability.py","file_url":"https://github.com/ariba-k/llm-cultural-alignment-evaluation/blob/HEAD/extrapolability/run_extrapolability.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d097e29cb56b8d1c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}