{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/culture-gen-revealing-global-cultural","title":"CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting","arxiv_id":"2404.10199","date":"2024-04-16","proceeding":null,"authors":["Huihan Li","Liwei Jiang","Jena D. Hwang","Hyunwoo Kim","Sebastin Santy","Taylor Sorensen","Bill Yuchen Lin","Nouha Dziri","Xiang Ren","Yejin Choi"],"abstract":"As the utilization of large language models (LLMs) has proliferated world-wide, it is crucial for them to have adequate knowledge and fair representation for diverse global cultures. In this work, we uncover culture perceptions of three SOTA models on 110 countries and regions on 8 culture-related topics through culture-conditioned generations, and extract symbols from these generations that are associated to each culture by the LLM. We discover that culture-conditioned generation consist of linguistic \"markers\" that distinguish marginalized cultures apart from default cultures. We also discover that LLMs have an uneven degree of diversity in the culture symbols, and that cultures from different geographic regions have different presence in LLMs' culture-agnostic generation. Our findings promote further research in studying the knowledge and fairness of global culture perception in LLMs. Code and Data can be found here: https://github.com/huihanlhh/Culture-Gen/","url_abs":"https://arxiv.org/abs/2404.10199v5","url_pdf":"https://arxiv.org/pdf/2404.10199v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"culture-gen-revealing-global-cultural","repo_url":"https://github.com/huihanlhh/culture-gen","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"fairness","task_name":"Fairness"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2404.10199","atlas_url":"https://app.syntology.ai/?focus=2404.10199","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.10199"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huihanlhh/culture-gen","reach":null}],"summary":{"ran_honours":2},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9e998932b0ab4052","entry":"extract_keyword_probability_distribution","repo":"huihanlhh/culture-gen","repo_kind":"official","path":"script/culture_symbols.py","file_url":"https://github.com/huihanlhh/culture-gen/blob/HEAD/script/culture_symbols.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e998932b0ab4052"}},{"code_sha256_prefix":"6221576fbe8a2441","entry":"simpson_iod","repo":"huihanlhh/culture-gen","repo_kind":"official","path":"script/cultural_evaluations.py","file_url":"https://github.com/huihanlhh/culture-gen/blob/HEAD/script/cultural_evaluations.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6221576fbe8a2441"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}