{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/language-model-evolution-an-iterated-learning","title":"Bias Amplification in Language Model Evolution: An Iterated Learning Perspective","arxiv_id":"2404.04286","date":"2024-04-04","proceeding":null,"authors":["Yi Ren","Shangmin Guo","Linlu Qiu","Bailin Wang","Danica J. Sutherland"],"abstract":"With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods allow LLMs to generate new examples for training subsequent models. At the same time, multi-agent LLM systems, involving automated interactions among agents, are also increasing in prominence. Thus, in both short and long terms, LLMs may actively engage in an evolutionary process. We draw parallels between the behavior of LLMs and the evolution of human culture, as the latter has been extensively studied by cognitive scientists for decades. Our approach involves leveraging Iterated Learning (IL), a Bayesian framework that elucidates how subtle biases are magnified during human cultural evolution, to explain some behaviors of LLMs. This paper outlines key characteristics of agents' behavior in the Bayesian-IL framework, including predictions that are supported by experimental verification with various LLMs. This theoretical framework could help to more effectively predict and guide the evolution of LLMs in desired directions.","url_abs":"https://arxiv.org/abs/2404.04286v2","url_pdf":"https://arxiv.org/pdf/2404.04286v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"language-model-evolution-an-iterated-learning","repo_url":"https://github.com/joshua-ren/iicl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.04286","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.04286"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/joshua-ren/iicl","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10},"by_repo_kind":{"official":{"samples":10,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a675bd17e9f3f27f","entry":"cnt_of_status","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/h_and_d.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/h_and_d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a675bd17e9f3f27f"}},{"code_sha256_prefix":"01b21d0a9ec85282","entry":"convert_chatcompl_to_json","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/evaluations.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/evaluations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"01b21d0a9ec85282"}},{"code_sha256_prefix":"1d025eb199f9b305","entry":"dstr_to_pairs","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/evaluations.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/evaluations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d025eb199f9b305"}},{"code_sha256_prefix":"ac629ac9b68defd2","entry":"eval_feedback_h","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/evaluations.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/evaluations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac629ac9b68defd2"}},{"code_sha256_prefix":"c2ff65785c5bb719","entry":"gen_data_prompt","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/standard_prompts.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/standard_prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2ff65785c5bb719"}},{"code_sha256_prefix":"b88b11eb13d05a63","entry":"gen_dh_prompt","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/standard_prompts.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/standard_prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b88b11eb13d05a63"}},{"code_sha256_prefix":"158545d133c04f95","entry":"gen_hd_prompt","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/standard_prompts.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/standard_prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"158545d133c04f95"}},{"code_sha256_prefix":"17a5c87aa0811333","entry":"gen_hstar_given_status","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/h_and_d.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/h_and_d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17a5c87aa0811333"}},{"code_sha256_prefix":"cda033e38ec44fbd","entry":"gen_hstar_rnd","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/h_and_d.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/h_and_d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cda033e38ec44fbd"}},{"code_sha256_prefix":"f6926d522e90289e","entry":"get_fblist_from_hdfeedback","repo":"joshua-ren/iicl","repo_kind":"official","path":"utils/acronym_utils.py","file_url":"https://github.com/joshua-ren/iicl/blob/HEAD/utils/acronym_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6926d522e90289e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}