{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/expressivity-of-emergent-language-is-a-trade","title":"Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability","arxiv_id":"2106.03982","date":"2021-06-07","proceeding":null,"authors":["Shangmin Guo","Yi Ren","Kory Mathewson","Simon Kirby","Stefano V. Albrecht","Kenny Smith"],"abstract":"Researchers are using deep learning models to explore the emergence of language in various language games, where agents interact and develop an emergent language to solve tasks. We focus on the factors that determine the expressivity of emergent languages, which reflects the amount of information about input spaces those languages are capable of encoding. We measure the expressivity of emergent languages based on the generalisation performance across different games, and demonstrate that the expressivity of emergent languages is a trade-off between the complexity and unpredictability of the context those languages emerged from. Another contribution of this work is the discovery of message type collapse, i.e. the number of unique messages is lower than that of inputs. We also show that using the contrastive loss proposed by Chen et al. (2020) can alleviate this problem.","url_abs":"https://arxiv.org/abs/2106.03982v2","url_pdf":"https://arxiv.org/pdf/2106.03982v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"expressivity-of-emergent-language-is-a-trade","repo_url":"https://github.com/uoe-agents/Expressivity-of-Emergent-Languages","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2106.03982","atlas_url":"https://app.syntology.ai/?focus=2106.03982","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.03982"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/uoe-agents/Expressivity-of-Emergent-Languages","reach":null}],"summary":{"ran_draft_wrong":2,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"079e3227e21464d0","entry":"read_language_from_pickle","repo":"uoe-agents/Expressivity-of-Emergent-Languages","repo_kind":"official","path":"context_analysis.py","file_url":"https://github.com/uoe-agents/Expressivity-of-Emergent-Languages/blob/HEAD/context_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"079e3227e21464d0"}},{"code_sha256_prefix":"ec4f1dcb91582ebc","entry":"read_msg_num_file","repo":"uoe-agents/Expressivity-of-Emergent-Languages","repo_kind":"official","path":"context_analysis.py","file_url":"https://github.com/uoe-agents/Expressivity-of-Emergent-Languages/blob/HEAD/context_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"ec4f1dcb91582ebc"}},{"code_sha256_prefix":"7b2df1c39486da61","entry":"read_msg_num_text_in_dir","repo":"uoe-agents/Expressivity-of-Emergent-Languages","repo_kind":"official","path":"context_analysis.py","file_url":"https://github.com/uoe-agents/Expressivity-of-Emergent-Languages/blob/HEAD/context_analysis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7b2df1c39486da61"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}