{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/revisiting-the-linearity-in-cross-lingual","title":"Understanding Linearity of Cross-Lingual Word Embedding Mappings","arxiv_id":"2004.01079","date":"2020-04-02","proceeding":null,"authors":["Xutan Peng","Mark Stevenson","Chenghua Lin","Chen Li"],"abstract":"The technique of Cross-Lingual Word Embedding (CLWE) plays a fundamental role in tackling Natural Language Processing challenges for low-resource languages. Its dominant approaches assumed that the relationship between embeddings could be represented by a linear mapping, but there has been no exploration of the conditions under which this assumption holds. Such a research gap becomes very critical recently, as it has been evidenced that relaxing mappings to be non-linear can lead to better performance in some cases. We, for the first time, present a theoretical analysis that identifies the preservation of analogies encoded in monolingual word embeddings as a necessary and sufficient condition for the ground-truth CLWE mapping between those embeddings to be linear. On a novel cross-lingual analogy dataset that covers five representative analogy categories for twelve distinct languages, we carry out experiments which provide direct empirical support for our theoretical claim. These results offer additional insight into the observations of other researchers and contribute inspiration for the development of more effective cross-lingual representation learning strategies.","url_abs":"https://arxiv.org/abs/2004.01079v3","url_pdf":"https://arxiv.org/pdf/2004.01079v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"revisiting-the-linearity-in-cross-lingual","repo_url":"https://github.com/pzoom522/xanlg","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2004.01079","atlas_url":"https://app.syntology.ai/?focus=2004.01079","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.01079"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pzoom522/xanlg","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":2,"ran_fixture":1},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"65019dd978d5fe27","entry":"filter_x_embs","repo":"pzoom522/xanlg","repo_kind":"official","path":"get_emb.py","file_url":"https://github.com/pzoom522/xanlg/blob/HEAD/get_emb.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"65019dd978d5fe27"}},{"code_sha256_prefix":"e58e520e94aded67","entry":"read_emb","repo":"pzoom522/xanlg","repo_kind":"official","path":"get_emb.py","file_url":"https://github.com/pzoom522/xanlg/blob/HEAD/get_emb.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"e58e520e94aded67"}},{"code_sha256_prefix":"746d551c2ad601a4","entry":"read_m_analogy_set","repo":"pzoom522/xanlg","repo_kind":"official","path":"get_emb.py","file_url":"https://github.com/pzoom522/xanlg/blob/HEAD/get_emb.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"746d551c2ad601a4"}},{"code_sha256_prefix":"b0aa0ea12e60060e","entry":"transport","repo":"pzoom522/xanlg","repo_kind":"official","path":"validate_analogy.py","file_url":"https://github.com/pzoom522/xanlg/blob/HEAD/validate_analogy.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b0aa0ea12e60060e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}