{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/langbridge-multilingual-reasoning-without","title":"LangBridge: Multilingual Reasoning Without Multilingual Supervision","arxiv_id":"2401.10695","date":"2024-01-19","proceeding":null,"authors":["Dongkeun Yoon","Joel Jang","Sungdong Kim","Seungone Kim","Sheikh Shafayat","Minjoon Seo"],"abstract":"We introduce LangBridge, a zero-shot approach to adapt language models for multilingual reasoning tasks without multilingual supervision. LangBridge operates by bridging two models, each specialized in different aspects: (1) one specialized in understanding multiple languages (e.g., mT5 encoder) and (2) one specialized in reasoning (e.g., MetaMath). LangBridge connects the two models by introducing minimal trainable parameters between them. Despite utilizing only English data for training, LangBridge considerably enhances the performance of language models on low-resource languages across mathematical reasoning, code completion, logical reasoning, and commonsense reasoning. Our analysis suggests that the efficacy of LangBridge stems from the language-agnostic characteristics of multilingual representations. We publicly release our code and models.","url_abs":"https://arxiv.org/abs/2401.10695v2","url_pdf":"https://arxiv.org/pdf/2401.10695v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"langbridge-multilingual-reasoning-without","repo_url":"https://github.com/kaistAI/LangBridge","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"code-completion","task_name":"Code Completion"},{"task_slug":"logical-reasoning","task_name":"Logical Reasoning"},{"task_slug":"mathematical-reasoning","task_name":"Mathematical Reasoning"}],"methods":[{"method_slug":"adafactor","method_name":"Adafactor"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"glu","method_name":"Gated Linear Unit"},{"method_slug":"inverse-square-root-schedule","method_name":"Inverse Square Root Schedule"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"sentencepiece","method_name":"SentencePiece"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"t5","method_name":"T5"},{"method_slug":"mt5","method_name":"mT5"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2401.10695","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.10695"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kaistAI/LangBridge","reach":null}],"summary":{"ran":3,"ran_draft_wrong":2,"unverified":7},"by_repo_kind":{"official":{"samples":12,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"daf9d2141195f786","entry":"FFNWithAddedEos","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"daf9d2141195f786"}},{"code_sha256_prefix":"37a7a2b6f100bb8d","entry":"FeedForward","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"37a7a2b6f100bb8d"}},{"code_sha256_prefix":"1d7b746adcbadaf8","entry":"LinearWithAddedEos","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1d7b746adcbadaf8"}},{"code_sha256_prefix":"5d149544c7fc8e6a","entry":"PerceiverAttentionLayer","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d149544c7fc8e6a"}},{"code_sha256_prefix":"549ba22ac5f083c2","entry":"suppress_model_loading_warnings","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"549ba22ac5f083c2"}},{"code_sha256_prefix":"542d4a6ee0955100","entry":"LBBaseModel","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"542d4a6ee0955100"}},{"code_sha256_prefix":"3fc6f3444566829b","entry":"LBLlama","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3fc6f3444566829b"}},{"code_sha256_prefix":"7894e0187dc3bdce","entry":"LBMistral","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7894e0187dc3bdce"}},{"code_sha256_prefix":"e543977530e8e05b","entry":"LBOPT","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e543977530e8e05b"}},{"code_sha256_prefix":"701eaad49610095c","entry":"LangBridgeConfig","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"701eaad49610095c"}},{"code_sha256_prefix":"96f7e42651976ef9","entry":"LangBridgeModel","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"96f7e42651976ef9"}},{"code_sha256_prefix":"4052ae455ec9b682","entry":"PerceiverResampler","repo":"kaistAI/LangBridge","repo_kind":"official","path":"langbridge/modeling_langbridge.py","file_url":"https://github.com/kaistAI/LangBridge/blob/HEAD/langbridge/modeling_langbridge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4052ae455ec9b682"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}