{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-01732","title":"Bootstrapping Embeddings for Low Resource Languages","arxiv_id":"2603.01732","date":"2026-03-02","proceeding":null,"authors":["Merve Basoz","Andrew Horne","Mattia Opper"],"abstract":"Embedding models are crucial to modern NLP. However, the creation of the most effective models relies on carefully constructed supervised finetuning data. For high resource languages, such as English, such datasets are readily available. However, for hundreds of other languages, they are simply non-existent. We investigate whether the advent of large language models can help to bridge this gap. We test three different strategies for generating synthetic triplet data used to optimise embedding models. These include in-context learning as well as two novel approaches, leveraging adapter composition and cross lingual finetuning of the LLM generator (XL-LoRA) respectively. We find that while in-context learning still falls short of strong non-synthetic baselines, adapter composition and XL-LoRA yield strong performance gains across a wide array of tasks and languages, offering a clear, scalable pathway to producing performant embedding models for a wide variety of languages.","url_abs":"https://arxiv.org/abs/2603.01732","url_pdf":"https://arxiv.org/pdf/2603.01732","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2603.01732","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.01732"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mbasoz/xllora-embedding","reach":null}],"summary":{"unverified":5},"by_repo_kind":{"found_in_text":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c30690135148911a","entry":"cl_or_sentemb_forward","repo":"mbasoz/xllora-embedding","repo_kind":"found_in_text","path":"src/simcse_train.py","file_url":"https://github.com/mbasoz/xllora-embedding/blob/HEAD/src/simcse_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c30690135148911a"}},{"code_sha256_prefix":"213cd4addc2af25d","entry":"generate_pairs_df","repo":"mbasoz/xllora-embedding","repo_kind":"found_in_text","path":"src/generate_answers_multigpu.py","file_url":"https://github.com/mbasoz/xllora-embedding/blob/HEAD/src/generate_answers_multigpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"213cd4addc2af25d"}},{"code_sha256_prefix":"c299ba74525ae352","entry":"last_dir","repo":"mbasoz/xllora-embedding","repo_kind":"found_in_text","path":"src/evaluation_mteb.py","file_url":"https://github.com/mbasoz/xllora-embedding/blob/HEAD/src/evaluation_mteb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c299ba74525ae352"}},{"code_sha256_prefix":"1a1bd28fcf95f9eb","entry":"preprocess_sts","repo":"mbasoz/xllora-embedding","repo_kind":"found_in_text","path":"src/simcse_train.py","file_url":"https://github.com/mbasoz/xllora-embedding/blob/HEAD/src/simcse_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1a1bd28fcf95f9eb"}},{"code_sha256_prefix":"65c47b0359649891","entry":"to_chat_format","repo":"mbasoz/xllora-embedding","repo_kind":"found_in_text","path":"src/generate_answers_multigpu.py","file_url":"https://github.com/mbasoz/xllora-embedding/blob/HEAD/src/generate_answers_multigpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65c47b0359649891"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}