Zero-Shot Cross-Lingual Transfer

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 80 papers with code (163 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
  26 Dec 2018 13 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 4 pointer-only (licence)
  We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
• XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
  30 Jun 2021 3 repositories listed
  In this paper, we introduce ELECTRA-style tasks to cross-lingual language model pre-training.
• Composable Sparse Fine-Tuning for Cross-Lingual Transfer
  14 Oct 2021 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  Both these masks can then be composed with the pretrained model.
• Simple and Effective Zero-shot Cross-lingual Phoneme Recognition
  23 Sep 2021 2 repositories listed
  Recent progress in self-training, self-supervised pretraining and unsupervised learning enabled well performing speech recognition systems without any labeled data.
• XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
  1 Jan 2020 2 repositories listed
  However, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse…
• Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
  19 Apr 2019 2 repositories listed
  Pretrained contextual representation models (Peters et al., 2018; Devlin et al., 2018) have pushed forward the state-of-the-art on many NLP tasks.
• Cross-Dialect Information Retrieval: Information Access in Low-Resource and High-Variance Languages
  17 Dec 2024 1 repository listed
  A large amount of local and culture-specific knowledge (e.
• Table Question Answering for Low-resourced Indic Languages
  4 Oct 2024 1 repository listed
  TableQA models trained on our large-scale datasets outperform state-of-the-art LLMs.
• Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing
  1 Oct 2024 1 repository listed Syntology ran 5 of 7 samples · 2 unverified · 7 pointer-only (licence)
  In this study, we propose Cross-Lingual Back-Parsing (CBP), a novel data augmentation methodology designed to enhance cross-lingual transfer for SP.
• PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment
  23 Jul 2024 1 repository listed Syntology ran 4 of 9 samples · 5 unverified · 9 pointer-only (licence)
  In this paper, we propose PreAlign, a framework that establishes multilingual alignment prior to language model pretraining.
• News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation
  18 Jun 2024 1 repository listed
  Rapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations.
• Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer
  25 Apr 2024 1 repository listed
  In this paper, we present a novel framework called "Lexicon-Syntax Enhanced Multilingual BERT" that combines both lexical and syntactic knowledge.
• Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations
  3 Apr 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Zero-Shot Cross-lingual Transfer (ZS-XLT) utilizes a model trained in a source language to make predictions in another language, often with a performance loss.
• AAdaM at SemEval-2024 Task 1: Augmentation and Adaptation for Multilingual Semantic Textual Relatedness
  1 Apr 2024 1 repository listed
  This paper presents our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages.
• An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models
  29 Mar 2024 1 repository listed
  The capacity and effectiveness of pre-trained multilingual models (MLMs) for zero-shot cross-lingual transfer is well established.
• Constrained Decoding for Cross-lingual Label Projection
  5 Feb 2024 1 repository listed Syntology ran 3 of 4 samples · 1 unverified
  Therefore, it is common to exploit translation and label projection to further improve the performance by (1) translating training data that is available in a high-resource language (e.
• The Impact of Language Adapters in Cross-Lingual Transfer for NLU
  31 Jan 2024 1 repository listed
  Modular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages.
• ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks
  29 Jan 2024 1 repository listed
  However, most previous studies primarily focused on sentence-level classification tasks, and only a few considered token-level labeling tasks such as Named Entity Recognition (NER) and Part-of-Speech (POS) tagging.
• Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations
  11 Jan 2024 1 repository listed Syntology ran 7 of 8 samples · 1 unverified · 8 pointer-only (licence)
  While these results are promising, follow-up works found that, within the multilingual embedding spaces, there exists strong language identity information which hinders the expression of linguistic factors shared across…
• ZGUL: Zero-shot Generalization to Unseen Languages using Multi-source Ensembling of Language Adapters
  25 Oct 2023 1 repository listed
  We posit that for more effective cross-lingual transfer, instead of just one source LA, we need to leverage LAs of multiple (linguistically or geographically related) source languages, both at train and test-time -…
• One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfer
  16 Oct 2023 1 repository listed
  Because of this, model selection based on source-language validation is unreliable: it picks model snapshots with suboptimal target-language performance.
• TRAM: Bridging Trust Regions and Sharpness Aware Minimization
  5 Oct 2023 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We propose Trust Region Aware Minimization (TRAM), a SAM algorithm fine-tuning for low parameter sharpness and smooth, informative representations preserving pre-trained structure.
• Contextual Label Projection for Cross-Lingual Structured Prediction
  16 Sep 2023 1 repository listed Syntology ran 10 of 15 samples · 5 unverified · 15 pointer-only (licence)
  Label projection, which involves obtaining translated labels and texts jointly, is essential for leveraging machine translation to facilitate cross-lingual transfer in structured prediction tasks.
• Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding
  15 Jul 2023 1 repository listed
  We conduct comprehensive experiments on diverse cross-lingual language understanding tasks (sentiment classification, paraphrase identification, and natural language inference) and empirically analyze the variation…
• Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributes
  7 Jun 2023 1 repository listed
  This paper proposes Allophant, a multilingual phoneme recognizer.
• Distilling Efficient Language-Specific Models for Cross-Lingual Transfer
  2 Jun 2023 1 repository listed
  Specifically, we use a two-phase distillation approach, termed BiStil: (i) the first phase distils a general bilingual model from the MMT, while (ii) the second, task-specific phase sparsely fine-tunes the bilingual…
• Revisiting non-English Text Simplification: A Unified Multilingual Benchmark
  25 May 2023 1 repository listed
  However, less work has been done on multilingual text simplification due to the lack of a diverse evaluation benchmark that covers complex-simple sentence pairs in many languages.
• mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models
  23 May 2023 1 repository listed
  Recent multilingual pretrained language models (mPLMs) have been shown to encode strong language-specific signals, which are not explicitly provided during pretraining.
• Translation and Fusion Improves Zero-shot Cross-lingual Information Extraction
  23 May 2023 1 repository listed
  Large language models (LLMs) combined with instruction tuning have shown significant progress in information extraction (IE) tasks, exhibiting strong generalization capabilities to unseen datasets by following…
• Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?
  21 Dec 2022 1 repository listed
  We demonstrate that the distance between the distributions of different languages is highly consistent with the syntactic difference in terms of linguistic formalisms.

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.