Browse State-of-the-Art › Zero-Shot Cross-Lingual Transfer
Zero-Shot Cross-Lingual Transfer
80 papers with code · 2 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| XTREME (25 rows) | Turing ULR v6 | XLM-E: Cross-lingual Language Model Pre-training via ELECTRA | code | — | Compare |
| MaRVL (2 rows) | xUNITER | Visually Grounded Reasoning across Languages and Cultures | code | Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 163 · with a code link: 80 · where Syntology ran a sample: 17 (13 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (17 of 163 tagged: 13 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 163, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
26 Dec 2018 13 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 4 pointer-only (licence)We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
-
30 Jun 2021 3 repositories listedIn this paper, we introduce ELECTRA-style tasks to cross-lingual language model pre-training.
-
14 Oct 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)Both these masks can then be composed with the pretrained model.
-
23 Sep 2021 2 repositories listedRecent progress in self-training, self-supervised pretraining and unsupervised learning enabled well performing speech recognition systems without any labeled data.
-
1 Jan 2020 2 repositories listedHowever, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse…
-
19 Apr 2019 2 repositories listedPretrained contextual representation models (Peters et al., 2018; Devlin et al., 2018) have pushed forward the state-of-the-art on many NLP tasks.
-
17 Dec 2024 1 repository listedA large amount of local and culture-specific knowledge (e. g., people, traditions, food) can only be found in documents written in dialects.
-
4 Oct 2024 1 repository listedTableQA models trained on our large-scale datasets outperform state-of-the-art LLMs.
-
1 Oct 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 5 samples that ran constructed an object rather than computing a result (of 7 harvested samples) · 7 pointer-only (licence)In this study, we propose Cross-Lingual Back-Parsing (CBP), a novel data augmentation methodology designed to enhance cross-lingual transfer for SP.
-
23 Jul 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 9 pointer-only (licence)In this paper, we propose PreAlign, a framework that establishes multilingual alignment prior to language model pretraining.
-
18 Jun 2024 1 repository listedRapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations.
-
25 Apr 2024 1 repository listedIn this paper, we present a novel framework called "Lexicon-Syntax Enhanced Multilingual BERT" that combines both lexical and syntactic knowledge.
-
3 Apr 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Zero-Shot Cross-lingual Transfer (ZS-XLT) utilizes a model trained in a source language to make predictions in another language, often with a performance loss.
-
1 Apr 2024 1 repository listedThis paper presents our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages.
-
29 Mar 2024 1 repository listedThe capacity and effectiveness of pre-trained multilingual models (MLMs) for zero-shot cross-lingual transfer is well established.
-
5 Feb 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Therefore, it is common to exploit translation and label projection to further improve the performance by (1) translating training data that is available in a high-resource language (e. g., English) together with the…
-
31 Jan 2024 1 repository listedModular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages.
-
29 Jan 2024 1 repository listedHowever, most previous studies primarily focused on sentence-level classification tasks, and only a few considered token-level labeling tasks such as Named Entity Recognition (NER) and Part-of-Speech (POS) tagging.
-
11 Jan 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 8 pointer-only (licence)While these results are promising, follow-up works found that, within the multilingual embedding spaces, there exists strong language identity information which hinders the expression of linguistic factors shared across…
-
25 Oct 2023 1 repository listedWe posit that for more effective cross-lingual transfer, instead of just one source LA, we need to leverage LAs of multiple (linguistically or geographically related) source languages, both at train and test-time -…
-
16 Oct 2023 1 repository listedBecause of this, model selection based on source-language validation is unreliable: it picks model snapshots with suboptimal target-language performance.
-
5 Oct 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)We propose Trust Region Aware Minimization (TRAM), a SAM algorithm fine-tuning for low parameter sharpness and smooth, informative representations preserving pre-trained structure.
-
16 Sep 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 15 pointer-only (licence)Label projection, which involves obtaining translated labels and texts jointly, is essential for leveraging machine translation to facilitate cross-lingual transfer in structured prediction tasks.
-
15 Jul 2023 1 repository listedWe conduct comprehensive experiments on diverse cross-lingual language understanding tasks (sentiment classification, paraphrase identification, and natural language inference) and empirically analyze the variation…
-
7 Jun 2023 1 repository listedThis paper proposes Allophant, a multilingual phoneme recognizer.
-
2 Jun 2023 1 repository listedSpecifically, we use a two-phase distillation approach, termed BiStil: (i) the first phase distils a general bilingual model from the MMT, while (ii) the second, task-specific phase sparsely fine-tunes the bilingual…
-
25 May 2023 1 repository listedHowever, less work has been done on multilingual text simplification due to the lack of a diverse evaluation benchmark that covers complex-simple sentence pairs in many languages.
-
23 May 2023 1 repository listedLarge language models (LLMs) combined with instruction tuning have shown significant progress in information extraction (IE) tasks, exhibiting strong generalization capabilities to unseen datasets by following…
-
23 May 2023 1 repository listedRecent multilingual pretrained language models (mPLMs) have been shown to encode strong language-specific signals, which are not explicitly provided during pretraining.
-
21 Dec 2022 1 repository listedWe demonstrate that the distance between the distributions of different languages is highly consistent with the syntactic difference in terms of linguistic formalisms.
-
4 Dec 2022 1 repository listed
-
15 Nov 2022 1 repository listed
-
24 Oct 2022 1 repository listed
-
22 Oct 2022 1 repository listed
-
18 Oct 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
7 Sep 2022 1 repository listed
-
12 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
1 Jun 2022 1 repository listed
-
23 May 2022 1 repository listed
-
23 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
13 Apr 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
13 Apr 2022 1 repository listed
-
3 Apr 2022 1 repository listed
-
19 Mar 2022 1 repository listed
-
18 Mar 2022 1 repository listed
-
15 Mar 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
3 Mar 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
23 Feb 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
21 Dec 2021 1 repository listed
-
28 Nov 2021 1 repository listed
-
1 Nov 2021 1 repository listed
-
1 Nov 2021 1 repository listed
-
13 Sep 2021 1 repository listed
-
2 Sep 2021 1 repository listed
-
2 Sep 2021 1 repository listed
-
7 Aug 2021 1 repository listed
-
3 Jun 2021 1 repository listed
-
20 Apr 2021 1 repository listed
-
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders18 Apr 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
17 Apr 2021 1 repository listed
-
16 Mar 2021 1 repository listed
-
3 Mar 2021 1 repository listed
-
15 Feb 2021 1 repository listed
-
26 Jan 2021 1 repository listed
-
13 Oct 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
13 Oct 2020 1 repository listed
-
6 Oct 2020 1 repository listed
-
10 Sep 2020 1 repository listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
20 Aug 2020 1 repository listed
-
9 May 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
3 May 2020 1 repository listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
5 Mar 2020 1 repository listed
-
30 Jan 2020 1 repository listed
-
23 Sep 2019 1 repository listed
-
15 Sep 2019 1 repository listed
-
11 Sep 2018 1 repository listed
-
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer21 May 2025 0 repositories listed
-
Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model6 Mar 2025 0 repositories listed
-
Zero-shot Cross-lingual Transfer Learning with Multiple Source and Target Languages for Information Extraction: Language Selection and Adversarial Training13 Nov 2024 0 repositories listed
-
Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models2 Oct 2024 0 repositories listed
-
Bridging the Language Gap: Enhancing Multilingual Prompt-Based Code Generation in LLMs via Zero-Shot Cross-Lingual Transfer19 Aug 2024 0 repositories listed
-
Zero-shot Cross-Lingual Transfer for Synthetic Data Generation in Grammatical Error Detection16 Jul 2024 0 repositories listed
-
Cross-Lingual Transfer Learning for Speech Translation1 Jul 2024 0 repositories listed
-
Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability29 Jun 2024 0 repositories listed
-
Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching19 Jun 2024 0 repositories listed
-
Probing the Emergence of Cross-lingual Alignment during LLM Training19 Jun 2024 0 repositories listed
-
Generalization Measures for Zero-Shot Cross-Lingual Transfer24 Apr 2024 0 repositories listed
-
CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scripts19 Apr 2024 0 repositories listed
-
MaiNLP at SemEval-2024 Task 1: Analyzing Source Language Selection in Cross-Lingual Textual Relatedness3 Apr 2024 0 repositories listed
-
Towards Knowledge-Grounded Natural Language Understanding and Generation22 Mar 2024 0 repositories listed
-
Zero-shot cross-lingual transfer in instruction tuning of large language models22 Feb 2024 0 repositories listed
-
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks19 Feb 2024 0 repositories listed
-
Stanceosaurus 2.0: Classifying Stance Towards Russian and Spanish Misinformation6 Feb 2024 0 repositories listed
-
Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization15 Nov 2023 0 repositories listed
-
Zero-Shot Cross-Lingual Sentiment Classification under Distribution Shift: an Exploratory Study11 Nov 2023 0 repositories listed
-
A Multi-Modal Multilingual Benchmark for Document Image Classification25 Oct 2023 0 repositories listed
Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections