Cross-Lingual Natural Language Inference

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

17 shown of 17 papers with code (31 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 534 repositories listed Syntology ran 204 of 659 samples · 455 unverified · 149 pointer-only (licence)
  We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
• Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
  5 May 2017 23 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Many modern NLP systems rely on word embeddings, previously trained in an unsupervised manner on large corpora, as base features.
• Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
  26 Dec 2018 13 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 4 pointer-only (licence)
  We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
• XNLI: Evaluating Cross-lingual Sentence Representations
  13 Sep 2018 9 repositories listed
  State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models.
• ByT5: Towards a token-free future with pre-trained byte-to-byte models
  28 May 2021 5 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  Most widely-used pre-trained language models operate on sequences of tokens corresponding to word or subword units.
• Rethinking embedding coupling in pre-trained language models
  24 Oct 2020 4 repositories listed
  We re-evaluate the standard practice of sharing weights between input and output embeddings in state-of-the-art pre-trained language models.
• Better Fine-Tuning by Reducing Representational Collapse
  6 Aug 2020 3 repositories listed
  Although widely adopted, existing approaches for fine-tuning pre-trained language models have been shown to be unstable across hyper-parameter settings, motivating recent work on trust region methods.
• Leveraging Entailment Judgements in Cross-Lingual Summarisation
  1 Aug 2024 1 repository listed
  Synthetically created Cross-Lingual Summarisation (CLS) datasets are prone to include document-summary pairs where the reference summary is unfaithful to the corresponding document as it contains content not supported…
• Do Multilingual Language Models Think Better in English?
  2 Aug 2023 1 repository listed Syntology ran 1 of 3 samples · 2 unverified
  In this work, we introduce a new approach called self-translate, which overcomes the need of an external translation system by leveraging the few-shot translation capabilities of multilingual language models.
• Enhancing Cross-lingual Natural Language Inference by Soft Prompting with Multilingual Verbalizer
  22 May 2023 1 repository listed Syntology ran 0 of 4 samples · 4 unverified
  In this paper, we propose a novel Soft prompt learning framework with the Multilingual Verbalizer (SoftMV) for XNLI.
• Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters
  19 May 2022 1 repository listed
  We took natural language processing (NLP) as an example to show how Nebula-I works in different training phases that include: a) pre-training a multilingual language model using two remote clusters; and b) fine-tuning a…
• Enhancing Cross-lingual Natural Language Inference by Prompt-learning from Cross-lingual Templates
  1 May 2022 1 repository listed
  Cross-lingual natural language inference (XNLI) is a fundamental task in cross-lingual natural language understanding.
• Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and Understanding
  16 Apr 2022 1 repository listed
  For multilingual sequence-to-sequence pretrained language models (multilingual Seq2Seq PLMs), e.
• mGPT: Few-Shot Learners Go Multilingual
  15 Apr 2022 1 repository listed
  Recent studies report that autoregressive language models can successfully solve many NLP tasks via zero- and few-shot learning paradigms, which opens up new possibilities for using the pre-trained language models.
• Subword Mapping and Anchoring across Languages
  9 Sep 2021 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  State-of-the-art multilingual systems rely on shared vocabularies that sufficiently cover all considered languages.
• PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining
  4 Aug 2021 1 repository listed
  Despite the success of multilingual sequence-to-sequence pretraining, most existing approaches rely on monolingual corpora, and do not make use of the strong cross-lingual signal contained in parallel data.
• Language Embeddings for Typology and Cross-lingual Transfer Learning
  3 Jun 2021 1 repository listed
  Cross-lingual language tasks typically require a substantial amount of annotated data or parallel translation data.

Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.