Pretrained Multilingual Language Models

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

12 shown of 12 papers with code (26 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations
  11 Jan 2024 1 repository listed Syntology ran 7 of 8 samples · 1 unverified · 8 pointer-only (licence)
  While these results are promising, follow-up works found that, within the multilingual embedding spaces, there exists strong language identity information which hinders the expression of linguistic factors shared across…
• Improving Bilingual Lexicon Induction with Cross-Encoder Reranking
  30 Oct 2022 1 repository listed Syntology ran 0 of 4 samples · 4 unverified
  This crucial step is done via 1) creating a word similarity dataset, comprising positive word pairs (i.
• Language Agnostic Multilingual Information Retrieval with Contrastive Learning
  12 Oct 2022 1 repository listed
  Multilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages.
• Are Pretrained Multilingual Models Equally Fair Across Languages?
  11 Oct 2022 1 repository listed
  Pretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower resourced languages.
• Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining
  10 Oct 2022 1 repository listed
  To benchmark the performance of pretrained multilingual language models, we construct noisy datasets covering five languages and four NLP tasks and observe a clear gap in the performance between clean and noisy data in…
• To Adapt or to Fine-tune: A Case Study on Abstractive Summarization
  30 Aug 2022 1 repository listed
  Recent advances in the field of abstractive summarization leverage pre-trained language models rather than train a model from scratch.
• Improving Word Translation via Two-Stage Contrastive Learning
  15 Mar 2022 1 repository listed Syntology ran 5 of 6 samples · 1 unverified · 4 pointer-only (licence)
  At Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
• Improving Word Translation via Two-Stage Contrastive Learning
  16 Nov 2021 1 repository listed
  As Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
• Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages
  1 Nov 2021 1 repository listed
  In this work, we challenge this assumption and present the first attempt at training a multilingual language model on only low-resource languages.
• Specializing Multilingual Language Models: An Empirical Study
  16 Jun 2021 1 repository listed
  Pretrained multilingual language models have become a common tool in transferring NLP capabilities to low-resource languages, often with adaptations.
• Investigating Math Word Problems using Pretrained Multilingual Language Models
  19 May 2021 1 repository listed
  In this paper, we revisit math word problems~(MWPs) from the cross-lingual and multilingual perspective.
• How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
  31 Dec 2020 1 repository listed
  In this work, we provide a systematic and comprehensive empirical comparison of pretrained multilingual language models versus their monolingual counterparts with regard to their monolingual task performance.

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.