Methods › Natural Language Processing › Language Models › XLM-R
XLM-R
Introduced by Alexis Conneau et al. in Unsupervised Cross-lingual Representation Learning at Scale
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
XLM-R
In Syntology repository known, no verified implementation (declared_code; repositories: 5 listed of 35 in the graph, strongest link: official). This answer is about arXiv:1911.02116, the paper the archive credits with this method.
Origin paper of this answer, arXiv:1911.02116 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 40 ran (of which 13 constructed an object rather than computing a result; 35 with no instrument failure: 4 honoured, 1 violated, 30 with no contract checked; 5 where Syntology's instrument failed) · 19 unverified (of 59 harvested samples) · 52 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 176 · with a code link: 80 · where Syntology ran a sample: 14 (10 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (14 of 176 tagged: 10 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 176, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages 15 Feb 2025 · 1 repository · arXiv:2502.10852
-
AmaSQuAD: A Benchmark for Amharic Extractive Question Answering 4 Feb 2025 · 0 repositories · arXiv:2502.02047
-
Evaluating the Effectiveness of XAI Techniques for Encoder-Based Language Models 26 Jan 2025 · 0 repositories · arXiv:2501.15374
-
Comparative Approaches to Sentiment Analysis Using Datasets in Major European and Arabic Languages 21 Jan 2025 · 0 repositories · arXiv:2501.12540
-
Multi-stage Training of Bilingual Islamic LLM for Neural Passage Retrieval 17 Jan 2025 · 0 repositories · arXiv:2501.10175
-
BabyLMs for isiXhosa: Data-Efficient Language Modelling in a Low-Resource Context 7 Jan 2025 · 0 repositories · arXiv:2501.03855
-
On the Applicability of Zero-Shot Cross-Lingual Transfer Learning for Sentiment Classification in Distant Language Pairs 24 Dec 2024 · 1 repository · arXiv:2412.18188
-
Retrofitting Large Language Models with Dynamic Tokenization 27 Nov 2024 · 0 repositories · arXiv:2411.18553
-
Transformer-Based Contextualized Language Models Joint with Neural Networks for Natural Language Inference in Vietnamese 20 Nov 2024 · 0 repositories · arXiv:2411.13407
-
LangSAMP: Language-Script Aware Multilingual Pretraining 26 Sep 2024 · 1 repository · arXiv:2409.18199
-
GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge 26 Sep 2024 · 1 repository · arXiv:2409.18193
-
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval 29 Jul 2024 · 0 repositories · arXiv:2407.19669Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models 27 Jun 2024 · 0 repositories · arXiv:2406.19358
-
Medical Spoken Named Entity Recognition 19 Jun 2024 · 1 repository · arXiv:2406.13337
-
Targeted Multilingual Adaptation for Low-resource Language Families 20 May 2024 · 0 repositories · arXiv:2405.12413
-
Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model 13 Apr 2024 · 0 repositories · arXiv:2404.09045
-
MaiNLP at SemEval-2024 Task 1: Analyzing Source Language Selection in Cross-Lingual Textual Relatedness 3 Apr 2024 · 0 repositories · arXiv:2404.02570
-
CICLe: Conformal In-Context Learning for Largescale Multi-Class Food Risk Classification 18 Mar 2024 · 1 repository · arXiv:2403.11904
-
Machines Do See Color: A Guideline to Classify Different Forms of Racist Discourse in Large Corpora 17 Jan 2024 · 0 repositories · arXiv:2401.09333
-
LinguAlchemy: Fusing Typological and Geographical Elements for Unseen Language Generalization 11 Jan 2024 · 0 repositories · arXiv:2401.06034
-
Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformers 9 Dec 2023 · 0 repositories · arXiv:2312.05671
-
A Text-to-Text Model for Multilingual Offensive Language Identification 6 Dec 2023 · 0 repositories · arXiv:2312.03379
-
KBioXLM: A Knowledge-anchored Biomedical Multilingual Pretrained Language Model 20 Nov 2023 · 1 repository · arXiv:2311.11564
-
MELA: Multilingual Evaluation of Linguistic Acceptability 15 Nov 2023 · 1 repository · arXiv:2311.09033
-
calamanCy: A Tagalog Natural Language Processing Toolkit 13 Nov 2023 · 1 repository · arXiv:2311.07171
-
Zero-Shot Cross-Lingual Sentiment Classification under Distribution Shift: an Exploratory Study 11 Nov 2023 · 0 repositories · arXiv:2311.06549
-
Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering 20 Oct 2023 · 1 repository · arXiv:2310.13583
-
MedAI Dialog Corpus (MEDIC): Zero-Shot Classification of Doctor and AI Responses in Health Consultations 19 Oct 2023 · 0 repositories · arXiv:2310.12489
-
ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing 17 Oct 2023 · 1 repository · arXiv:2310.11166
-
QASiNa: Religious Domain Question Answering using Sirah Nabawiyah 12 Oct 2023 · 1 repository · arXiv:2310.08102
-
Exploring the Maze of Multilingual Modeling 9 Oct 2023 · 0 repositories · arXiv:2310.05404
-
Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi 19 Sep 2023 · 0 repositories · arXiv:2309.10272
-
Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models 17 Aug 2023 · 0 repositories · arXiv:2308.08774Syntology 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 23 harvested samples)
-
Does mBERT understand Romansh? Evaluating word embeddings using word alignment 14 Jun 2023 · 0 repositories · arXiv:2306.08702
-
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers 5 Jun 2023 · 1 repository · arXiv:2306.02790Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer 2 Jun 2023 · 1 repository · arXiv:2306.01709
-
FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models 23 May 2023 · 2 repositories · arXiv:2305.14481
-
ReadMe++: Benchmarking Multilingual Language Models for Multi-Domain Readability Assessment 23 May 2023 · 1 repository · arXiv:2305.14463
-
DUMB: A Benchmark for Smart Evaluation of Dutch Models 22 May 2023 · 2 repositories · arXiv:2305.13026
-
Extrapolating Multilingual Understanding Models as Multilingual Generators 22 May 2023 · 0 repositories · arXiv:2305.13140
-
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain 20 May 2023 · 1 repository · arXiv:2305.12092
-
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages 20 May 2023 · 1 repository · arXiv:2305.12182
-
DN at SemEval-2023 Task 12: Low-Resource Language Text Classification via Multilingual Pretrained Language Model Fine-tuning 4 May 2023 · 0 repositories · arXiv:2305.02607
-
USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NER 4 May 2023 · 0 repositories · arXiv:2305.02517
-
GreekBART: The First Pretrained Greek Sequence-to-Sequence Model 3 Apr 2023 · 2 repositories · arXiv:2304.00869
-
Evaluating the Effectiveness of Pre-trained Language Models in Predicting the Helpfulness of Online Product Reviews 19 Feb 2023 · 1 repository · arXiv:2302.10199
-
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval 3 Feb 2023 · 1 repository · arXiv:2302.01626
-
Multilingual Sentence Transformer as A Multilingual Word Aligner 28 Jan 2023 · 1 repository · arXiv:2301.12140
-
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models 25 Jan 2023 · 3 repositories · arXiv:2301.10472
-
Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension 1 Jan 2023 · 0 repositories · arXiv:2301.00429
-
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue 15 Dec 2022 · 1 repository · arXiv:2212.08054
-
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages 11 Dec 2022 · 1 repository · arXiv:2212.05409
-
Punctuation Restoration for Singaporean Spoken Languages: English, Malay, and Mandarin 10 Dec 2022 · 1 repository · arXiv:2212.05356
-
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer 4 Dec 2022 · 0 repositories · arXiv:2212.01757
-
Compressing Cross-Lingual Multi-Task Models at Qualtrics 29 Nov 2022 · 0 repositories · arXiv:2211.15927
-
X²-VLM: All-In-One Pre-trained Model For Vision-Language Tasks 22 Nov 2022 · 2 repositories · arXiv:2211.12402Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages 21 Nov 2022 · 0 repositories · arXiv:2211.11418
-
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities 12 Nov 2022 · 2 repositories · arXiv:2211.06679Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Collateral facilitation in humans and language models 9 Nov 2022 · 1 repository · arXiv:2211.05198Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection 31 Oct 2022 · 1 repository · arXiv:2210.17190
-
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking 30 Oct 2022 · 1 repository · arXiv:2210.16953Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning 18 Oct 2022 · 1 repository · arXiv:2210.09934
-
Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task 18 Oct 2022 · 1 repository · arXiv:2210.10049
-
Are Pretrained Multilingual Models Equally Fair Across Languages? 11 Oct 2022 · 1 repository · arXiv:2210.05457
-
Disfluency Detection for Vietnamese 1 Oct 2022 · 1 repository
-
How about Time? Probing a Multilingual Language Model for Temporal Relations 1 Oct 2022 · 1 repository
-
Extending Word-Level Quality Estimation for Post-Editing Assistance 23 Sep 2022 · 0 repositories · arXiv:2209.11378
-
SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese 21 Sep 2022 · 0 repositories · arXiv:2209.10482
-
ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification 19 Sep 2022 · 0 repositories · arXiv:2209.09034
-
From Disfluency Detection to Intent Detection and Slot Filling 17 Sep 2022 · 1 repository · arXiv:2209.08359
-
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching 13 Sep 2022 · 1 repository · arXiv:2209.05869
-
Multilingual Bidirectional Unsupervised Translation Through Multilingual Finetuning and Back-Translation 6 Sep 2022 · 1 repository · arXiv:2209.02821
-
Neural Approaches to Multilingual Information Retrieval 3 Sep 2022 · 1 repository · arXiv:2209.01335
-
Investigating Language Relationships in Multilingual Sentence Encoders Through the Lens of Linguistic Typology 1 Sep 2022 · 0 repositories
-
BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification 16 Aug 2022 · 0 repositories · arXiv:2208.07864
-
AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognition 7 Jul 2022 · 0 repositories · arXiv:2207.03422
-
Hitachi at SemEval-2022 Task 2: On the Effectiveness of Span-based Classification Approaches for Multilingual Idiomaticity Detection 1 Jul 2022 · 0 repositories
-
Sliced at SemEval-2022 Task 11: Bigger, Better? Massively Multilingual LMs for Multilingual Complex NER on an Academic GPU Budget 1 Jul 2022 · 0 repositories
-
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems 15 Jun 2022 · 0 repositories · arXiv:2206.07808
-
AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition 1 Jun 2022 · 0 repositories
-
BERTifying Sinhala - A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification 1 Jun 2022 · 1 repository
-
Debating Europe: A Multilingual Multi-Target Stance Classification Dataset of Online Debates 1 Jun 2022 · 0 repositories
-
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models 24 May 2022 · 0 repositories · arXiv:2205.11758
-
The Geometry of Multilingual Language Model Representations 22 May 2022 · 1 repository · arXiv:2205.10964
-
Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language 2 May 2022 · 1 repository · arXiv:2205.01204
-
black[LSCDiscovery shared task] GlossReader at LSCDiscovery: Train to Select a Proper Gloss in English – Discover Lexical Semantic Change in Spanish 1 May 2022 · 0 repositories
-
CUET-NLP@TamilNLP-ACL2022: Multi-Class Textual Emotion Detection from Social Media using Transformer 1 May 2022 · 0 repositories
-
Explaining Classes through Stable Word Attributions 1 May 2022 · 1 repository
-
TeluguNER: Leveraging Multi-Domain Named Entity Recognition with Deep Transformers 1 May 2022 · 0 repositories
-
Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation 1 May 2022 · 1 repository
-
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages 18 Apr 2022 · 6 repositories · arXiv:2204.08582Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer 13 Apr 2022 · 1 repository · arXiv:2204.06457
-
Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change 12 Apr 2022 · 0 repositories · arXiv:2204.05717
-
Factual Consistency of Multilingual Pretrained Language Models 22 Mar 2022 · 1 repository · arXiv:2203.11552
-
Towards Explainable Evaluation Metrics for Natural Language Generation 21 Mar 2022 · 1 repository · arXiv:2203.11131
-
Do Multilingual Language Models Capture Differing Moral Norms? 18 Mar 2022 · 0 repositories · arXiv:2203.09904
-
Combining Static and Contextualised Multilingual Embeddings 17 Mar 2022 · 1 repository · arXiv:2203.09326
-
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure 16 Mar 2022 · 0 repositories · arXiv:2203.08430
-
Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages 3 Mar 2022 · 1 repository · arXiv:2203.01976Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models 20 Jan 2022 · 1 repository · arXiv:2201.08471Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 179 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections