Methods › Natural Language Processing › Language Models › mT5
mT5
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
mt5 is a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering $101$ languages.
In Syntology name not resolved (unknown_name). Other entries in Syntology's graph carry this name; the lookup's note below says what that means for this name.
From the lookup's note on this name: Nothing resolved to this name, but 2 entries in Syntology's graph carry it; the most cited is the paper “mT5: A massively multilingual pre-trained text-to-text transformer” (arXiv:2010.11934, 3,342 citations). The lookup reads this as a miss of its own name matching, not a gap in coverage: the graph holds the name under a spelling the lookup did not reach. For arXiv:2010.11934: its page on this site · ask the lookup about it.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 104 · with a code link: 48 · where Syntology ran a sample: 10 (7 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (10 of 104 tagged: 7 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 104, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Advancing Sentiment Analysis in Tamil-English Code-Mixed Texts: Challenges and Transformer-Based Solutions 30 Mar 2025 · 0 repositories · arXiv:2503.23295
-
Exploring Robustness of Multilingual LLMs on Real-World Noisy Data 14 Jan 2025 · 1 repository · arXiv:2501.08322
-
Bridging Dialects: Translating Standard Bangla to Regional Variants Using Neural Models 10 Jan 2025 · 0 repositories · arXiv:2501.05749
-
Empowering Bengali Education with AI: Solving Bengali Math Word Problems through Transformer Models 5 Jan 2025 · 0 repositories · arXiv:2501.02599
-
BeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusion 2 Jan 2025 · 1 repository · arXiv:2501.01069
-
HAND: Hierarchical Attention Network for Multi-Scale Handwritten Document Recognition and Layout Analysis 25 Dec 2024 · 0 repositories · arXiv:2412.18981
-
Advancing Explainability in Neural Machine Translation: Analytical Metrics for Attention and Alignment Consistency 24 Dec 2024 · 0 repositories · arXiv:2412.18669
-
The First Multilingual Model For The Detection of Suicide Texts 20 Dec 2024 · 0 repositories · arXiv:2412.15498
-
Neural Text Normalization for Luxembourgish using Real-Life Variation Data 12 Dec 2024 · 0 repositories · arXiv:2412.09383
-
SiTSE: Sinhala Text Simplification Dataset and Evaluation 2 Dec 2024 · 1 repository · arXiv:2412.01293
-
Towards Santali Linguistic Inclusion: Building the First Santali-to-English Translation Model using mT5 Transformer and Data Augmentation 29 Nov 2024 · 0 repositories · arXiv:2411.19726
-
Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland 17 Oct 2024 · 0 repositories · arXiv:2410.13456
-
Tokenization and Morphology in Multilingual Language Models: A Comparative Analysis of mT5 and ByT5 15 Oct 2024 · 0 repositories · arXiv:2410.11627
-
Abstractive Summarization of Low resourced Nepali language using Multilingual Transformers 29 Sep 2024 · 0 repositories · arXiv:2409.19566
-
MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions 19 Sep 2024 · 1 repository · arXiv:2409.12958
-
Exploring Fine-tuned Generative Models for Keyphrase Selection: A Case Study for Russian 16 Sep 2024 · 0 repositories · arXiv:2409.10640
-
On Initializing Transformers with Pre-trained Embeddings 17 Jul 2024 · 0 repositories · arXiv:2407.12514
-
Segment-Based Interactive Machine Translation for Pre-trained Models 9 Jul 2024 · 0 repositories · arXiv:2407.06990
-
Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation 8 Jul 2024 · 0 repositories · arXiv:2407.06048
-
The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models 27 Jun 2024 · 0 repositories · arXiv:2406.19358
-
UQA: Corpus for Urdu Question Answering 2 May 2024 · 3 repositories · arXiv:2405.01458
-
TuBA: Cross-Lingual Transferability of Backdoor Attacks in LLMs with Instruction Tuning 30 Apr 2024 · 0 repositories · arXiv:2404.19597
-
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages 25 Apr 2024 · 1 repository · arXiv:2404.16816
-
HLTCOE at TREC 2023 NeuCLIR Track 11 Apr 2024 · 0 repositories · arXiv:2404.08118
-
Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain 11 Apr 2024 · 0 repositories · arXiv:2404.07613
-
Data Bias According to Bipol: Men are Naturally Right and It is the Role of Women to Follow Their Lead 7 Apr 2024 · 1 repository · arXiv:2404.04838
-
Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations 3 Apr 2024 · 1 repository · arXiv:2404.02452Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Transcribing Bengali Text with Regional Dialects to IPA using District Guided Tokens 26 Mar 2024 · 0 repositories · arXiv:2403.17407
-
Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts dataset 18 Mar 2024 · 2 repositories · arXiv:2403.12212
-
Basque and Spanish Counter Narrative Generation: Data Creation and Evaluation 14 Mar 2024 · 0 repositories · arXiv:2403.09159
-
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks 19 Feb 2024 · 0 repositories · arXiv:2402.12279
-
InkSight: Offline-to-Online Handwriting Conversion by Learning to Read and Write 8 Feb 2024 · 1 repository · arXiv:2402.05804
-
ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks 29 Jan 2024 · 1 repository · arXiv:2401.16589
-
LangBridge: Multilingual Reasoning Without Multilingual Supervision 19 Jan 2024 · 1 repository · arXiv:2401.10695Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Mapping Transformer Leveraged Embeddings for Cross-Lingual Document Representation 12 Jan 2024 · 1 repository · arXiv:2401.06583
-
Multilingual large language models leak human stereotypes across language boundaries 12 Dec 2023 · 1 repository · arXiv:2312.07141
-
A Text-to-Text Model for Multilingual Offensive Language Identification 6 Dec 2023 · 0 repositories · arXiv:2312.03379
-
Vashantor: A Large-scale Multilingual Benchmark Dataset for Automated Translation of Bangla Regional Dialects to Bangla Language 18 Nov 2023 · 1 repository · arXiv:2311.11142
-
FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization 3 Nov 2023 · 1 repository · arXiv:2311.02271Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
Indo LEGO-ABSA: A Multitask Generative Aspect Based Sentiment Analysis for Indonesian Language 3 Nov 2023 · 1 repository · arXiv:2311.01757
-
Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering 20 Oct 2023 · 1 repository · arXiv:2310.13583
-
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation 15 Oct 2023 · 0 repositories · arXiv:2310.09917
-
CAPP-130: A Corpus of Chinese Application Privacy Policy Summarization and Interpretation 26 Sep 2023 · 1 repository
-
Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish 13 Sep 2023 · 1 repository · arXiv:2309.06698
-
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations 23 May 2023 · 0 repositories · arXiv:2305.14224
-
ReadMe++: Benchmarking Multilingual Language Models for Multi-Domain Readability Assessment 23 May 2023 · 1 repository · arXiv:2305.14463
-
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences 18 May 2023 · 1 repository · arXiv:2305.11129
-
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation 3 Apr 2023 · 1 repository · arXiv:2304.01282
-
Summarizing Indian Languages using Multilingual Transformers based Models 29 Mar 2023 · 0 repositories · arXiv:2303.16657
-
NeuralMind-UNICAMP at 2022 TREC NeuCLIR: Large Boring Rerankers for Cross-lingual Retrieval 28 Mar 2023 · 1 repository · arXiv:2303.16145
-
PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs 15 Mar 2023 · 1 repository · arXiv:2303.08954
-
Are Character-level Translations Worth the Wait? Comparing ByT5 and mT5 for Machine Translation 28 Feb 2023 · 1 repository · arXiv:2302.14220
-
EVJVQA Challenge: Multilingual Visual Question Answering 23 Feb 2023 · 0 repositories · arXiv:2302.11752
-
idT5: Indonesian Version of Multilingual T5 Transformer 2 Feb 2023 · 0 repositories · arXiv:2302.00856
-
HunSum-1: an Abstractive Summarization Dataset for Hungarian 1 Feb 2023 · 1 repository · arXiv:2302.00455
-
Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark Datasets 28 Jan 2023 · 2 repositories · arXiv:2301.12139
-
ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models 20 Dec 2022 · 1 repository · arXiv:2212.10474Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Mu²SLAM: Multitask, Multilingual Speech and Language Models 19 Dec 2022 · 0 repositories · arXiv:2212.09553
-
Multilingual Sequence-to-Sequence Models for Hebrew NLP 19 Dec 2022 · 0 repositories · arXiv:2212.09682
-
Evaluating Byte and Wordpiece Level Models for Massively Multilingual Semantic Parsing 14 Dec 2022 · 0 repositories · arXiv:2212.07223
-
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics 12 Dec 2022 · 2 repositories · arXiv:2212.05726
-
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer 4 Dec 2022 · 0 repositories · arXiv:2212.01757
-
GLAMI-1M: A Multilingual Image-Text Fashion Dataset 17 Nov 2022 · 1 repository · arXiv:2211.14451
-
Unified Question Answering in Slovene 16 Nov 2022 · 1 repository · arXiv:2211.09159
-
Crosslingual Generalization through Multitask Finetuning 3 Nov 2022 · 1 repository · arXiv:2211.01786Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Two-stage LLM Fine-tuning with Less Specialization and More Generalization 1 Nov 2022 · 0 repositories · arXiv:2211.00635
-
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning 26 Oct 2022 · 0 repositories · arXiv:2210.14867
-
SLING: Sino Linguistic Evaluation of Large Language Models 21 Oct 2022 · 1 repository · arXiv:2210.11689Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
-
Tone prediction and orthographic conversion for Basaa 13 Oct 2022 · 0 repositories · arXiv:2210.06986
-
Are Pretrained Multilingual Models Equally Fair Across Languages? 11 Oct 2022 · 1 repository · arXiv:2210.05457
-
Bidirectional Language Models Are Also Few-shot Learners 29 Sep 2022 · 0 repositories · arXiv:2209.14500
-
XF2T: Cross-lingual Fact-to-Text Generation for Low-Resource Languages 22 Sep 2022 · 0 repositories · arXiv:2209.11252
-
MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages 27 Aug 2022 · 1 repository · arXiv:2208.13078
-
A Boring-yet-effective Approach for the Product Ranking Task of the Amazon KDD Cup 2022 9 Aug 2022 · 0 repositories · arXiv:2208.06264
-
Effectiveness of French Language Models on Abstractive Dialogue Summarization Task 17 Jul 2022 · 0 repositories · arXiv:2207.08305
-
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems 15 Jun 2022 · 0 repositories · arXiv:2206.07808
-
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models 24 May 2022 · 1 repository · arXiv:2205.12247
-
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla 23 May 2022 · 2 repositories · arXiv:2205.11081
-
Evaluation of Transfer Learning for Polish with a Text-to-Text Model 18 May 2022 · 0 repositories · arXiv:2205.08808
-
Towards Arabic Sentence Simplification via Classification and Generative Approaches 20 Apr 2022 · 0 repositories · arXiv:2204.09292
-
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages 18 Apr 2022 · 6 repositories · arXiv:2204.08582Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
WordAlchemy: A transformer-based Reverse Dictionary 16 Apr 2022 · 0 repositories · arXiv:2204.10181
-
ByT5 model for massively multilingual grapheme-to-phoneme conversion 6 Apr 2022 · 1 repository · arXiv:2204.03067
-
AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization 21 Mar 2022 · 0 repositories · arXiv:2203.10945
-
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models 17 Mar 2022 · 1 repository · arXiv:2203.09397Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All 16 Jan 2022 · 0 repositories
-
AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization 16 Jan 2022 · 0 repositories
-
Are Pretrained Multilingual Models Equally Fair Across Languages? 16 Jan 2022 · 0 repositories
-
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation 16 Jan 2022 · 0 repositories
-
Exploring the Low-Resource Transfer-Learning with mT5 model 16 Jan 2022 · 0 repositories
-
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs 16 Dec 2021 · 1 repository · arXiv:2112.08804
-
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All 15 Dec 2021 · 0 repositories · arXiv:2112.08333
-
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models 16 Nov 2021 · 0 repositories
-
Calculating Question Similarity is Enough: A New Method for KBQA Tasks 15 Nov 2021 · 0 repositories · arXiv:2111.07658
-
Evaluation of Transfer Learning for Polish with a text-to-text model 16 Oct 2021 · 0 repositories
-
AraT5: Text-to-Text Transformers for Arabic Language Generation 31 Aug 2021 · 1 repository · arXiv:2109.12068
-
nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? 1 Aug 2021 · 0 repositories
-
XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages 25 Jun 2021 · 2 repositories · arXiv:2106.13822Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
CPM-2: Large-scale Cost-effective Pre-trained Language Models 20 Jun 2021 · 2 repositories · arXiv:2106.10715
-
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? 3 Jun 2021 · 0 repositories · arXiv:2106.02171
Tasks archive 2025-07-28
20 shown of 133 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections