Methods › Natural Language Processing › Language Models › mBART
mBART
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
mBART is a sequence-to-sequence denoising auto-encoder pre-trained on large-scale monolingual corpora in many languages using the BART objective. The input texts are noised by masking phrases and permuting sentences, and a single Transformer model is learned to recover the texts. Different from other pre-training approaches for machine translation, mBART pre-trains a complete autoregressive Seq2Seq model. mBART is trained once for all languages, providing a set of parameters that can be fine-tuned for any of the language pairs in both supervised and unsupervised settings, without any task-specific or language-specific modifications or initialization schemes.
In Syntology the paper matched by title, arXiv:1612.01619, held, no code (no_code; paper_only). The lookup matched a paper by its title, arXiv:1612.01619, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:1612.01619) is about this method is not checked; it does not say whether this method has code.
Origin paper of this answer, arXiv:1612.01619 (its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 66 · with a code link: 32 · where Syntology ran a sample: 6 (4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 66 tagged: 4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 66 of 66, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
State-of-the-Art Translation of Text-to-Gloss using mBART : A case study of Bangla 3 Apr 2025 · 0 repositories · arXiv:2504.02293
-
BeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusion 2 Jan 2025 · 1 repository · arXiv:2501.01069
-
SiTSE: Sinhala Text Simplification Dataset and Evaluation 2 Dec 2024 · 1 repository · arXiv:2412.01293
-
Abstractive Summarization of Low resourced Nepali language using Multilingual Transformers 29 Sep 2024 · 0 repositories · arXiv:2409.19566
-
Exploring Fine-tuned Generative Models for Keyphrase Selection: A Case Study for Russian 16 Sep 2024 · 0 repositories · arXiv:2409.10640
-
Segment-Based Interactive Machine Translation for Pre-trained Models 9 Jul 2024 · 0 repositories · arXiv:2407.06990
-
NAIST Simultaneous Speech Translation System for IWSLT 2024 30 Jun 2024 · 0 repositories · arXiv:2407.00826
-
CantonMT: Cantonese to English NMT Platform with Fine-Tuned Models Using Synthetic Back-Translation Data 17 Mar 2024 · 1 repository · arXiv:2403.11346
-
VBART: The Turkish LLM 2 Mar 2024 · 0 repositories · arXiv:2403.01308
-
Transcription and translation of videos using fine-tuned XLSR Wav2Vec2 on custom dataset and mBART 1 Mar 2024 · 0 repositories · arXiv:2403.00212
-
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks 19 Feb 2024 · 0 repositories · arXiv:2402.12279
-
End to end Hindi to English speech conversion using Bark, mBART and a finetuned XLSR Wav2Vec2 11 Jan 2024 · 0 repositories · arXiv:2401.06183
-
Exploring Automatic Text Simplification of German Narrative Documents 15 Dec 2023 · 1 repository · arXiv:2312.09907
-
Context-aware Neural Machine Translation for English-Japanese Business Scene Dialogues 20 Nov 2023 · 1 repository · arXiv:2311.11976
-
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation 15 Oct 2023 · 0 repositories · arXiv:2310.09917
-
Direct Text to Speech Translation System using Acoustic Units 14 Sep 2023 · 0 repositories · arXiv:2309.07478
-
Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish 13 Sep 2023 · 1 repository · arXiv:2309.06698
-
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation 29 Aug 2023 · 1 repository · arXiv:2308.15226Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
VBD-MT Chinese-Vietnamese Translation Systems for VLSP 2022 15 Aug 2023 · 0 repositories · arXiv:2308.07601
-
Binary and Ternary Natural Language Generation 2 Jun 2023 · 1 repository · arXiv:2306.01841Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Improving Polish to English Neural Machine Translation with Transfer Learning: Effects of Data Volume and Language Similarity 1 Jun 2023 · 0 repositories · arXiv:2306.00660
-
DEPLAIN: A German Parallel Corpus with Intralingual Translations into Plain Language for Sentence and Document Simplification 30 May 2023 · 1 repository · arXiv:2305.18939
-
Enhancing Translation for Indigenous Languages: Experiments with Multilingual Models 27 May 2023 · 0 repositories · arXiv:2305.17406
-
Extrapolating Multilingual Understanding Models as Multilingual Generators 22 May 2023 · 0 repositories · arXiv:2305.13140
-
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences 18 May 2023 · 1 repository · arXiv:2305.11129
-
Towards Speech Dialogue Translation Mediating Speakers of Different Languages 16 May 2023 · 1 repository · arXiv:2305.09210
-
Prompt-Learning for Cross-Lingual Relation Extraction 20 Apr 2023 · 1 repository · arXiv:2304.10354
-
Neural Machine Translation For Low Resource Languages 16 Apr 2023 · 1 repository · arXiv:2304.07869
-
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation 3 Apr 2023 · 1 repository · arXiv:2304.01282
-
Summarizing Indian Languages using Multilingual Transformers based Models 29 Mar 2023 · 0 repositories · arXiv:2303.16657
-
Patient-friendly Clinical Notes: Towards a new Text Simplification Dataset 7 Dec 2022 · 1 repository
-
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer 4 Dec 2022 · 0 repositories · arXiv:2212.01757
-
Gui at MixMT 2022 : English-Hinglish: An MT approach for translation of code mixed data 21 Oct 2022 · 0 repositories · arXiv:2210.12215
-
Silo NLP's Participation at WAT2022 2 Aug 2022 · 1 repository · arXiv:2208.01296
-
Effectiveness of French Language Models on Abstractive Dialogue Summarization Task 17 Jul 2022 · 0 repositories · arXiv:2207.08305
-
Two New Datasets for Italian-Language Abstractive Text Summarization 29 Apr 2022 · 1 repository
-
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and Understanding 16 Apr 2022 · 1 repository · arXiv:2204.07834
-
AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization 21 Mar 2022 · 0 repositories · arXiv:2203.10945
-
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models 17 Mar 2022 · 1 repository · arXiv:2203.09397Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfer 16 Mar 2022 · 1 repository · arXiv:2203.08552
-
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? 16 Mar 2022 · 0 repositories · arXiv:2203.08850
-
Improving Neural Machine Translation by Denoising Training 19 Jan 2022 · 0 repositories · arXiv:2201.07365
-
AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization 16 Jan 2022 · 0 repositories
-
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation 16 Jan 2022 · 0 repositories
-
Multilingual pre-training with Language and Task Adaptation for Multilingual Text Style Transfer 16 Nov 2021 · 0 repositories
-
Sequence-to-Sequence Multilingual Pre-Trained Models: A Hope for Low-Resource Language Translation? 16 Nov 2021 · 0 repositories
-
PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation 23 Oct 2021 · 1 repository · arXiv:2110.12199
-
mRAT-SQL+GAP:A Portuguese Text-to-SQL Transformer 7 Oct 2021 · 2 repositories · arXiv:2110.03546
-
Sequence-to-Sequence Lexical Normalization with Multilingual Transformers 6 Oct 2021 · 0 repositories · arXiv:2110.02869
-
BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese 20 Sep 2021 · 3 repositories · arXiv:2109.09701
-
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models 1 Aug 2021 · 0 repositories
-
Don't Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data 12 Jun 2021 · 0 repositories · arXiv:2106.06875
-
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation 3 Jun 2021 · 1 repository · arXiv:2106.01597Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Lightweight Adapter Tuning for Multilingual Speech Translation 2 Jun 2021 · 2 repositories · arXiv:2106.01463
-
ViTA: Visual-Linguistic Translation by Aligning Object Tags 1 Jun 2021 · 1 repository · arXiv:2106.00250
-
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation 20 May 2021 · 3 repositories · arXiv:2105.09501
-
Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translation 9 May 2021 · 0 repositories · arXiv:2105.03953
-
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders 18 Apr 2021 · 1 repository · arXiv:2104.08757Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
GupShup: An Annotated Corpus for Abstractive Summarization of Open-Domain Code-Switched Conversations 17 Apr 2021 · 0 repositories · arXiv:2104.08578
-
Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions 16 Nov 2020 · 0 repositories · arXiv:2011.07933
-
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models 24 Oct 2020 · 0 repositories · arXiv:2010.12829
-
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning 2 Aug 2020 · 6 repositories · arXiv:2008.00401Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Dataset for Automatic Summarization of Russian News 19 Jun 2020 · 2 repositories · arXiv:2006.11063
-
Cross-lingual Retrieval for Iterative Self-Supervised Training 16 Jun 2020 · 1 repository · arXiv:2006.09526
-
Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation 30 Apr 2020 · 0 repositories · arXiv:2004.14911
-
Multilingual Denoising Pre-training for Neural Machine Translation 22 Jan 2020 · 8 repositories · arXiv:2001.08210
Tasks archive 2025-07-28
20 shown of 76 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections