Methods › Natural Language Processing › Language Models › mBERT
mBERT
Introduced by Jacob Devlin et al. in BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
mBERT
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: E-MBERT.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 198 · with a code link: 98 · where Syntology ran a sample: 10 (10 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (10 of 198 tagged: 10 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 198, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
How do datasets, developers, and models affect biases in a low-resourced language? 7 Jun 2025 · 0 repositories · arXiv:2506.06816
-
University of Indonesia at SemEval-2025 Task 11: Evaluating State-of-the-Art Encoders for Multi-Label Emotion Detection 22 May 2025 · 0 repositories · arXiv:2505.16460
-
Cross-Linguistic Transfer in Multilingual NLP: The Role of Language Families and Morphology 20 May 2025 · 0 repositories · arXiv:2505.13908
-
Generating Synthetic Oracle Datasets to Analyze Noise Impact: A Study on Building Function Classification Using Tweets 28 Mar 2025 · 0 repositories · arXiv:2503.22856
-
Comparative Approaches to Sentiment Analysis Using Datasets in Major European and Arabic Languages 21 Jan 2025 · 0 repositories · arXiv:2501.12540
-
The First Multilingual Model For The Detection of Suicide Texts 20 Dec 2024 · 0 repositories · arXiv:2412.15498
-
Transformer-Based Contextualized Language Models Joint with Neural Networks for Natural Language Inference in Vietnamese 20 Nov 2024 · 0 repositories · arXiv:2411.13407
-
From N-grams to Pre-trained Multilingual Models For Language Identification 11 Oct 2024 · 2 repositories · arXiv:2410.08728
-
Motamot: A Dataset for Revealing the Supremacy of Large Language Models over Transformer Models in Bengali Political Sentiment Analysis 28 Jul 2024 · 1 repository · arXiv:2407.19528
-
On Initializing Transformers with Pre-trained Embeddings 17 Jul 2024 · 0 repositories · arXiv:2407.12514
-
Decipherment-Aware Multilingual Learning in Jointly Trained Language Models 11 Jun 2024 · 0 repositories · arXiv:2406.07231
-
Vietnamese AI Generated Text Detection 6 May 2024 · 0 repositories · arXiv:2405.03206
-
Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study 5 May 2024 · 1 repository · arXiv:2405.02937
-
UQA: Corpus for Urdu Question Answering 2 May 2024 · 3 repositories · arXiv:2405.01458
-
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer 25 Apr 2024 · 1 repository · arXiv:2404.16627
-
Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model 13 Apr 2024 · 0 repositories · arXiv:2404.09045
-
Data Bias According to Bipol: Men are Naturally Right and It is the Role of Women to Follow Their Lead 7 Apr 2024 · 1 repository · arXiv:2404.04838
-
Large Language Models for Expansion of Spoken Language Understanding Systems to New Languages 3 Apr 2024 · 1 repository · arXiv:2404.02588
-
A Benchmark Evaluation of Clinical Named Entity Recognition in French 28 Mar 2024 · 0 repositories · arXiv:2403.19726
-
Introducing Syllable Tokenization for Low-resource Languages: A Case Study with Swahili 26 Mar 2024 · 0 repositories · arXiv:2406.15358
-
Ax-to-Grind Urdu: Benchmark Dataset for Urdu Fake News Detection 20 Mar 2024 · 1 repository · arXiv:2403.14037
-
LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression 19 Mar 2024 · 1 repository · arXiv:2403.12968
-
Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts dataset 18 Mar 2024 · 2 repositories · arXiv:2403.12212
-
A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Sets 6 Mar 2024 · 1 repository · arXiv:2403.03909
-
Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models 16 Feb 2024 · 0 repositories · arXiv:2402.10772
-
Cross-lingual Editing in Multilingual Language Models 19 Jan 2024 · 1 repository · arXiv:2401.10521
-
LinguAlchemy: Fusing Typological and Geographical Elements for Unseen Language Generalization 11 Jan 2024 · 0 repositories · arXiv:2401.06034
-
Multilingual large language models leak human stereotypes across language boundaries 12 Dec 2023 · 1 repository · arXiv:2312.07141
-
On Significance of Subword tokenization for Low Resource and Efficient Named Entity Recognition: A case study in Marathi 3 Dec 2023 · 0 repositories · arXiv:2312.01306
-
Vashantor: A Large-scale Multilingual Benchmark Dataset for Automated Translation of Bangla Regional Dialects to Bangla Language 18 Nov 2023 · 1 repository · arXiv:2311.11142
-
calamanCy: A Tagalog Natural Language Processing Toolkit 13 Nov 2023 · 1 repository · arXiv:2311.07171
-
Zero-Shot Cross-Lingual Sentiment Classification under Distribution Shift: an Exploratory Study 11 Nov 2023 · 0 repositories · arXiv:2311.06549
-
Investigating Bias in Multilingual Language Models: Cross-Lingual Transfer of Debiasing Techniques 16 Oct 2023 · 1 repository · arXiv:2310.10310
-
QASiNa: Religious Domain Question Answering using Sirah Nabawiyah 12 Oct 2023 · 1 repository · arXiv:2310.08102
-
Exploring the Maze of Multilingual Modeling 9 Oct 2023 · 0 repositories · arXiv:2310.05404
-
Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi 19 Sep 2023 · 0 repositories · arXiv:2309.10272
-
Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models 17 Aug 2023 · 0 repositories · arXiv:2308.08774Syntology 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 23 harvested samples)
-
Tackling Fake News in Bengali: Unraveling the Impact of Summarization vs. Augmentation on Pre-trained Language Models 13 Jul 2023 · 1 repository · arXiv:2307.06979
-
AI-UPV at EXIST 2023 -- Sexism Characterization Using Large Language Models Under The Learning with Disagreements Regime 7 Jul 2023 · 1 repository · arXiv:2307.03385
-
Multilingual Multiword Expression Identification Using Lateral Inhibition and Domain Adaptation 17 Jun 2023 · 0 repositories · arXiv:2306.10419
-
Does mBERT understand Romansh? Evaluating word embeddings using word alignment 14 Jun 2023 · 0 repositories · arXiv:2306.08702
-
DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models 8 Jun 2023 · 1 repository · arXiv:2306.05076
-
A Technical Report for Polyglot-Ko: Open-Source Large-Scale Korean Language Models 4 Jun 2023 · 0 repositories · arXiv:2306.02254
-
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer 2 Jun 2023 · 1 repository · arXiv:2306.01709
-
FEED PETs: Further Experimentation and Expansion on the Disambiguation of Potentially Euphemistic Terms 31 May 2023 · 0 repositories · arXiv:2306.00217
-
Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Data 25 May 2023 · 0 repositories · arXiv:2305.15722
-
Assessing Linguistic Generalisation in Language Models: A Dataset for Brazilian Portuguese 23 May 2023 · 0 repositories · arXiv:2305.14070
-
LLM-powered Data Augmentation for Enhanced Cross-lingual Performance 23 May 2023 · 1 repository · arXiv:2305.14288
-
ReadMe++: Benchmarking Multilingual Language Models for Multi-Domain Readability Assessment 23 May 2023 · 1 repository · arXiv:2305.14463
-
Natural Language Processing and Sentiment Analysis on Bangla Social Media Comments on Russia–Ukraine War Using Transformers 4 May 2023 · 1 repository
-
evaluating bert and parsbert for analyzing persian advertisement data 3 May 2023 · 0 repositories · arXiv:2305.02426
-
Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese 18 Apr 2023 · 0 repositories · arXiv:2304.08823
-
SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classification 16 Mar 2023 · 1 repository · arXiv:2303.09421
-
Impact of Subword Pooling Strategy on Cross-lingual Event Detection 22 Feb 2023 · 1 repository · arXiv:2302.11365
-
Hate Speech and Offensive Language Detection using an Emotion-aware Shared Encoder 17 Feb 2023 · 0 repositories · arXiv:2302.08777
-
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval 3 Feb 2023 · 1 repository · arXiv:2302.01626
-
Multilingual Sentence Transformer as A Multilingual Word Aligner 28 Jan 2023 · 1 repository · arXiv:2301.12140
-
Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension 1 Jan 2023 · 0 repositories · arXiv:2301.00429
-
MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning 23 Dec 2022 · 1 repository · arXiv:2212.12510
-
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT 22 Dec 2022 · 0 repositories · arXiv:2212.11456
-
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? 21 Dec 2022 · 1 repository · arXiv:2212.10879
-
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages 20 Dec 2022 · 1 repository · arXiv:2212.10168
-
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue 15 Dec 2022 · 1 repository · arXiv:2212.08054
-
Patient-friendly Clinical Notes: Towards a new Text Simplification Dataset 7 Dec 2022 · 1 repository
-
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer 4 Dec 2022 · 0 repositories · arXiv:2212.01757
-
Compressing Cross-Lingual Multi-Task Models at Qualtrics 29 Nov 2022 · 0 repositories · arXiv:2211.15927
-
Intriguing Properties of Compression on Multilingual Models 4 Nov 2022 · 0 repositories · arXiv:2211.02738
-
IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection 31 Oct 2022 · 1 repository · arXiv:2210.17190
-
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation 24 Oct 2022 · 2 repositories · arXiv:2210.13236
-
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning 18 Oct 2022 · 1 repository · arXiv:2210.09934
-
Are Pretrained Multilingual Models Equally Fair Across Languages? 11 Oct 2022 · 1 repository · arXiv:2210.05457
-
Better Than Whitespace: Information Retrieval for Languages without Custom Tokenizers 11 Oct 2022 · 0 repositories · arXiv:2210.05481
-
Extending Word-Level Quality Estimation for Post-Editing Assistance 23 Sep 2022 · 0 repositories · arXiv:2209.11378
-
ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification 19 Sep 2022 · 0 repositories · arXiv:2209.09034
-
Massively Multilingual Lexical Specialization of Multilingual Transformers 1 Aug 2022 · 0 repositories · arXiv:2208.01018
-
Integrating Linguistic Theory and Neural Language Models 20 Jul 2022 · 1 repository · arXiv:2207.09643
-
Multilingual Transformers for Product Matching -- Experiments and a New Benchmark in Polish 31 May 2022 · 0 repositories · arXiv:2205.15712
-
Discovering Language-neutral Sub-networks in Multilingual Language Models 25 May 2022 · 1 repository · arXiv:2205.12672
-
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models 24 May 2022 · 1 repository · arXiv:2205.12247
-
Sample Efficient Approaches for Idiomaticity Detection 23 May 2022 · 0 repositories · arXiv:2205.11306
-
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese 21 May 2022 · 1 repository · arXiv:2205.10517
-
Persian Natural Language Inference: A Meta-learning approach 18 May 2022 · 1 repository · arXiv:2205.08755
-
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT 17 May 2022 · 0 repositories · arXiv:2205.08497
-
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages 12 May 2022 · 0 repositories · arXiv:2205.06356
-
Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language 2 May 2022 · 1 repository · arXiv:2205.01204
-
yosm: A new yoruba sentiment corpus for movie reviews 20 Apr 2022 · 1 repository · arXiv:2204.09711
-
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi 19 Apr 2022 · 0 repositories · arXiv:2204.08669
-
Evaluation Benchmarks for Spanish Sentence Representations 15 Apr 2022 · 1 repository · arXiv:2204.07571
-
Latent Aspect Detection from Online Unsolicited Customer Reviews 14 Apr 2022 · 1 repository · arXiv:2204.06964
-
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer 13 Apr 2022 · 1 repository · arXiv:2204.06457
-
L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models 12 Apr 2022 · 1 repository · arXiv:2204.06029
-
MuCoT: Multilingual Contrastive Training for Question-Answering in Low-resource Languages 12 Apr 2022 · 1 repository · arXiv:2204.05814
-
Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension 3 Apr 2022 · 1 repository · arXiv:2204.00996
-
bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Comments 27 Mar 2022 · 1 repository · arXiv:2203.14267
-
L3Cube-MahaHate: A Tweet-based Marathi Hate Speech Detection Dataset and BERT models 25 Mar 2022 · 1 repository · arXiv:2203.13778
-
Factual Consistency of Multilingual Pretrained Language Models 22 Mar 2022 · 1 repository · arXiv:2203.11552
-
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure 16 Mar 2022 · 0 repositories · arXiv:2203.08430
-
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning 16 Mar 2022 · 1 repository · arXiv:2203.08555
-
Improving Word Translation via Two-Stage Contrastive Learning 15 Mar 2022 · 1 repository · arXiv:2203.08307Syntology official (archive's flag): 2 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 4 pointer-only (licence)
-
Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages 3 Mar 2022 · 1 repository · arXiv:2203.01976Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
Tasks archive 2025-07-28
20 shown of 170 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections