Methods › Natural Language Processing › Language Models › mBERT › Papers, page 2

mBERT

Papers archive 2025-07-28

archive papers tagged: 198 · with a code link: 98 · where Syntology ran a sample: 10 (10 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (10 of 198 tagged: 10 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)

Page 2 of 2: papers 101 to 198 of 198, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• pNLP-Mixer: an Efficient all-MLP Architecture for Language
  9 Feb 2022 · 1 repository · arXiv:2202.04350
• Are Pretrained Multilingual Models Equally Fair Across Languages?
  16 Jan 2022 · 0 repositories
• Frustratingly Simple Regularization to Improve Zero-shot Cross-lingual Robustness
  16 Jan 2022 · 0 repositories
• Lexicon based Fine-tuning of Multilingual Language Models for Sentiment Analysis of Low-resource Languages
  16 Jan 2022 · 0 repositories
• The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer
  16 Jan 2022 · 0 repositories
• Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languages
  27 Nov 2021 · 0 repositories · arXiv:2111.13974
• To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLP
  18 Nov 2021 · 0 repositories · arXiv:2111.09618
• An Isotropy Analysis in the Multilingual BERT Embedding Space
  16 Nov 2021 · 0 repositories
• Improving Word Translation via Two-Stage Contrastive Learning
  16 Nov 2021 · 1 repository
• Linguistic Diversity Scores for NLP Data Sets
  16 Nov 2021 · 0 repositories
• Shallow Parsing for Nepal Bhasa Complement Clauses
  16 Nov 2021 · 0 repositories
• Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning
  16 Nov 2021 · 0 repositories
• Cross-Lingual Training of Dense Retrievers for Document Retrieval
  1 Nov 2021 · 0 repositories
• Limitations of Knowledge Distillation for Zero-shot Transfer Learning
  1 Nov 2021 · 0 repositories
• Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages
  1 Nov 2021 · 1 repository
• Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction
  20 Oct 2021 · 1 repository · arXiv:2110.10318
• Predicting the Performance of Multilingual NLP Models
  17 Oct 2021 · 0 repositories · arXiv:2110.08875
• Learning Compact Metrics for MT
  12 Oct 2021 · 1 repository · arXiv:2110.06341
• Cross-Language Learning for Entity Matching
  7 Oct 2021 · 1 repository · arXiv:2110.03338
• StoryDB: Broad Multi-language Narrative Dataset
  29 Sep 2021 · 0 repositories · arXiv:2109.14396
• Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification
  28 Sep 2021 · 0 repositories · arXiv:2109.13486
• On the Prunability of Attention Heads in Multilingual BERT
  26 Sep 2021 · 0 repositories · arXiv:2109.12683
• Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages
  22 Sep 2021 · 1 repository · arXiv:2109.10534
• DiS-ReX: A Multilingual Dataset for Distantly Supervised Relation Extraction
  17 Sep 2021 · 0 repositories
• On the Universality of Deep Contextual Language Models
  15 Sep 2021 · 0 repositories · arXiv:2109.07140
• On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning
  14 Sep 2021 · 1 repository · arXiv:2109.06935
• Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario
  8 Sep 2021 · 0 repositories · arXiv:2109.03570
• Nearest Neighbour Few-Shot Learning for Cross-lingual Classification
  6 Sep 2021 · 1 repository · arXiv:2109.02221
  Syntology 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
• Cross-Lingual Training with Dense Retrieval for Document Retrieval
  3 Sep 2021 · 0 repositories · arXiv:2109.01628
• Cross-Lingual Text Classification of Transliterated Hindi and Malayalam
  31 Aug 2021 · 1 repository · arXiv:2108.13620
• COSY: COunterfactual SYntax for Cross-Lingual Understanding
  1 Aug 2021 · 1 repository
• gaBERT -- an Irish Language Model
  27 Jul 2021 · 1 repository · arXiv:2107.12930
• A Primer on Pretrained Multilingual Language Models
  1 Jul 2021 · 0 repositories · arXiv:2107.00676
• Bilingual Alignment Pre-Training for Zero-Shot Cross-Lingual Transfer
  3 Jun 2021 · 1 repository · arXiv:2106.01732
• Syntax-augmented Multilingual BERT for Cross-lingual Transfer
  3 Jun 2021 · 1 repository · arXiv:2106.02134
• UoB at ProfNER 2021: Data Augmentation for Classification Using Machine Translation
  1 Jun 2021 · 0 repositories
• Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model
  19 Apr 2021 · 2 repositories · arXiv:2104.09617
• DiS-ReX: A Multilingual Dataset for Distantly Supervised Relation Extraction
  17 Apr 2021 · 1 repository · arXiv:2104.08655
• Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation
  8 Apr 2021 · 0 repositories · arXiv:2104.03767
• BERTologiCoMix: How does Code-Mixing interact with Multilingual BERT?
  1 Apr 2021 · 0 repositories
• Challenges in Annotating and Parsing Spoken, Code-switched, Frisian-Dutch Data
  1 Apr 2021 · 1 repository
• Introducing A large Tunisian Arabizi Dialectal Dataset for Sentiment Analysis
  1 Apr 2021 · 0 repositories
• ssn_diBERTsity@LT-EDI-EACL2021:Hope Speech Detection on multilingual YouTube comments via transformer based approach
  1 Apr 2021 · 0 repositories
• Subword Pooling Makes a Difference
  1 Apr 2021 · 1 repository
• Task-Oriented Dialog Systems for Dravidian Languages
  1 Apr 2021 · 0 repositories
• Towards Offensive Language Identification for Dravidian Languages
  1 Apr 2021 · 1 repository
• Bertinho: Galician BERT Representations
  25 Mar 2021 · 0 repositories · arXiv:2103.13799
• AngryBERT: Joint Learning Target and Emotion for Hate Speech Detection
  14 Mar 2021 · 0 repositories · arXiv:2103.11800
• Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling
  13 Mar 2021 · 1 repository · arXiv:2103.07792
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation
  11 Mar 2021 · 6 repositories · arXiv:2103.06874
• LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation
  11 Mar 2021 · 0 repositories · arXiv:2103.06418
• Automatic Difficulty Classification of Arabic Sentences
  7 Mar 2021 · 0 repositories · arXiv:2103.04386
• Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages
  1 Mar 2021 · 0 repositories · arXiv:2103.00854
• Subword Pooling Makes a Difference
  22 Feb 2021 · 1 repository · arXiv:2102.10864
• Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models
  1 Feb 2021 · 1 repository · arXiv:2102.00894
• SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification
  1 Feb 2021 · 1 repository · arXiv:2102.01051
• Attention Can Reflect Syntactic Structure (If You Let It)
  26 Jan 2021 · 0 repositories · arXiv:2101.10927
• Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT
  26 Jan 2021 · 1 repository · arXiv:2101.11043
• Distilling Large Language Models into Tiny and Effective Students using pQRNN
  21 Jan 2021 · 0 repositories · arXiv:2101.08890
• Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts
  15 Jan 2021 · 0 repositories · arXiv:2101.06004
• Evaluation of Deep Learning Models for Hostility Detection in Hindi Text
  11 Jan 2021 · 0 repositories · arXiv:2101.04144
• CMCE at SemEval-2020 Task 1: Clustering on Manifolds of Contextualized Embeddings to Detect Historical Meaning Shifts
  1 Dec 2020 · 1 repository
• GruPaTo at SemEval-2020 Task 12: Retraining mBERT on Social Media and Fine-tuned Offensive Language Models
  1 Dec 2020 · 0 repositories
• MSR India at SemEval-2020 Task 9: Multilingual Models Can Do Code-Mixing Too
  1 Dec 2020 · 0 repositories
• Probing Multilingual BERT for Genetic and Typological Signals
  4 Nov 2020 · 0 repositories · arXiv:2011.02070
• Cross-Lingual Training of Neural Models for Document Ranking
  1 Nov 2020 · 0 repositories
• From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
  1 Nov 2020 · 0 repositories
• Identifying Elements Essential for BERT's Multilinguality
  1 Nov 2020 · 0 repositories
• It’s not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT
  1 Nov 2020 · 1 repository
• UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models
  26 Oct 2020 · 0 repositories · arXiv:2010.13609
• Char2Subword: Extending the Subword Embedding Space Using Robust Character Compositionality
  24 Oct 2020 · 0 repositories · arXiv:2010.12730
• Deep Clustering of Text Representations for Supervision-free Probing of Syntax
  24 Oct 2020 · 0 repositories · arXiv:2010.12784
• DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries
  23 Oct 2020 · 0 repositories · arXiv:2010.12566
• Multilingual BERT Post-Pretraining Alignment
  23 Oct 2020 · 0 repositories · arXiv:2010.12547
• It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT
  16 Oct 2020 · 1 repository · arXiv:2010.08275
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
• Explicit Alignment Objectives for Multilingual Bidirectional Encoders
  15 Oct 2020 · 0 repositories · arXiv:2010.07972
• No Rumours Please! A Multi-Indic-Lingual Approach for COVID Fake-Tweet Detection
  14 Oct 2020 · 1 repository · arXiv:2010.06906
• Model Selection for Cross-Lingual Transfer
  13 Oct 2020 · 1 repository · arXiv:2010.06127
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Detecting Foodborne Illness Complaints in Multiple Languages Using English Annotations Only
  11 Oct 2020 · 0 repositories · arXiv:2010.05194
• Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages
  7 Oct 2020 · 1 repository · arXiv:2010.03179
• BERT for Monolingual and Cross-Lingual Reverse Dictionary
  30 Sep 2020 · 1 repository · arXiv:2009.14790
• Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study
  29 Sep 2020 · 0 repositories · arXiv:2009.14304
• Model Selection for Cross-Lingual Transfer using a Learned Scoring Function
  28 Sep 2020 · 0 repositories
• FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding
  10 Sep 2020 · 1 repository · arXiv:2009.05166
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
• Transferring Monolingual Model to Low-Resource Language: The Case of Tigrinya
  13 Jun 2020 · 0 repositories · arXiv:2006.07698
• CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP
  11 Jun 2020 · 1 repository · arXiv:2006.06402
• WikiBERT models: deep transfer learning for many languages
  2 Jun 2020 · 0 repositories · arXiv:2006.01538
• Are All Languages Created Equal in Multilingual BERT?
  18 May 2020 · 1 repository · arXiv:2005.09093
• Finding Universal Grammatical Relations in Multilingual BERT
  9 May 2020 · 1 repository · arXiv:2005.04511
  Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
• From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers
  1 May 2020 · 0 repositories · arXiv:2005.00633
• Identifying Necessary Elements for BERT's Multilinguality
  1 May 2020 · 1 repository · arXiv:2005.00396
• An Empirical Study of Pre-trained Transformers for Arabic Information Extraction
  30 Apr 2020 · 1 repository · arXiv:2004.14519
• Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings
  30 Apr 2020 · 0 repositories · arXiv:2004.15001
• LAReQA: Language-agnostic answer retrieval from a multilingual pool
  11 Apr 2020 · 1 repository · arXiv:2004.05484
• What the [MASK]? Making Sense of Language-Specific BERT Models
  5 Mar 2020 · 0 repositories · arXiv:2003.02912
• How Language-Neutral is Multilingual BERT?
  8 Nov 2019 · 1 repository · arXiv:1911.03310
• Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
  19 Apr 2019 · 2 repositories · arXiv:1904.09077
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 · 534 repositories · arXiv:1810.04805
  Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 235 with no instrument failure: 17 honoured, 4 violated, 214 with no contract checked; 65 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)