Browse State-of-the-Art › Masked Language Modeling › Papers, page 5

Masked Language Modeling

Papers archive 2025-07-28

archive papers tagged: 475 · with a code link: 254 · where Syntology ran a sample: 67 (52 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (67 of 475 tagged: 52 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument)

Page 5 of 5: papers 401 to 475 of 475, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Composable Sparse Fine-Tuning for Cross-Lingual Transfer
  16 Nov 2021 0 repositories listed
• Contextual Representation Learning beyond Masked Language Modeling
  16 Nov 2021 0 repositories listed
• DAWSON: Data Augmentation using Weak Supervision On Natural Language
  16 Nov 2021 0 repositories listed
• DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog
  16 Nov 2021 0 repositories listed
• Generative Prompt Tuning for Relation Classification
  16 Nov 2021 0 repositories listed
• How does the pre-training objective affect what large language models learn about linguistic properties?
  16 Nov 2021 0 repositories listed
• "Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
  16 Nov 2021 0 repositories listed
• Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification
  16 Nov 2021 0 repositories listed
• Phrase-aware Unsupervised Constituency Parsing
  16 Nov 2021 0 repositories listed
• Predicting Attention Sparsity in Transformers
  16 Nov 2021 0 repositories listed
• Probing BERT’s priors with serial reproduction chains
  16 Nov 2021 0 repositories listed
• Prompt-Learning for Fine-Grained Entity Typing
  16 Nov 2021 0 repositories listed
• TACO: Pre-training of Deep Transformers with Attention Convolution using Disentangled Positional Representation
  16 Nov 2021 0 repositories listed
• Temporal Language Modeling for Short Text Document Classification with Transformers
  16 Nov 2021 0 repositories listed
• Towards Unified Prompt Tuning for Few-shot Learning
  16 Nov 2021 0 repositories listed
• Unsupervised Dependency Graph Network
  16 Nov 2021 0 repositories listed
• Joint Unsupervised and Supervised Training for Multilingual ASR
  15 Nov 2021 0 repositories listed
• Modeling Mathematical Notation Semantics in Academic Papers
  1 Nov 2021 0 repositories listed
• NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection
  1 Nov 2021 0 repositories listed
• Maximizing Efficiency of Language Model Pre-training for Learning Representation
  13 Oct 2021 0 repositories listed
• Multi-Modal Pre-Training for Automated Speech Recognition
  12 Oct 2021 0 repositories listed
• Image BERT Pre-training with Online Tokenizer
  29 Sep 2021 0 repositories listed
• MLIM: Vision-and-Language Model Pre-training with Masked Language and Image Modeling
  24 Sep 2021 0 repositories listed
• Predicting Attention Sparsity in Transformers
  24 Sep 2021 0 repositories listed
• Domain-Specific Japanese ELECTRA Model Using a Small Corpus
  1 Sep 2021 0 repositories listed
• Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline
  1 Sep 2021 0 repositories listed
• Prompt-Learning for Fine-Grained Entity Typing
  24 Aug 2021 0 repositories listed
• Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction
  1 Aug 2021 0 repositories listed
• Learning to Sample Replacements for ELECTRA Pre-Training
  25 Jun 2021 0 repositories listed
• Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model
  24 Jun 2021 0 repositories listed
• MST: Masked Self-Supervised Transformer for Visual Representation
  10 Jun 2021 0 repositories listed
• Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene
  4 Jun 2021 0 repositories listed
• Exposing the Implicit Energy Networks behind Masked Language Models via Metropolis--Hastings
  4 Jun 2021 0 repositories listed
• MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling
  1 Jun 2021 0 repositories listed
• SCRIPT: Self-Critic PreTraining of Transformers
  1 Jun 2021 0 repositories listed
• Target-Aware Data Augmentation for Stance Detection
  1 Jun 2021 0 repositories listed
• Larger-Scale Transformers for Multilingual Masked Language Modeling
  2 May 2021 0 repositories listed
• Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training
  19 Apr 2021 0 repositories listed
• On the Influence of Masking Policies in Intermediate Pre-training
  18 Apr 2021 0 repositories listed
• Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little
  14 Apr 2021 0 repositories listed
• Pseudo-Label Guided Unsupervised Domain Adaptation of Contextual Embeddings
  1 Apr 2021 0 repositories listed
• UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  1 Apr 2021 0 repositories listed
• Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays
  30 Mar 2021 0 repositories listed
• Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling
  23 Mar 2021 0 repositories listed
• A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives
  25 Feb 2021 0 repositories listed
• Bilingual Language Modeling, A transfer learning technique for Roman Urdu
  22 Feb 2021 0 repositories listed
• MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding
  23 Jan 2021 0 repositories listed
• Universal Sentence Representations Learning with Conditional Masked Language Model
  1 Jan 2021 0 repositories listed
• Universal Sentence Representation Learning with Conditional Masked Language Model
  28 Dec 2020 0 repositories listed
• Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence Models
  1 Dec 2020 0 repositories listed
• Self-Supervised Relationship Probing
  1 Dec 2020 0 repositories listed
• XHate-999: Analyzing and Detecting Abusive Language Across Domains and Languages
  1 Dec 2020 0 repositories listed
• Self-Supervised learning with cross-modal transformers for emotion recognition
  20 Nov 2020 0 repositories listed
• A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus
  18 Nov 2020 0 repositories listed
• POSTECH-ETRI’s Submission to the WMT2020 APE Shared Task: Automatic Post-Editing with Cross-lingual Language Model
  1 Nov 2020 0 repositories listed
• Effective Decoder Masking for Transformer Based End-to-End Speech Recognition
  27 Oct 2020 0 repositories listed
• DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries
  23 Oct 2020 0 repositories listed
• ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding
  23 Oct 2020 0 repositories listed
• Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring
  13 Oct 2020 0 repositories listed
• VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation
  28 Sep 2020 0 repositories listed
• Learning Visual Representations with Caption Annotations
  4 Aug 2020 0 repositories listed
• TensorCoder: Dimension-Wise Attention via Tensor Representation for Natural Language Modeling
  28 Jul 2020 0 repositories listed
• Position Masking for Language Models
  2 Jun 2020 0 repositories listed
• Segatron: Segment-aware Transformer for Language Modeling and Understanding
  2 Jun 2020 0 repositories listed
• Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning
  29 Apr 2020 0 repositories listed
• UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection
  23 Apr 2020 0 repositories listed
• XGPT: Cross-modal Generative Pre-Training for Image Captioning
  3 Mar 2020 0 repositories listed
• ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data
  22 Jan 2020 0 repositories listed
• Retrieval Augmented Language Model Pre-Training
  1 Jan 2020 0 repositories listed
• Emerging Cross-lingual Structure in Pretrained Language Models
  4 Nov 2019 0 repositories listed
• UNITER: Learning UNiversal Image-TExt Representations
  25 Sep 2019 0 repositories listed
• The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives
  3 Sep 2019 0 repositories listed
• Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training
  16 Aug 2019 0 repositories listed
• BERT Masked Language Modeling for Co-reference Resolution
  1 Aug 2019 0 repositories listed
• Adversarial Generation and Encoding of Nested Texts
  1 Jun 2019 0 repositories listed