Browse State-of-the-Art › Masked Language Modeling › Papers, page 4

Masked Language Modeling

Papers archive 2025-07-28

archive papers tagged: 475 · with a code link: 254 · where Syntology ran a sample: 67 (52 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (67 of 475 tagged: 52 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument)

Page 4 of 5: papers 301 to 400 of 475, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• How Useful is Continued Pre-Training for Generative Unsupervised Domain Adaptation?
  31 Jan 2024 0 repositories listed
• BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining
  29 Jan 2024 0 repositories listed
• Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labeling
  25 Jan 2024 0 repositories listed
• Automated Scoring of Clinical Patient Notes using Advanced NLP and Pseudo Labeling
  18 Jan 2024 0 repositories listed
• Iterative Mask Filling: An Effective Text Augmentation Method Using Masked Language Modeling
  3 Jan 2024 0 repositories listed
• Efficient Parallel Audio Generation using Group Masked Language Modeling
  2 Jan 2024 0 repositories listed
• HCDIR: End-to-end Hate Context Detection, and Intensity Reduction model for online comments
  20 Dec 2023 0 repositories listed
• LightCLIP: Learning Multi-Level Interaction for Lightweight Vision-Language Models
  1 Dec 2023 0 repositories listed
• BIM: Block-Wise Self-Supervised Learning with Masked Image Modeling
  28 Nov 2023 0 repositories listed
• CLIMB: Curriculum Learning for Infant-inspired Model Building
  15 Nov 2023 0 repositories listed
• User Persona Identification and New Service Adaptation Recommendation
  15 Nov 2023 0 repositories listed
• Understanding the Natural Language of DNA using Encoder-Decoder Foundation Models with Byte-level Precision
  4 Nov 2023 0 repositories listed
• BERTwich: Extending BERT's Capabilities to Model Dialectal and Noisy Text
  31 Oct 2023 0 repositories listed
• ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction
  13 Oct 2023 0 repositories listed
• Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection
  13 Oct 2023 0 repositories listed
• PerPLM: Personalized Fine-tuning of Pretrained Language Models via Writer-specific Intermediate Learning and Prompts
  14 Sep 2023 0 repositories listed
• BiLMa: Bidirectional Local-Matching for Text-based Person Re-identification
  9 Sep 2023 0 repositories listed
• ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation
  31 Aug 2023 0 repositories listed
• Exploring Multi-Modal Contextual Knowledge for Open-Vocabulary Object Detection
  30 Aug 2023 0 repositories listed
• Gender-tuning: Empowering Fine-tuning for Debiasing Pre-trained Language Models
  20 Jul 2023 0 repositories listed
• PASTA: Pretrained Action-State Transformer Agents
  20 Jul 2023 0 repositories listed
• Improving the Reusability of Pre-trained Language Models in Real-world Applications
  19 Jul 2023 0 repositories listed
• Improving BERT with Hybrid Pooling Network and Drop Mask
  14 Jul 2023 0 repositories listed
• Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling
  21 Jun 2023 0 repositories listed
• Investigating Masking-based Data Generation in Language Models
  16 Jun 2023 0 repositories listed
• Recipes for Sequential Pre-training of Multilingual Encoder and Seq2Seq Models
  14 Jun 2023 0 repositories listed
• Absformer: Transformer-based Model for Unsupervised Multi-Document Abstractive Summarization
  7 Jun 2023 0 repositories listed
• Leveraging Explicit Procedural Instructions for Data-Efficient Action Prediction
  6 Jun 2023 0 repositories listed
• Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression
  1 Jun 2023 0 repositories listed
• LayoutMask: Enhance Text-Layout Interaction in Multi-modal Pre-training for Document Understanding
  30 May 2023 0 repositories listed
• Dynamic Masking Rate Schedules for MLM Pretraining
  24 May 2023 0 repositories listed
• Extrapolating Multilingual Understanding Models as Multilingual Generators
  22 May 2023 0 repositories listed
• A Pilot Study on Dialogue-Level Dependency Parsing for Chinese
  21 May 2023 0 repositories listed
• Patton: Language Model Pretraining on Text-Rich Networks
  20 May 2023 0 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 8 harvested samples)
• Pre-training Language Model as a Multi-perspective Course Learner
  6 May 2023 0 repositories listed
• Mapping of attention mechanisms to a generalized Potts model
  14 Apr 2023 0 repositories listed
• Joint unsupervised and supervised learning for context-aware language identification
  29 Mar 2023 0 repositories listed
• HOP+: History-enhanced and Order-aware Pre-training for Vision-and-Language Navigation
  20 Mar 2023 0 repositories listed
• CCPL: Cross-modal Contrastive Protein Learning
  19 Mar 2023 0 repositories listed
• Do Transformers Parse while Predicting the Masked Word?
  14 Mar 2023 0 repositories listed
• Generating multiple-choice questions for medical question answering with distractors and cue-masking
  13 Mar 2023 0 repositories listed
• Domain-adapted large language models for classifying nuclear medicine reports
  1 Mar 2023 0 repositories listed
• Efficient Masked Autoencoders with Self-Consistency
  28 Feb 2023 0 repositories listed
• Weighted Sampling for Masked Language Modeling
  28 Feb 2023 0 repositories listed
• Capturing Topic Framing via Masked Language Modeling
  7 Feb 2023 0 repositories listed
• Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval
  30 Jan 2023 0 repositories listed
• A Cohesive Distillation Architecture for Neural Language Models
  12 Jan 2023 0 repositories listed
• Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks
  1 Jan 2023 0 repositories listed
• Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Models
  20 Dec 2022 0 repositories listed
• APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning
  19 Dec 2022 0 repositories listed
• Mu²SLAM: Multitask, Multilingual Speech and Language Models
  19 Dec 2022 0 repositories listed
• Uniform Masking Prevails in Vision-Language Pretraining
  10 Dec 2022 0 repositories listed
• Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE
  4 Dec 2022 0 repositories listed
• Global memory transformer for processing long documents
  3 Dec 2022 0 repositories listed
• Comparison Study Between Token Classification and Sequence Classification In Text Classification
  25 Nov 2022 0 repositories listed
• Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge
  20 Nov 2022 0 repositories listed
• Leveraging per Image-Token Consistency for Vision-Language Pre-training
  20 Nov 2022 0 repositories listed
• HanTrans: An Empirical Study on Cross-Era Transferability of Chinese Pre-trained Language Model
  1 Nov 2022 0 repositories listed
• Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation
  1 Nov 2022 0 repositories listed
• SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation
  21 Oct 2022 0 repositories listed
• A Closer Look at Parameter Contributions When Training Neural Language and Translation Models
  1 Oct 2022 0 repositories listed
• KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification
  1 Oct 2022 0 repositories listed
• Taking Actions Separately: A Bidirectionally-Adaptive Transfer Learning Method for Low-Resource Neural Machine Translation
  1 Oct 2022 0 repositories listed
• Towards Making the Most of Pre-trained Translation Model for Quality Estimation
  1 Oct 2022 0 repositories listed
• Bidirectional Language Models Are Also Few-shot Learners
  29 Sep 2022 0 repositories listed
• Masked Vision and Language Modeling for Multi-modal Representation Learning
  3 Aug 2022 0 repositories listed
• Augmenting Vision Language Pretraining by Learning Codebook with Visual Semantics
  31 Jul 2022 0 repositories listed
• STT: Soft Template Tuning for Few-Shot Adaptation
  18 Jul 2022 0 repositories listed
• GPTs at Factify 2022: Prompt Aided Fact-Verification
  29 Jun 2022 0 repositories listed
• General Framework for Reversible Data Hiding in Texts Based on Masked Language Modeling
  21 Jun 2022 0 repositories listed
• VL-BEiT: Generative Vision-Language Pretraining
  2 Jun 2022 0 repositories listed
• Developing Language Resources and NLP Tools for the North Korean Language
  1 Jun 2022 0 repositories listed
• Discovering Financial Hypernyms by Prompting Masked Language Models
  1 Jun 2022 0 repositories listed
• Enhancing Continual Learning with Global Prototypes: Counteracting Negative Representation Drift
  24 May 2022 0 repositories listed
• MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification
  24 May 2022 0 repositories listed
• Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
  22 May 2022 0 repositories listed
• Foundation Posteriors for Approximate Probabilistic Inference
  19 May 2022 0 repositories listed
• Adversarial Soft Prompt Tuning for Cross-Domain Sentiment Analysis
  1 May 2022 0 repositories listed
• “Is Whole Word Masking Always Better for Chinese BERT?”: Probing on Chinese Grammatical Error Correction
  1 May 2022 0 repositories listed
• Phrase-aware Unsupervised Constituency Parsing
  1 May 2022 0 repositories listed
• Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
  26 Apr 2022 0 repositories listed
• SimpleBERT: A Pre-trained Model That Learns to Generate Simple Words
  16 Apr 2022 0 repositories listed
• WordAlchemy: A transformer-based Reverse Dictionary
  16 Apr 2022 0 repositories listed
• Token Dropping for Efficient BERT Pretraining
  24 Mar 2022 0 repositories listed
• SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding
  7 Mar 2022 0 repositories listed
• "Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
  1 Mar 2022 0 repositories listed
• VU-BERT: A Unified framework for Visual Dialog
  22 Feb 2022 0 repositories listed
• Misinformation Detection in Social Media Video Posts
  15 Feb 2022 0 repositories listed
• Prompt-Guided Injection of Conformation to Pre-trained Protein Model
  7 Feb 2022 0 repositories listed
• Text Style Transfer for Bias Mitigation using Masked Language Modeling
  21 Jan 2022 0 repositories listed
• Causal Distillation for Language Models
  16 Jan 2022 0 repositories listed
• Data Augmentation for Biomedical Factoid Question Answering
  16 Jan 2022 0 repositories listed
• STT: Soft Template Tuning for Few-Shot Learning
  16 Jan 2022 0 repositories listed
• A Transfer Learning Pipeline for Educational Resource Discovery with Application in Leading Paragraph Generation
  7 Jan 2022 0 repositories listed
• Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge
  16 Dec 2021 0 repositories listed
• CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising
  14 Dec 2021 0 repositories listed
• Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation
  10 Dec 2021 0 repositories listed
• UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  19 Nov 2021 0 repositories listed
• LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model
  18 Nov 2021 0 repositories listed
• A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models
  16 Nov 2021 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.