Methods › Natural Language Processing › Transformers › ELECTRA › Papers, page 2

ELECTRA

Papers archive 2025-07-28

archive papers tagged: 118 · with a code link: 55 · where Syntology ran a sample: 9 (9 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (9 of 118 tagged: 9 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)

Page 2 of 2: papers 101 to 118 of 118, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
  30 Dec 2020 · 2 repositories · arXiv:2012.15283
• MeDAL: Medical Abbreviation Disambiguation Dataset for Natural Language Understanding Pretraining
  27 Dec 2020 · 1 repository · arXiv:2012.13978
• To what extent do human explanations of model behavior align with actual model behavior?
  24 Dec 2020 · 0 repositories · arXiv:2012.13354
• Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems
  22 Dec 2020 · 1 repository · arXiv:2012.11937
• Learning from Mistakes: Using Mis-predictions as Harm Alerts in Language Pre-Training
  16 Dec 2020 · 0 repositories · arXiv:2012.08789
• Pre-Training Transformers as Energy-Based Cloze Models
  15 Dec 2020 · 1 repository · arXiv:2012.08561
• A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge
  27 Oct 2020 · 0 repositories · arXiv:2010.14202
• Commonsense knowledge adversarial dataset that challenges ELECTRA
  25 Oct 2020 · 0 repositories · arXiv:2010.13049
• Exploiting News Article Structure for Automatic Corpus Generation of Entailment Datasets
  22 Oct 2020 · 1 repository · arXiv:2010.11574
• German's Next Language Model
  21 Oct 2020 · 1 repository · arXiv:2010.10906
• Aspect-based Document Similarity for Research Papers
  13 Oct 2020 · 1 repository · arXiv:2010.06395
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue
  14 Sep 2020 · 1 repository · arXiv:2009.06504
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Comparative Study of Language Models on Cross-Domain Data with Model Agnostic Explainability
  9 Sep 2020 · 0 repositories · arXiv:2009.04095
• Taking Notes on the Fly Helps BERT Pre-training
  4 Aug 2020 · 0 repositories · arXiv:2008.01466
• Roles and Utilization of Attention Heads in Transformer-based Neural Language Models
  1 Jul 2020 · 1 repository
• MC-BERT: Efficient Language Pre-Training via a Meta Controller
  10 Jun 2020 · 1 repository · arXiv:2006.05744
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Learning-to-Rank with BERT in TF-Ranking
  17 Apr 2020 · 0 repositories · arXiv:2004.08476
• ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  23 Mar 2020 · 19 repositories · arXiv:2003.10555
  Syntology official: no sample here; runs from other or unrecorded repositories · 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified (of 40 harvested samples) · 10 pointer-only (licence)