Methods › Natural Language Processing › Transformers › ELECTRA
ELECTRA
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
ELECTRA is a transformer with a new pre-training approach which trains two transformer models: the generator and the discriminator. The generator replaces tokens in the sequence - trained as a masked language model - and the discriminator (the ELECTRA contribution) attempts to identify which tokens are replaced by the generator in the sequence. This pre-training task is called replaced token detection, and is a replacement for masking the input.
Papers archive 2025-07-28
30 shown of 118, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
AdUE: Improving uncertainty estimation head for LoRA adapters in LLMs 21 May 2025 · 0 repositories · arXiv:2505.15443
-
LiteLMGuard: Seamless and Lightweight On-Device Prompt Filtering for Safeguarding Small Language Models against Quantization-induced Risks and Vulnerabilities 8 May 2025 · 2 repositories · arXiv:2505.05619
-
Sigma: A dataset for text-to-code semantic parsing with statistical analysis 5 Apr 2025 · 1 repository · arXiv:2504.04301
-
Comparative Analysis of Efficient Adapter-Based Fine-Tuning of State-of-the-Art Transformer Models 14 Jan 2025 · 0 repositories · arXiv:2501.08271
-
Aligning Brain Activity with Advanced Transformer Models: Exploring the Role of Punctuation in Semantic Processing 10 Jan 2025 · 1 repository · arXiv:2501.06278
-
IntegrityAI at GenAI Detection Task 2: Detecting Machine-Generated Academic Essays in English and Arabic Using ELECTRA and Stylometry 7 Jan 2025 · 0 repositories · arXiv:2501.05476
-
ELECTRA and GPT-4o: Cost-Effective Partners for Sentiment Analysis 29 Dec 2024 · 1 repository · arXiv:2501.00062
-
What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics 26 Nov 2024 · 0 repositories · arXiv:2411.17593
-
A Comparative Analysis of Transformer and LSTM Models for Detecting Suicidal Ideation on Reddit 23 Nov 2024 · 1 repository · arXiv:2411.15404
-
LA4SR: illuminating the dark proteome with generative AI 11 Nov 2024 · 0 repositories · arXiv:2411.06798
-
A Named Entity Recognition and Topic Modeling-based Solution for Locating and Better Assessment of Natural Disasters in Social Media 1 May 2024 · 0 repositories · arXiv:2405.00903
-
Do "English" Named Entity Recognizers Work Well on Global Englishes? 20 Apr 2024 · 2 repositories · arXiv:2404.13465
-
FastLogAD: Log Anomaly Detection with Mask-Guided Pseudo Anomaly Generation and Discrimination 12 Apr 2024 · 1 repository · arXiv:2404.08750
-
Leveraging pre-trained language models for code generation 29 Feb 2024 · 1 repository
-
Are ELECTRA's Sentence Embeddings Beyond Repair? The Case of Semantic Textual Similarity 20 Feb 2024 · 1 repository · arXiv:2402.13130
-
A Curious Case of Searching for the Correlation between Training Data and Adversarial Robustness of Transformer Textual Models 18 Feb 2024 · 1 repository · arXiv:2402.11469
-
LogELECTRA: Self-supervised Anomaly Detection for Unstructured Logs 16 Feb 2024 · 0 repositories · arXiv:2402.10397
-
Dissecting vocabulary biases datasets through statistical testing and automated data augmentation for artifact mitigation in Natural Language Inference 14 Dec 2023 · 1 repository · arXiv:2312.08747
-
FA Team at the NTCIR-17 UFO Task 31 Oct 2023 · 0 repositories · arXiv:2310.20322
-
Fast-ELECTRA for Efficient Pre-training 11 Oct 2023 · 0 repositories · arXiv:2310.07347
-
Structural Self-Supervised Objectives for Transformers 15 Sep 2023 · 1 repository · arXiv:2309.08272
-
Transformer Based Punctuation Restoration for Turkish 15 Sep 2023 · 1 repository
-
Optimizing Multi-Class Text Classification: A Diverse Stacking Ensemble Framework Utilizing Transformers 19 Aug 2023 · 0 repositories · arXiv:2308.11519
-
An Ensemble Approach to Question Classification: Integrating Electra Transformer, GloVe, and LSTM 13 Aug 2023 · 0 repositories · arXiv:2308.06828
-
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining 7 Aug 2023 · 1 repository · arXiv:2308.03235
-
Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer Models 22 Jul 2023 · 1 repository · arXiv:2307.12155
-
Vacaspati: A Diverse Corpus of Bangla Literature 11 Jul 2023 · 0 repositories · arXiv:2307.05083
-
Comparison of Pre-trained Language Models for Turkish Address Parsing 24 Jun 2023 · 0 repositories · arXiv:2306.13947
-
Named entity recognition in resumes 22 Jun 2023 · 0 repositories · arXiv:2306.13062
-
Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension 15 May 2023 · 1 repository · arXiv:2305.08348
Tasks archive 2025-07-28
20 shown of 136 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections