Methods › Natural Language Processing › Autoencoding Transformers › Electric
Electric
Introduced by Kevin Clark et al. in Pre-Training Transformers as Energy-Based Cloze Models
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Electric is an energy-based cloze model for representation learning over text. Like BERT, it is a conditional generative model of tokens given their contexts. However, Electric does not use masking or output a full distribution over tokens that could occur in a context. Instead, it assigns a scalar energy score to each input token indicating how likely it is given its context.
Specifically, like BERT, Electric also models p_(data)(xₜ |x_(t)), but does not use masking or a softmax layer. Electric first maps the unmasked input x=[x₁, …, xₙ] into contextualized vector representations h(x)=[h₁, …, hₙ] using a transformer network. The model assigns a given position t an energy score
E(x)ₜ=wᵀ h(x)ₜ
using a learned weight vector w. The energy function defines a distribution over the possible tokens at position t as
p_θ(xₜ |x_(t))=exp(-E(x)ₜ) / Z(x_(t))
=(exp(-E(x)ₜ))/(∑_(x′ ∈𝒱) exp(-E(REPLACE(x, t, x′))ₜ))
where REPLACE(x, t, x′) denotes replacing the token at position t with x′ and 𝒱 is the vocabulary, in practice usually word pieces. Unlike with BERT, which produces the probabilities for all possible tokens x′ using a softmax layer, a candidate x′ is passed in as input to the transformer. As a result, computing p_θ is prohibitively expensive because the partition function Z_θ(x_(t)) requires running the transformer |𝒱| times; unlike most EBMs, the intractability of Z_θ(x \t) is more due to the expensive scoring function rather than having a large sample space.
In Syntology repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: official). This answer is about arXiv:2012.08561, the paper the archive credits with this method.
Origin paper of this answer, arXiv:2012.08561 (its page on this site · its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 167 · with a code link: 23 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran: none of the 167 tagged papers has a Syntology run on record
Page 1 of 2: papers 1 to 100 of 167, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Integrated Switched Capacitor Array and Synchronous Charge Extraction with Adaptive Hybrid MPPT for Piezoelectric Harvesters 16 Jul 2025 · 0 repositories · arXiv:2507.12163
-
Smart Ride and Delivery Services with Electric Vehicles: Leveraging Bidirectional Charging for Profit Optimisation 25 Jun 2025 · 0 repositories · arXiv:2506.20401
-
Deep reinforcement learning-based joint real-time energy scheduling for green buildings with heterogeneous battery energy storage devices 7 Jun 2025 · 0 repositories · arXiv:2506.06824
-
Agent-Based Decentralized Energy Management of EV Charging Station with Solar Photovoltaics via Multi-Agent Reinforcement Learning 24 May 2025 · 0 repositories · arXiv:2505.18750
-
Control of Renewable Energy Communities using AI and Real-World Data 22 May 2025 · 0 repositories · arXiv:2505.17321
-
Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learning 15 May 2025 · 0 repositories · arXiv:2505.10262
-
Optimizing Electric Bus Charging Scheduling with Uncertainties Using Hierarchical Deep Reinforcement Learning 15 May 2025 · 0 repositories · arXiv:2505.10296
-
Leveraging Surplus Electricity: Profitability of Bitcoin Mining as a National Strategy in South Korea 1 May 2025 · 0 repositories · arXiv:2505.00303
-
LLM-Enabled EV Charging Stations Recommendation 29 Apr 2025 · 0 repositories · arXiv:2505.01447
-
Sensitivity Analysis of State Space Models for Scrap Composition Estimation in EAF and BOF 15 Apr 2025 · 0 repositories · arXiv:2504.11319
-
Vehicle Dynamics Control for Simultaneous Optimization of Tire Emissions and Performance in EVs 14 Apr 2025 · 0 repositories · arXiv:2504.10709
-
Modeling Scrap Composition in Electric Arc and Basic Oxygen Furnaces 13 Apr 2025 · 0 repositories · arXiv:2504.09382
-
Embedding Reliability Verification Constraints into Generation Expansion Planning 6 Apr 2025 · 0 repositories · arXiv:2504.07131
-
Methodology for Detecting Energy Anomalies due to Multi-Replay Attacks on Electric Vehicle Charging Infrastructure 1 Apr 2025 · 0 repositories · arXiv:2504.00319
-
EVOLVE: a Value-Added Services Platform for Electric Vehicle Charging Stations 24 Mar 2025 · 0 repositories · arXiv:2503.18687
-
Pruning-Based TinyML Optimization of Machine Learning Models for Anomaly Detection in Electric Vehicle Charging Infrastructure 19 Mar 2025 · 1 repository · arXiv:2503.14799
-
Large Neighborhood Search and Bitmask Dynamic Programming for Wireless Mobile Charging Electric Vehicle Routing Problems in Medical Transportation 11 Mar 2025 · 0 repositories · arXiv:2503.08752
-
The Untapped Potential of Smart Charging: How EV Owners Can Save Money and Reduce Emissions Without Behavioral Change 5 Mar 2025 · 0 repositories · arXiv:2503.03167
-
A Kolmogorov-Arnold Network for Explainable Detection of Cyberattacks on EV Chargers 4 Mar 2025 · 0 repositories · arXiv:2503.02281
-
H-FLTN: A Privacy-Preserving Hierarchical Framework for Electric Vehicle Spatio-Temporal Charge Prediction 25 Feb 2025 · 0 repositories · arXiv:2502.18697
-
Impact Analysis of Utility-Scale Energy Storage on the ERCOT Grid in Reducing Renewable Generation Curtailments and Emissions 21 Feb 2025 · 0 repositories · arXiv:2502.15958
-
TSS GAZ PTP: Towards Improving Gumbel AlphaZero with Two-stage Self-play for Multi-constrained Electric Vehicle Routing Problems 17 Feb 2025 · 0 repositories · arXiv:2502.15777
-
InterGridNet: An Electric Network Frequency Approach for Audio Source Location Classification Using Convolutional Neural Networks 14 Feb 2025 · 0 repositories · arXiv:2502.10011
-
Impact of Lead Time on Aggregate EV Flexibility for Congestion Management Services 27 Jan 2025 · 0 repositories · arXiv:2501.15946
-
Intelligent Electric Power Steering: Artificial Intelligence Integration Enhances Vehicle Safety and Performance 11 Dec 2024 · 0 repositories · arXiv:2412.08133
-
Evaluating the Relationship of EV Charging Station on the Uptake of Electric Vehicles -- Implication of the NEVI Formula Program 4 Dec 2024 · 1 repository · arXiv:2412.03608
-
A Bandpass Twin-T Active Filter Used in the Buchla 200 Electric Music Box Synthesizer 18 Nov 2024 · 1 repository · arXiv:2411.11358
-
Knowledge-enhanced Transformer for Multivariate Long Sequence Time-series Forecasting 17 Nov 2024 · 0 repositories · arXiv:2411.11046
-
Integrated Power and Thermal Management for Enhancing Energy Efficiency and Battery Life in Connected and Automated Electric Vehicles 8 Nov 2024 · 0 repositories · arXiv:2411.05298
-
A Scientific Machine Learning Approach for Predicting and Forecasting Battery Degradation in Electric Vehicles 18 Oct 2024 · 0 repositories · arXiv:2410.14347
-
Finite-volume method and observability analysis for core-shell enhanced single particle model for lithium iron phosphate batteries 17 Oct 2024 · 0 repositories · arXiv:2410.14032
-
EFILN: The Electric Field Inversion-Localization Network for High-Precision Underwater Positioning 15 Oct 2024 · 0 repositories · arXiv:2410.11223
-
Event-Driven Real-Time Multi-Objective Charging Schedule Optimization For Electric Vehicle Fleets 19 Sep 2024 · 0 repositories · arXiv:2409.12439
-
Location based Probabilistic Load Forecasting of EV Charging Sites: Deep Transfer Learning with Multi-Quantile Temporal Convolutional Network 18 Sep 2024 · 0 repositories · arXiv:2409.11862
-
A Carryover Storage Valuation Framework for Medium-Term Cascaded Hydropower Planning: A Portland General Electric System Study 15 Sep 2024 · 0 repositories · arXiv:2409.09876
-
Model Predictive Online Trajectory Planning for Adaptive Battery Discharging in Fuel Cell Vehicle 5 Sep 2024 · 0 repositories · arXiv:2409.03201
-
Urban context and delivery performance: Modelling service time for cargo bikes and vans across diverse urban environments 27 Aug 2024 · 0 repositories · arXiv:2409.06730
-
Deep Analysis of Time Series Data for Smart Grid Startup Strategies: A Transformer-LSTM-PSO Model Approach 22 Aug 2024 · 0 repositories · arXiv:2408.12129
-
Online Electric Vehicle Charging Detection Based on Memory-based Transformer using Smart Meter Data 6 Aug 2024 · 0 repositories · arXiv:2408.11828
-
Emission Reduction in Urban Environments by Replacing Conventional City Buses with Electric Bus Technology: A Case Study of Pakistan 29 Jul 2024 · 0 repositories · arXiv:2407.20139
-
Robustness of Explainable Artificial Intelligence in Industrial Process Modelling 12 Jul 2024 · 0 repositories · arXiv:2407.09127
-
CARACAS: vehiCular ArchitectuRe for detAiled Can Attacks Simulation 11 Jun 2024 · 1 repository · arXiv:2406.07125
-
Electric Vehicle Adoption Modeling in France: A Systematic Literature Review 4 Jun 2024 · 0 repositories · arXiv:2406.02029
-
A Two-sided Model for EV Market Dynamics and Policy Implications 27 May 2024 · 0 repositories · arXiv:2405.17702
-
Coverage Path Planning for Thermal Interface Materials 22 May 2024 · 0 repositories · arXiv:2405.13512
-
Reinforcement Learning control strategies for Electric Vehicles and Renewable energy sources Virtual Power Plants 3 May 2024 · 1 repository · arXiv:2405.01889
-
On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Case 25 Apr 2024 · 1 repository · arXiv:2404.16894
-
Cell Balancing for the Transportation Sector: Techniques, Challenges, and Future Research Directions 22 Apr 2024 · 0 repositories · arXiv:2404.13890
-
Aggregator of Electric Vehicles Bidding in Nordic FCR-D Markets: A Chance-Constrained Program 19 Apr 2024 · 0 repositories · arXiv:2404.12818
-
Grid-aware Scheduling and Control of Electric Vehicle Charging Stations for Dispatching Active Distribution Networks. Part-I: Day-ahead and Numerical Validation 19 Apr 2024 · 0 repositories · arXiv:2404.12863
-
Prescribing Optimal Health-Aware Operation for Urban Air Mobility with Deep Reinforcement Learning 12 Apr 2024 · 0 repositories · arXiv:2404.08497
-
Vehicle-to-Vehicle Charging: Model, Complexity, and Heuristics 12 Apr 2024 · 0 repositories · arXiv:2404.08837
-
Optimal EV Charging Scheduling at Electric Railway Stations Under Peak Load Constraints 11 Apr 2024 · 0 repositories · arXiv:2404.07804
-
SCAResNet: A ResNet Variant Optimized for Tiny Object Detection in Transmission and Distribution Towers 5 Apr 2024 · 1 repository · arXiv:2404.04179
-
Electric Vehicle Routing Problem for Emergency Power Supply: Towards Telecom Base Station Relief 3 Apr 2024 · 1 repository · arXiv:2404.02448
-
EnergAIze: Multi Agent Deep Deterministic Policy Gradient for Vehicle to Grid Energy Management 2 Apr 2024 · 0 repositories · arXiv:2404.02361
-
On Spectrogram Analysis in a Multiple Classifier Fusion Framework for Power Grid Classification Using Electric Network Frequency 27 Mar 2024 · 1 repository · arXiv:2403.18402
-
Aggregate Peak EV Charging Demand: The Impact of Segmented Network Tariffs 18 Mar 2024 · 0 repositories · arXiv:2403.12215
-
Stochastic Mean Field Game for Strategic Bidding of Consumers in Congested Distribution Networks 18 Mar 2024 · 0 repositories · arXiv:2403.11836
-
The Role of Extended Horizon Methodology in Renewable-Dense Grids With Inter-Day Long-Duration Energy Storage 18 Mar 2024 · 0 repositories · arXiv:2403.11379
-
Ride-pooling Electric Autonomous Mobility-on-Demand: Joint Optimization of Operations and Fleet and Infrastructure Design 11 Mar 2024 · 0 repositories · arXiv:2403.06566
-
Assessing the Potential for Building Sector Retrofits to Mitigate ERCOT Electricity Shortfalls During Winter Storm Uri 1 Mar 2024 · 0 repositories · arXiv:2403.01027
-
Impacts of electric carsharing on a power sector with variable renewables 29 Feb 2024 · 1 repository · arXiv:2402.19380
-
Controlling Large Electric Vehicle Charging Stations via User Behavior Modeling and Stochastic Programming 20 Feb 2024 · 0 repositories · arXiv:2402.13224
-
Contingency Analysis of a Grid of Connected EVs for Primary Frequency Control of an Industrial Microgrid Using Efficient Control Scheme 2 Feb 2024 · 0 repositories · arXiv:2402.01608
-
Power Flow Analysis Using Deep Neural Networks in Three-Phase Unbalanced Smart Distribution Grids 15 Jan 2024 · 0 repositories · arXiv:2401.07465
-
Energy Sharing among Resources within Electrical Distribution Systems: A Systematic Review 3 Jan 2024 · 0 repositories · arXiv:2401.01597
-
Full-Envelope Flight Control for Compound Vertical Takeoff and Landing Aircraft 15 Dec 2023 · 0 repositories · arXiv:2312.09629
-
Privacy-Aware Energy Consumption Modeling of Connected Battery Electric Vehicles using Federated Learning 12 Dec 2023 · 1 repository · arXiv:2312.07371
-
Smart Energy Management with Optimized Prosumerism for Achieving Dynamic Net-Zero Balance in Electrified Road Transport Networks 12 Dec 2023 · 0 repositories · arXiv:2312.08162
-
Maximum flow-based formulation for the optimal location of electric vehicle charging stations 10 Dec 2023 · 0 repositories · arXiv:2312.05980
-
A Data-Driven Framework for Improving Public EV Charging Infrastructure: Modeling and Forecasting 8 Dec 2023 · 0 repositories · arXiv:2312.05333
-
The Role of Net-Zero Energy Residential Buildings in Florida's Energy Transition: Economic Analysis and Technical Benefits 5 Dec 2023 · 0 repositories · arXiv:2312.03137
-
Out-of-Distribution-Aware Electric Vehicle Charging 10 Nov 2023 · 0 repositories · arXiv:2311.05941
-
Real-time Control of Electric Autonomous Mobility-on-Demand Systems via Graph Reinforcement Learning 9 Nov 2023 · 1 repository · arXiv:2311.05780
-
L'utilité de l'échelle opératique pour considérer des stratégies d'intelligence et de guerre économique 31 Oct 2023 · 0 repositories · arXiv:2401.02963
-
An Electric Vehicle Control Strategy to Mitigate Load Altering Attacks Against Power Grids 23 Oct 2023 · 0 repositories · arXiv:2310.14471
-
Optimal Scheduling of Electric Vehicle Charging with Deep Reinforcement Learning considering End Users Flexibility 13 Oct 2023 · 0 repositories · arXiv:2310.09040
-
Electric Autonomous Mobility-on-Demand: Jointly Optimal Vehicle Design and Fleet Operation 21 Sep 2023 · 0 repositories · arXiv:2309.13012
-
Who should pay for frequency-containment ancillary services? Making responsible units bear the cost to shape investment in generation and loads 21 Aug 2023 · 0 repositories · arXiv:2308.10629
-
Multi-horizon short-term load forecasting using hybrid of LSTM and modified split convolution 15 Aug 2023 · 1 repository
-
Challenges and Opportunities for Second-life Batteries: A Review of Key Technologies and Economy 13 Aug 2023 · 0 repositories · arXiv:2308.06786
-
Integrating Optimal EV Charging in the Energy Management of Electric Railway Stations 2 Aug 2023 · 0 repositories · arXiv:2308.01145
-
A Regional Analysis of Electric LDV Portfolio Choices by Vehicle Manufacturers 7 Jul 2023 · 0 repositories · arXiv:2307.03808
-
Phase Space Analysis of Cardiac Spectra 27 Jun 2023 · 0 repositories · arXiv:2306.15425
-
Interval Load Forecasting for Individual Households in the Presence of Electric Vehicle Charging 5 Jun 2023 · 0 repositories · arXiv:2306.03010
-
An Approximate Feasibility Assessment of Electric Vehicles Adoption in Nigeria: Forecast 2030 29 May 2023 · 0 repositories · arXiv:2305.17844
-
Increasing Electric Vehicles Utilization in Transit Fleets using Learning, Predictions, Optimization, and Automation 24 May 2023 · 0 repositories · arXiv:2305.14732
-
GreenEVT: Greensboro Electric Vehicle Testbed 22 May 2023 · 1 repository · arXiv:2305.12722
-
"Seeing'' Electric Network Frequency from Events 4 May 2023 · 1 repository · arXiv:2305.02597
-
Correlation-Driven Multi-Level Multimodal Learning for Anomaly Detection on Multiple Energy Sources 1 May 2023 · 1 repository · arXiv:2305.02323
-
Enhancing Supply Chain Resilience: A Machine Learning Approach for Predicting Product Availability Dates Under Disruption 28 Apr 2023 · 0 repositories · arXiv:2304.14902
-
AI-based Predictive Analytic Approaches for safeguarding the Future of Electric/Hybrid Vehicles 26 Apr 2023 · 0 repositories · arXiv:2304.13841
-
A New Flexible Modified Impedance Network Converter 16 Apr 2023 · 0 repositories · arXiv:2304.07866
-
A Deep Learning Approach Towards Generating High-fidelity Diverse Synthetic Battery Datasets 9 Apr 2023 · 0 repositories · arXiv:2304.06043
-
Predicting Short Term Energy Demand in Smart Grid: A Deep Learning Approach for Integrating Renewable Energy Sources in Line with SDGs 7, 9, and 13 8 Apr 2023 · 1 repository · arXiv:2304.03997
-
e-Uber: A Crowdsourcing Platform for Electric Vehicle-based Ride- and Energy-sharing 31 Mar 2023 · 0 repositories · arXiv:2304.04753
-
Optimization of Cryptocurrency Miners' Participation in Ancillary Service Markets 13 Mar 2023 · 0 repositories · arXiv:2303.07276
-
An Optimal Energy Management Algorithm Considering Regenerative Braking and Renewable Energy for EV Charging in Railway Stations 8 Mar 2023 · 0 repositories · arXiv:2303.04503
-
Optimization of a three-phase Induction Motor for Electric Vehicles Based on Hook-Jews Optimization Method 28 Feb 2023 · 0 repositories · arXiv:2302.14805
Tasks archive 2025-07-28
20 shown of 83 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections