Papers › Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

9 May 2023arXiv:2305.05484archive 2025-07-28

Hou Shengren, Pedro P. Vergara, Edgar Mauricio Salazar Duque, Peter Palensky

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms arise as a promising solution due to their data-driven and model-free features. However, current DRL algorithms fail to enforce rigorous operational constraints (e.g., power balance, ramping up or down constraints) limiting their implementation in real systems. To overcome this, in this paper, a DRL algorithm (namely MIP-DQN) is proposed, capable of \textit{strictly} enforcing all operational constraints in the action space, ensuring the feasibility of the defined schedule in real-time operation. This is done by leveraging recent optimization advances for deep neural networks (DNNs) that allow their representation as a MIP formulation, enabling further consideration of any action space constraints. Comprehensive numerical simulations show that the proposed algorithm outperforms existing state-of-the-art DRL algorithms, obtaining a lower error when compared with the optimal global solution (upper boundary) obtained after solving a mathematical programming formulation with perfect forecast information; while strictly enforcing all operational constraints (even in unseen test days).

Paper PDF Code

Code

ShengrenHou/Energy-management-MIP-Deep-Reinforcement-Learning officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning Scheduling energy management reinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Test fail

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections