Real-Time Adaptive Load Shedding Using Dual DDQN toward Criterion-Aware Post-Fault Frequency Recovery
Hao Yang1,*, Shuo Feng1, Bo Jin1, Fang Shi2, Zhenglong Sun1, Xiaohan Shi2
1 Key Laboratory of Modern Power System Simulation and Control & Renewable Energy Technology, Ministry of Education, Northeast Electric Power University, Jilin, China
2 School of Electrical Engineering, Shandong University, Jinan, China
* Corresponding Author: Hao Yang. Email:
Energy Engineering https://doi.org/10.32604/ee.2026.077417
Received 09 December 2025; Accepted 09 February 2026; Published online 02 March 2026
Abstract
To ensure secure post-fault frequency ride-through in modern power systems, the grid codes specify strict frequency recovery criterion (FRC) for different regional power systems. In response to the FRC, this paper proposes a decentralized adaptive load shedding strategy to enhance frequency recovery. First, a Markov decision process (MDP) is constructed to characterize the load shedding control procedure for frequency control. The frequency evolution status used to decide load shedding actions is extracted based on the FRC, which includes the magnitude deviation and the recovery time deviation of bus frequency. The load shedding amount and time delay for each shedding round are taken as the MDP actions. Reward functions are designed by considering both the load shedding cost and the FRC requirement for safe reinforcement learning (RL). Second, a framework of offline centralized learning and real-time decentralized control based on dual agents consisting of a load-shedding agent and a time-delay agent is proposed. By utilizing an RL-based double deep Q network (DDQN) algorithm, the dual agents learn the optimal load shedding policy that responds to the FRC through interactions with the MDP. Finally, a decentralized load shedding control strategy is constructed by deploying the well-trained dual agents at load bus stations. According to the real-time frequency evolution, the strategy can adaptively determine the time, location, amount, and round of load shedding to facilitate frequency recovery while meeting the FRC. Simulations on a modified IEEE 39 test system validate the effectiveness and adaptability of the proposed method.
Keywords
Frequency recovery control; load shedding control; Markov decision process; dual agents; double deep Q network; real-time decentralized load shedding strategy