Zhang, Y;
Fei, M;
Du, D;
Hu, Y;
(2025)
Resilient Secondary Frequency Control in Distributed Renewable Energy Microgrids Under Cyber Attacks: A Double Replay Q-Learning Approach.
IEEE Transactions on Smart Grid
10.1109/TSG.2025.3643161.
(In press).
Preview |
Text
Resilient_Secondary_Frequency_Control_in_Distributed_Renewable_Energy_Microgrids_Under_Cyber_Attacks_A_Double_Replay_Q-Learning_Approach.pdf - Accepted Version Download (5MB) | Preview |
Abstract
This paper addresses the challenge of resilient secondary frequency control in distributed renewable energy microgrids under False Data Injection Attacks. A rigorous Lyapunov based stability analysis is conducted, and a formal theorem is established that quantifies the maximum tolerable attack intensity under both actuator and sensor side intrusions. This theoretical tolerance boundary provides a principled and interpretable threshold for real time attack detection and secure control activation. Building upon this result, we propose a resilience framework that tightly integrates the derived physical safety boundary with an adaptive reinforcement learning controller. Specifically, a Double Replay Q-learning algorithm is developed, leveraging dual Q-tables and prioritized experience replay to enhance convergence speed and robustness under nonlinear REM dynamics. Simulation results conducted on both a real world experimental REM platform and a modified IEEE 9-Node test system validate the effectiveness and scalability of the proposed approach.
| Type: | Article |
|---|---|
| Title: | Resilient Secondary Frequency Control in Distributed Renewable Energy Microgrids Under Cyber Attacks: A Double Replay Q-Learning Approach |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TSG.2025.3643161 |
| Publisher version: | https://doi.org/10.1109/tsg.2025.3643161 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Adaptive compensation, Renewable energy microgrids, FDIA, Tolerance boundary, Double Replay Qlearning |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10219849 |
Archive Staff Only
![]() |
View Item |

