UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Resilient Secondary Frequency Control in Distributed Renewable Energy Microgrids Under Cyber Attacks: A Double Replay Q-Learning Approach

Zhang, Y; Fei, M; Du, D; Hu, Y; (2025) Resilient Secondary Frequency Control in Distributed Renewable Energy Microgrids Under Cyber Attacks: A Double Replay Q-Learning Approach. IEEE Transactions on Smart Grid 10.1109/TSG.2025.3643161. (In press). Green open access

[thumbnail of Resilient_Secondary_Frequency_Control_in_Distributed_Renewable_Energy_Microgrids_Under_Cyber_Attacks_A_Double_Replay_Q-Learning_Approach.pdf]
Preview
Text
Resilient_Secondary_Frequency_Control_in_Distributed_Renewable_Energy_Microgrids_Under_Cyber_Attacks_A_Double_Replay_Q-Learning_Approach.pdf - Accepted Version

Download (5MB) | Preview

Abstract

This paper addresses the challenge of resilient secondary frequency control in distributed renewable energy microgrids under False Data Injection Attacks. A rigorous Lyapunov based stability analysis is conducted, and a formal theorem is established that quantifies the maximum tolerable attack intensity under both actuator and sensor side intrusions. This theoretical tolerance boundary provides a principled and interpretable threshold for real time attack detection and secure control activation. Building upon this result, we propose a resilience framework that tightly integrates the derived physical safety boundary with an adaptive reinforcement learning controller. Specifically, a Double Replay Q-learning algorithm is developed, leveraging dual Q-tables and prioritized experience replay to enhance convergence speed and robustness under nonlinear REM dynamics. Simulation results conducted on both a real world experimental REM platform and a modified IEEE 9-Node test system validate the effectiveness and scalability of the proposed approach.

Type: Article
Title: Resilient Secondary Frequency Control in Distributed Renewable Energy Microgrids Under Cyber Attacks: A Double Replay Q-Learning Approach
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TSG.2025.3643161
Publisher version: https://doi.org/10.1109/tsg.2025.3643161
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Adaptive compensation, Renewable energy microgrids, FDIA, Tolerance boundary, Double Replay Qlearning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10219849
Downloads since deposit
24Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item