Open this publication in new window or tab >>Show others...
2023 (English)In: 2023 IEEE Power and Energy Society General Meeting, PESGM 2023, Institute of Electrical and Electronics Engineers (IEEE) , 2023Conference paper, Published paper (Refereed)
Abstract [en]
The electrical grid is a safety-critical system, since incorrect actions taken by a power system operator can result in grid failure and cause harm. For this reason, it is desirable to have an automated power system operator that can reliably take actions that avoid grid failure while fulfilling some objective. Given the existing and growing complexity of power system operation, the choice has often fallen on deep reinforcement learning (DRL) agents for automation, but these are neither explainable nor provably safe. Therefore in this work, the effect of shielding on DRL agent survivability, validation computational time, and convergence are explored. To do this, shielded and unshielded DRL agents are evaluated on a standard IEEE 14-bus network. Agents are tasked with balancing generation and demand through redispatch and topology changing actions at a human timescale of 5 minutes. To test survivability under controlled conditions, varying degrees of scheduled unavailability events are introduced which could cause grid failure if unaddressed. Results show improved convergence and generally greater survivability of shielded agents compared with unshielded agents. However, the safety assurances provided by the shield increase computational time. This will require trade-offs or optimizations to make real-time deployment more feasible.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023
Keywords
deep learning, Deep reinforcement learning, power system operation, safe deep reinforcement learning
National Category
Computer Sciences Robotics and automation
Identifiers
urn:nbn:se:kth:diva-339277 (URN)10.1109/PESGM52003.2023.10252619 (DOI)001084633401007 ()2-s2.0-85174711633 (Scopus ID)
Conference
2023 IEEE Power and Energy Society General Meeting, PESGM 2023, Orlando, United States of America, Jul 16 2023 - Jul 20 2023
Note
Part of ISBN 9781665464413
QC 20231106
2023-11-062023-11-062025-02-05Bibliographically approved