kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (10 of 90) Show all publications
Zhang, Y., Świderski, K. & Xu, Q. (2025). A Dynamic Power Management Strategy for Cascaded Multilevel Converter With Hybrid Energy Storage System. IEEE Transactions on Industrial Electronics, 72(12), 13253-13263
Open this publication in new window or tab >>A Dynamic Power Management Strategy for Cascaded Multilevel Converter With Hybrid Energy Storage System
2025 (English)In: IEEE Transactions on Industrial Electronics, ISSN 0278-0046, E-ISSN 1557-9948, Vol. 72, no 12, p. 13253-13263Article in journal (Refereed) Published
Abstract [en]

A cascaded multilevel converter (CMC) with hybrid energy storage system (HESS) offers a promising solution for high-voltage and high-power hybrid dc-ac systems. However, asymmetric power distribution (APD) across different energy storage systems (ESSs) presents a challenge. This article proposes a dynamic power management strategy for CMC-based HESS, featuring dynamic power sharing to optimize power allocation between batteries and supercapacitors (SCs) based on their distinct response times. In addition, battery state-of-charge (SOC) balancing and SC energy management strategies are introduced to maintain optimal energy distribution and ensure long-term operation. The approach enhances overall system performance by fully leveraging the complementary strengths of batteries and SCs. The effectiveness of this strategy is validated through simulations and experiments, confirming its scalability and adaptability to various CMC-based HESS configurations.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Dynamic power management strategy, cascaded multilevel converter (CMC), hybrid energy storage system (HESS)
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-372825 (URN)10.1109/TIE.2025.3579091 (DOI)001537086800001 ()2-s2.0-105012282140 (Scopus ID)
Note

QC 20251119

Available from: 2025-11-19 Created: 2025-11-19 Last updated: 2025-12-30Bibliographically approved
Hu, J. & Xu, Q. (2025). A Gaussian Process-Regularized Graphical Learning Method for Distribution System State Estimation Using Extremely Scarce State Variable Labels. IEEE Transactions on Smart Grid, 16(4), 3359-3376
Open this publication in new window or tab >>A Gaussian Process-Regularized Graphical Learning Method for Distribution System State Estimation Using Extremely Scarce State Variable Labels
2025 (English)In: IEEE Transactions on Smart Grid, ISSN 1949-3053, E-ISSN 1949-3061, Vol. 16, no 4, p. 3359-3376Article in journal (Refereed) Published
Abstract [en]

Learning-based distribution system state estimation (DSSE) methods typically depend on sufficient fully labeled data to construct mapping functions. However, collecting historical labels (state variables) can be challenging and costly in practice, resulting in performance degradation for these methods. To fully leverage low-cost unlabeled historical measurement data, this article proposes a Gaussian process (GP)-regularized semi-supervised learning method for DSSE models, aiming at achieving feasible estimation precision using minimal state variable labels while also providing valuable interval estimation of state variables. Firstly, a structure-informed graphical encoder is established to generate appropriate node embeddings. A tailored GP-regularized learning method is then developed to model the intermediate latent space using these embeddings. It constructs the unlabeled embeddings by a weighted combination of labeled space vectors, with the weights determined by a kernel function, thereby forming additional supervision and regularizing the learning process of the network in the latent space. The regularized embeddings are then fed into a decoder to yield estimation outcomes. This procedure enables the proposed method to model intrinsic correlations across measurement data, as well as capture essential patterns related to DSSE even using extremely limited state labels. The trained DSSE models can thus adapt to the domain of new measurements. Lastly, the decoder outcomes and related latent embeddings are processed through a composite GP kernel to further derive the interval estimation of state variables, enabling uncertainty quantification. Experimental results demonstrate the effectiveness of the proposed method in handling extremely limited historical state labels and accurately quantifying the uncertainty of state variables.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Estimation, Learning systems, Data models, State estimation, Training, Topology, Biological system modeling, Adaptation models, Uncertainty, Kernel, Distribution system state estimation, semi-supervised learning, Gaussian process, interval state estimation
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:kth:diva-370251 (URN)10.1109/TSG.2025.3552958 (DOI)001516515600025 ()2-s2.0-105001323768 (Scopus ID)
Note

QC 20251021

Available from: 2025-10-21 Created: 2025-10-21 Last updated: 2025-10-21Bibliographically approved
Wan, Y., Xu, Q. & Dragicevic, T. (2025). Adversarial Learning-Based Cybersecurity Framework for DC Microgrids. In: 2025 IEEE 7th International Conference on DC Microgrids, ICDCM 2025: . Paper presented at 7th IEEE International Conference on DC Microgrids, ICDCM 2025, Tallinn, Estonia, Jun 4 2025 - Jun 6 2025. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Adversarial Learning-Based Cybersecurity Framework for DC Microgrids
2025 (English)In: 2025 IEEE 7th International Conference on DC Microgrids, ICDCM 2025, Institute of Electrical and Electronics Engineers (IEEE) , 2025Conference paper, Published paper (Refereed)
Abstract [en]

The distributed control strategy has been widely employed, facilitating flexible and scalable coordination of different units in DC microgrids. However, the communication networks employed make them cyber-physical systems that are susceptible to cyberattacks. In this paper, a novel cybersecurity vulnerability identification and detection framework based on adversarial learning is developed for DC microgrids. Specifically, a multi-agent reinforcement learning (MARL) algorithm is used to emulate intelligent attackers that exploit system vulnerabilities by generating attacks capable of bypassing the existing detection mechanisms. In response, a data-driven attack detector is developed to complement the detection scheme, enhancing the overall detection capability. The framework utilizes an iterative adversarial learning process, wherein attacker and defender models continuously challenge and improve each other. This dynamic interaction enables the identification of a wider range of potential attacks, resulting in a more robust and adaptable detection mechanism for DC microgrids.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Adversarial learning, cyberattack detection, DC microgrids, distributed control, multi-agent reinforcement learning (MARL)
National Category
Computer Sciences Control Engineering
Identifiers
urn:nbn:se:kth:diva-371377 (URN)10.1109/ICDCM63994.2025.11144733 (DOI)2-s2.0-105017008336 (Scopus ID)
Conference
7th IEEE International Conference on DC Microgrids, ICDCM 2025, Tallinn, Estonia, Jun 4 2025 - Jun 6 2025
Note

Part of ISBN 979-8-3315-1274-3

QC 20251010

Available from: 2025-10-10 Created: 2025-10-10 Last updated: 2025-10-10Bibliographically approved
Hu, J., Hu, W., Cao, D., Xu, Q., Huang, Q., Chen, Z. & Blaabjerg, F. (2025). An Adaptive Noise-Resistant Learning Method for DSSE Considering Inaccurate Label Data. IEEE Transactions on Power Systems, 40(2), 1989-1992
Open this publication in new window or tab >>An Adaptive Noise-Resistant Learning Method for DSSE Considering Inaccurate Label Data
Show others...
2025 (English)In: IEEE Transactions on Power Systems, ISSN 0885-8950, E-ISSN 1558-0679, Vol. 40, no 2, p. 1989-1992Article in journal (Refereed) Published
Abstract [en]

The training process of learning-based distribution system state estimation (DSSE) methods relies on accurate state variables, which typically contain unknown noise and outliers in practice. To this end, this paper proposes an adaptive noise-resistant graphical learning-based DSSE method considering the impact of inaccurate state variables. Specifically, two global-scanning graph jumping connection networks are first developed to capture the regression rules between measurements and state variables considering the structure constraints. To mitigate the negative impact caused by inaccurate labels, a collaborative learning framework is further developed, within which Gaussian mixture model-based discriminators are employed to adaptively select clean samples in each mini-batch. These allow the method to obtain robustness against noisy state labels in historical data, as well as anomalous measurements during online operations. Comparative tests show the superiority of the proposed method in tackling abnormal data in both the training and test phases.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Training, Noise measurement, Noise, Peer-to-peer computing, Topology, Federated learning, Estimation, Artificial neural networks, Adaptation models, State estimation, Distribution system state estimation, inaccurate state labels, collaborative learning, graphical learning
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-371010 (URN)10.1109/TPWRS.2024.3518098 (DOI)001519973900015 ()2-s2.0-85212772891 (Scopus ID)
Note

QC 20251003

Available from: 2025-10-03 Created: 2025-10-03 Last updated: 2025-10-03Bibliographically approved
Agredano Torres, M. & Xu, Q. (2025). Decentralized Power Management of Hybrid Hydrogen Electrolyzer—Supercapacitor Systems for Frequency Regulation of Low-Inertia Grids. IEEE Transactions on Industrial Electronics, 1-10
Open this publication in new window or tab >>Decentralized Power Management of Hybrid Hydrogen Electrolyzer—Supercapacitor Systems for Frequency Regulation of Low-Inertia Grids
2025 (English)In: IEEE Transactions on Industrial Electronics, ISSN 0278-0046, E-ISSN 1557-9948, p. 1-10Article in journal (Refereed) Epub ahead of print
Abstract [en]

Large-scale hydrogen electrolyzers for hard-to-abate industries, such as steel industry, have the potential to be an essential tool of demand response in low inertial power systems with high shares of renewable energies. Their flexibility comes from the possibility to store hydrogen, decoupling electric consumption from hydrogen demand. Therefore, they can help in the integration of more renewable energies by the provision of grid services, such as frequency regulation. Alkaline electrolyzers (AELs) are the most mature and cost effective technology for large-scale hydrogen applications. However, their slow dynamics do not allow a fast response. Therefore, their combination with energy storage systems (ESSs) into hybrid hydrogen systems (HHSs) enhances their flexibility and fast response for frequency regulation. Supercapacitors (SCs) are suitable ESS technology in this application due to the high power and low energy required. A decentralized dynamic power sharing control is proposed for an AEL/SC HHS to provide frequency regulation with scalability. The control strategy respects the slow dynamics of the AEL, while the use of the SC is optimized by the automatic recovery of the dc bus voltage and SC state of charge (SoC). The decentralized approach of the control strategy enables easy expansion of the system, essential for large-scale hydrogen systems. The effectiveness of the method in large-scale power systems, as well as its scalability is shown in simulation results. The control strategy is validated with experimental results.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Decentralized control, electrolyzer, frequency control, hybrid systems, hydrogen, supercapacitor
National Category
Power Systems and Components
Identifiers
urn:nbn:se:kth:diva-361705 (URN)10.1109/tie.2025.3528468 (DOI)001411809900001 ()2-s2.0-85216830136 (Scopus ID)
Funder
Swedish Energy Agency, 52650-1
Note

QC 20250326

Available from: 2025-03-25 Created: 2025-03-25 Last updated: 2025-03-26Bibliographically approved
Lu, Y., Zhang, M., Nordström, L. & Xu, Q. (2025). Digital Twin-Based Cyber-Attack Detection and Mitigation for DC Microgrids. IEEE Transactions on Smart Grid, 16(2), 876-889
Open this publication in new window or tab >>Digital Twin-Based Cyber-Attack Detection and Mitigation for DC Microgrids
2025 (English)In: IEEE Transactions on Smart Grid, ISSN 1949-3053, E-ISSN 1949-3061, Vol. 16, no 2, p. 876-889Article in journal (Refereed) Published
Abstract [en]

DC microgrids (MGs) are cyber-physical systems (CPSs) prone to cyber attacks which could disrupt the normal operation of DC MGs. Accurate estimation of the attack vector is crucial to recover correct signals from compromised measurements for safe DC MG operation, while it has not been effectively achieved by existing methods and the accuracy is challenged by unmodeled uncertainties in practical power electronic converters. This paper proposes a digital twin (DT)-based cyber attack detection and mitigation scheme for DC MGs. First, the lightweight radial basis function neural network (RBFNN) is adopted to compensate for the mismatch between the ideal model and the real system for accurate converter modeling. Second, a composite descriptor observer-based local DT is designed to achieve accurate estimations of attack signals and correct observations of converter states. In addition, a global DT is developed at the system level to accurately estimate and eliminate cyber attacks in the secondary control. As a result, the proposed method can mitigate attacks by replacing the corrupted signals with estimated true values provided by DT, leading to accurate and stable operation of the system. Finally, simulation and experimental results are given to validate the effectiveness of the proposed method.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Prevention and mitigation, Cyberattack, Accuracy, Estimation, Voltage control, Mathematical models, Actuators, Uncertainty, Observers, Voltage measurement, DC microgrids, false data injection attack, digital twin, attack detection, attack mitigation
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-361347 (URN)10.1109/TSG.2024.3487049 (DOI)001428067700034 ()2-s2.0-85208403053 (Scopus ID)
Note

QC 20250317

Available from: 2025-03-17 Created: 2025-03-17 Last updated: 2025-03-17Bibliographically approved
Wang, X., Liu, S., Xu, Q. & Shao, X. (2025). Distributed multi-agent reinforcement learning for multi-objective optimal dispatch of microgrids. ISA transactions, 158, 130-140
Open this publication in new window or tab >>Distributed multi-agent reinforcement learning for multi-objective optimal dispatch of microgrids
2025 (English)In: ISA transactions, ISSN 0019-0578, E-ISSN 1879-2022, Vol. 158, p. 130-140Article in journal (Refereed) Published
Abstract [en]

The distributed microgrids cooperate to accomplish economic and environmental objectives, which have a vital impact on maintaining the reliable and economic operation of power systems. Therefore a distributed multi-agent reinforcement learning (MARL) algorithm is put forward incorporating the actor-critic architecture, which learns multiple critics for subtasks and utilizes only information from neighbors to find dispatch strategy. Based on our proposed algorithm, multi-objective optimal dispatch problem of microgrids with continuous state changes and power values is dealt with. Meanwhile, the computation and communication resources requirements are greatly reduced and the privacy of each agent is protected in the process of information interaction. In addition, the convergence for the proposed algorithm is guaranteed with the adoption of linear function approximation. Simulation results validate the performance of the algorithm, demonstrating its effectiveness in achieving multi-objective optimal dispatch in microgrids.

Place, publisher, year, edition, pages
Elsevier BV, 2025
Keywords
Multi-agent system, Distributed consensus strategy, Task decomposition, Multi-agent reinforcement learning, Microgrid
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-362790 (URN)10.1016/j.isatra.2025.01.009 (DOI)001445170000001 ()39880767 (PubMedID)2-s2.0-86000432465 (Scopus ID)
Note

QC 20250428

Available from: 2025-04-28 Created: 2025-04-28 Last updated: 2025-04-28Bibliographically approved
Yan, D., Mashhoodi, B., Kang, L., Sun, H., Söder, L., Ge, Y. E. & Xu, Q. (2025). Distributed Operation of Hydrogen Integrated Microgrids and Transportation System Considering Energy Sharing and Ancillary Service Market. IEEE Transactions on Transportation Electrification
Open this publication in new window or tab >>Distributed Operation of Hydrogen Integrated Microgrids and Transportation System Considering Energy Sharing and Ancillary Service Market
Show others...
2025 (English)In: IEEE Transactions on Transportation Electrification, E-ISSN 2332-7782Article in journal (Refereed) Epub ahead of print
Abstract [en]

The widespread adoption of electric vehicles (EVs) and hydrogen fuel cell electric vehicles (HVs) is tightening the interdependence between power and transportation systems, calling for better coordination between them. To address this challenge, this paper proposed a distributed coordination method for the hydrogen-integrated microgrids and transportation system. First, we introduce energy sharing among microgrids which reduces the overall system cost by 16.2% and analyze how it improves the traffic flow. Additionally, we develop bidding models for microgrids participating in joint energy and ancillary service markets, maximizing flexible resources utilization and increasing revenue by 147%. A mixed vehicle flow transportation system model is then established, including EVs, HVs, and gasoline vehicles. To coordinate the two individual systems efficiently, a distributed algorithm is proposed, incorporating a filtering mechanism that reduces the communication burden by 63% during the iterative process. Uncertainties and nonlinearities are handled using distributionally robust method and linearization techniques. Finally, case studies validate the effectiveness of the proposed method and highlight the mutual impact between the two systems.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Electric vehicle, electricity market, hydrogen, microgrid, transportation
National Category
Energy Systems Transport Systems and Logistics Other Electrical Engineering, Electronic Engineering, Information Engineering Control Engineering
Identifiers
urn:nbn:se:kth:diva-370094 (URN)10.1109/TTE.2025.3606786 (DOI)2-s2.0-105015154289 (Scopus ID)
Note

QC 20250919

Available from: 2025-09-19 Created: 2025-09-19 Last updated: 2026-01-08Bibliographically approved
Wan, Y., Xu, Q. & Dragicevic, T. (2025). Reinforcement Learning-Based Predictive Control for Power Electronic Converters. IEEE Transactions on Industrial Electronics, 72(5), 5353-5364
Open this publication in new window or tab >>Reinforcement Learning-Based Predictive Control for Power Electronic Converters
2025 (English)In: IEEE Transactions on Industrial Electronics, ISSN 0278-0046, E-ISSN 1557-9948, Vol. 72, no 5, p. 5353-5364Article in journal (Refereed) Published
Abstract [en]

Finite-set model predictive control (FS-MPC) appears to be a promising and effective control method for power electronic converters. Conventional FS-MPC suffers from the time-consuming process of weighting factor selection, which significantly impacts control performance. Another ongoing challenge of FS-MPC is its dependence on the prediction model for desirable control performance. To overcome the above issues, we propose to apply reinforcement learning (RL) to FS-MPC for power converters. The RL algorithm is first employed for the automatic weighting factor design of the FS-MPC, aiming to minimize the total harmonic distortion (THD) or reduce the average switching frequency. Furthermore, by formulating the incentive for the RL agent with the cost function of the predictive algorithm, the agent learns autonomously to find the optimal switching policy for the power converter by imitating the predictive controller without prior knowledge of the system model. Finally, a deployment framework that allows for experimental validation of the proposed RL-based methods on a practical FS-MPC regulated stand-alone converter configuration is presented. Two exemplary control objectives are demonstrated to show the effectiveness of the proposed RL-aided weighting factor tuning method. Moreover, the results show a good match between the model-free RL-based controller and the FS-MPC performance.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Finite-set model predictive control (FS-MPC), model-free controller, reinforcement learning (RL), voltage source converter (VSC), weighting factor design
National Category
Control Engineering Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-362695 (URN)10.1109/TIE.2024.3472299 (DOI)001346698900001 ()2-s2.0-85208112592 (Scopus ID)
Note

QC 20250425

Available from: 2025-04-23 Created: 2025-04-23 Last updated: 2025-04-25Bibliographically approved
Zhang, M. & Xu, Q. (2025). Safe Deep Reinforcement Learning for Renewable Energy Integrated Power System. In: Weiqi Hua; Xiao-Ping Zhang; David C.H. Wallom (Ed.), Digitalisation of Local Energy Systems: (pp. 313-336). Springer Nature, Part F989
Open this publication in new window or tab >>Safe Deep Reinforcement Learning for Renewable Energy Integrated Power System
2025 (English)In: Digitalisation of Local Energy Systems / [ed] Weiqi Hua; Xiao-Ping Zhang; David C.H. Wallom, Springer Nature , 2025, Vol. Part F989, p. 313-336Chapter in book (Other academic)
Abstract [en]

Deep reinforcement learning (DRL) is a promising solution for the coordination of power systems with high penetration of inverter-based renewable energy sources (RESs). Yet, when adopting the DRL-based control method, the safe and optimal operation of the system cannot be guaranteed at the same time, as the conventional DRL agent is not designed to solve the hard constraint problem. To address this challenge, a deep neural network (DNN) assisted projection-based DRL method for safe control of distribution grids is proposed in this section. First, a finite iteration projection algorithm is proposed to guarantee hard constraints by converting a non-convex optimization problem into a finite iteration problem. Next, a DNN-assisted projection method is proposed to accelerate the calculation of projection and achieve the practical implementation of hard constraints in the DRL problem. Finally, a DNN Projection embedded twin-delayed deep deterministic policy gradient (DPe-TD3) method is proposed to achieve optimal operation of distribution grids with guaranteed 100% safety of the distribution grid. The safety of the DRL training is guaranteed via the embedded Projection DNN in TD3 with participation in the gradient return process, which could smoothly and effectively project the DRL agent actions into the feasible area, thus guaranteeing the safety of data-driven control and the optimal operation at the same time. The case studies and comparisons are conducted in the IEEE 33 bus system to show the effectiveness of the proposed method.

Place, publisher, year, edition, pages
Springer Nature, 2025
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-372595 (URN)10.1007/978-3-031-77833-9_11 (DOI)2-s2.0-105019185039 (Scopus ID)
Note

Part of ISBN 9783031778322, 9783031778339

QC 20251111

Available from: 2025-11-11 Created: 2025-11-11 Last updated: 2025-11-11Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-2793-9048

Search in DiVA

Show all publications