Endre søk
Link to record
Permanent link

Direct link
Publikasjoner (10 av 16) Visa alla publikasjoner
Zhang, M., Guo, G., Magnusson, S., Pilawa-Podgurski, R. C. N. & Xu, Q. (2024). Data Driven Decentralized Control of Inverter Based Renewable Energy Sources Using Safe Guaranteed Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Sustainable Energy, 15(2), 1288-1299
Åpne denne publikasjonen i ny fane eller vindu >>Data Driven Decentralized Control of Inverter Based Renewable Energy Sources Using Safe Guaranteed Multi-Agent Deep Reinforcement Learning
Vise andre…
2024 (engelsk)Inngår i: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, nr 2, s. 1288-1299Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

The wide integration of inverter based renewable energy sources (RESs) in modern grids may cause severe voltage violation issues due to high stochastic fluctuations of RESs. Existing centralized approaches can achieve optimal results for voltage regulation, but they have high communication burdens; existing decentralized methods only require local information, but they cannot achieve optimal results. Deep reinforcement learning (DRL) based methods are effective to deal with uncertainties, but it is difficult to guarantee secure constraints in existing DRL training. To address the above challenges, this paper proposes a projection embedded multi-agent DRL algorithm to achieve decentralized optimal control of distribution grids with guaranteed 100% safety. The safety of the DRL training is guaranteed via an embedded safe policy projection, which could smoothly and effectively restrict the DRL agent action space, and avoid any violation of physical constraints in distribution grid operations. The multi-agent implementation of the proposed algorithm enables the optimal solution achieved in a decentralized manner that does not require real-time communication for practical deployment. The proposed method is tested in modified IEEE 33-bus distribution and compared with existing methods; the results validate the effectiveness of the proposed method in achieving decentralized optimal control with guaranteed 100% safety and without the requirement of real-time communications.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2024
Emneord
Voltage control, Safety, Renewable energy sources, Uncertainty, Reinforcement learning, Real-time systems, Optimization, Inverter based renewable energy sources, deep neural network, deep reinforcement learning, safe, decentralized control
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-345993 (URN)10.1109/TSTE.2023.3341632 (DOI)001194520300027 ()2-s2.0-85180336097 (Scopus ID)
Merknad

QC 20240429

Tilgjengelig fra: 2024-04-29 Laget: 2024-04-29 Sist oppdatert: 2024-04-29bibliografisk kontrollert
Agredano Torres, M., Zhang, M., Söder, L. & Xu, Q. (2024). Decentralized Dynamic Power Sharing Control for Frequency Regulation Using Hybrid Hydrogen Electrolyzer Systems. IEEE Transactions on Sustainable Energy, 15(3), 1847-1858
Åpne denne publikasjonen i ny fane eller vindu >>Decentralized Dynamic Power Sharing Control for Frequency Regulation Using Hybrid Hydrogen Electrolyzer Systems
2024 (engelsk)Inngår i: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, nr 3, s. 1847-1858Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Hydrogen electrolyzers are promising tools for frequency regulation of future power systems with high penetration of renewable energies and low inertia. This is due to both the increasing demand for hydrogen and their flexibility as controllable load. The two main electrolyzer technologies are Alkaline Electrolyzers (AELs) and Proton Exchange Membrane Electrolyzers (PEMELs). However, they have trade-offs: dynamic response speed for AELs, and cost for PEMELs. This paper proposes the combination of both technologies into a Hybrid Hydrogen Electrolyzer System (HHES) to obtain a fast response for frequency regulation with reduced costs. A decentralized dynamic power sharing control strategy is proposed where PEMELs respond to the fast component of the frequency deviation, and AELs respond to the slow component, without the requirement of communication. The proposed decentralized approach facilitates a high reliability and scalability of the system, what is essential for expansion of hydrogen production. The effectiveness of the proposed strategy is validated in simulations and experimental results.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2024
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-348840 (URN)10.1109/tste.2024.3381491 (DOI)001252808200047 ()2-s2.0-85189352236 (Scopus ID)
Forskningsfinansiär
Swedish Energy Agency, 52650-1
Merknad

QC 20240628

Tilgjengelig fra: 2024-06-27 Laget: 2024-06-27 Sist oppdatert: 2024-07-05bibliografisk kontrollert
Zhang, M., Guo, G., Zhao, T. & Xu, Q. (2024). DNN Assisted Projection based Deep Reinforcement Learning for Safe Control of Distribution Grids. IEEE Transactions on Power Systems, 39(4), 5687-5698
Åpne denne publikasjonen i ny fane eller vindu >>DNN Assisted Projection based Deep Reinforcement Learning for Safe Control of Distribution Grids
2024 (engelsk)Inngår i: IEEE Transactions on Power Systems, ISSN 0885-8950, E-ISSN 1558-0679, Vol. 39, nr 4, s. 5687-5698Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Deep reinforcement learning (DRL) is a promising solution for voltage control of distribution grids with high penetration of inverter-based renewable energy sources (RESs). Yet, when adopting the DRL-based control method, the safe and optimal operation of the system cannot be guaranteed at the same time, as the conventional DRL agent is not designed to solve the hard constraint problem. To address this challenge, this paper proposes a deep neural network (DNN) assisted projection based DRL method for safe control of distribution grids. First, a finite iteration projection algorithm is proposed to guarantee hard constraints by converting a non-convex optimization problem into a finite iteration problem. Next, a DNN assisted projection method is proposed to accelerate the calculation of projection and achieve the practical implementation of hard constraints in DRL problem. Finally, a DNN Projection embedded twin-delayed deep deterministic policy gradient (DPe-TD3) method is proposed to achieve optimal operation of distribution grids with guaranteed 100% safety of the distribution grid. The safety of the DRL training is guaranteed via the embedded Projection DNN in TD3 with participation in gradient return process, which could smoothly and effectively project the DRL agent actions into the feasible area, thus guaranteeing the safety of data driven control and the optimal operation at the same time. The case studies and comparisons are conducted in the IEEE 33 bus system to show the effectiveness of the proposed method.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2024
Emneord
Artificial neural networks, deep neural network, deep reinforcement learning, distribution grid, inverter interfaced RESs, Inverters, Optimization, projection, safety, Safety, Security, Training, Voltage control
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-350174 (URN)10.1109/TPWRS.2023.3336614 (DOI)001252602200041 ()2-s2.0-85179111088 (Scopus ID)
Merknad

QC 20240709

Tilgjengelig fra: 2024-07-09 Laget: 2024-07-09 Sist oppdatert: 2024-07-15bibliografisk kontrollert
Wang, B., Li, Z., Fan, H., Wan, X., Xian, L., Zhang, M. & Xu, Q. (2024). Higher Order Sliding Mode Observer Based Fast Composite Backstepping Control for HESS in DC Microgrids. IEEE Transactions on Sustainable Energy, 15(3), 1627-1639
Åpne denne publikasjonen i ny fane eller vindu >>Higher Order Sliding Mode Observer Based Fast Composite Backstepping Control for HESS in DC Microgrids
Vise andre…
2024 (engelsk)Inngår i: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, nr 3, s. 1627-1639Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Hybrid energy storage system (HESS) is effective to compensate for fluctuation power in renewables and fast fluctuation loads in DC microgrids. To regulate DC bus voltage, a power management strategy is an essential issue. In the meantime, the increasing integration of constant power loads (CPLs) in DC microgrids brings great challenges to stable operation due to their negative incremental impedance. In this paper, a fast composite backstepping control (FBC) method is proposed for the HESS to achieve faster dynamics, smaller voltage variations, and large-signal stabilization. In the FBC method, a higher order sliding mode observer (HOSMO) is adopted to estimate the coupled disturbances. Furthermore, the FBC method is integrated with the droop control; so that the FBC-based decentralized power allocation (FBC-DPA) strategy for HESS in DC microgrids is developed. The proposed FBC method is designed based on the Lyapunov function to ensure its stability. Moreover, the design guidelines are provided to facilitate the application of the proposed method. Both simulation and experimental studies under different operating scenarios show that the proposed method achieves faster voltage recovery and smaller voltage variations than the conventional backstepping control method.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2024
Emneord
Microgrids, Voltage control, Stability analysis, Observers, Resource management, Energy storage, Backstepping, Backstepping control, higher order sliding mode observer, decentralized control, constant power loads, hybrid energy storage system, dc microgrid
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-350504 (URN)10.1109/TSTE.2024.3364653 (DOI)001252808200035 ()2-s2.0-85187280431 (Scopus ID)
Merknad

QC 20240716

Tilgjengelig fra: 2024-07-16 Laget: 2024-07-16 Sist oppdatert: 2024-07-16bibliografisk kontrollert
Zhang, M. & Xu, Q. (2023). An MPC based Power Management Method for Renewable Energy Hydrogen based DC Microgrids. In: 2023 IEEE Applied Power Electronics Conference and Exposition, APEC: . Paper presented at IEEE Applied Power Electronics Conference and Exposition (APEC), MAR 19-23, 2023, Orlando, FL, United States of America (pp. 577-581). Institute of Electrical and Electronics Engineers (IEEE)
Åpne denne publikasjonen i ny fane eller vindu >>An MPC based Power Management Method for Renewable Energy Hydrogen based DC Microgrids
2023 (engelsk)Inngår i: 2023 IEEE Applied Power Electronics Conference and Exposition, APEC, Institute of Electrical and Electronics Engineers (IEEE) , 2023, s. 577-581Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

The renewable energy hydrogen based dc microgrid is an attractive solution for renewables integration, as the hydrogen is a clean fuel, that extra renewable energy source generation can be stored as hydrogen through electrolysis technology, and be used later through fuel cell technology. However, the efficiency of the electrolyzer and fuel cell change significantly under the wide operation ranges, and they have different degradation mechanisms that are greatly impacted by current ripples. Moreover, to achieve consistent power supply with 100% RESs, the electrolyzer and fuel cell need to be optimally coordinated. To address the issues, this paper proposes an MPC based power management method to achieve smooth power sharing and reduce the current ripple, also can guarantee the system stability under uncertainties of the renewable energy source and load. It consists of a baseline MPC for optimized transient performance and a sliding mode observer to estimate system uncertainties. Both the simulation and experiment results can validate the effectiveness of the proposed method.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Serie
Annual IEEE Applied Power Electronics Conference and Exposition (APEC), ISSN 1048-2334
Emneord
Hydrogen, electrolyzer, microgrid, MPC, renewables
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-335128 (URN)10.1109/APEC43580.2023.10131431 (DOI)001012113600087 ()2-s2.0-85162201437 (Scopus ID)
Konferanse
IEEE Applied Power Electronics Conference and Exposition (APEC), MAR 19-23, 2023, Orlando, FL, United States of America
Merknad

QC 20230901

Tilgjengelig fra: 2023-09-01 Laget: 2023-09-01 Sist oppdatert: 2023-09-01bibliografisk kontrollert
Lu, Y., Zhang, M., Nordström, L. & Xu, Q. (2023). An Online Digital Twin based Health Monitoring Method for Boost Converter using Neural Network. In: 2023 IEEE Energy Conversion Congress and Exposition, ECCE 2023: . Paper presented at 2023 IEEE Energy Conversion Congress and Exposition, ECCE 2023, Nashville, United States of America, Oct 29 2023 - Nov 2 2023 (pp. 3701-3706). Institute of Electrical and Electronics Engineers (IEEE)
Åpne denne publikasjonen i ny fane eller vindu >>An Online Digital Twin based Health Monitoring Method for Boost Converter using Neural Network
2023 (engelsk)Inngår i: 2023 IEEE Energy Conversion Congress and Exposition, ECCE 2023, Institute of Electrical and Electronics Engineers (IEEE) , 2023, s. 3701-3706Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

This paper proposes a neural network-based digital twin for online health monitoring of vulnerable components in converters. The proposed digital twin consists of a physics-informed model with uncertain parameters, and a neural network (NN) for real-time model updating and health monitoring of components. This method is noninvasive, without extra circuits, and can identify parameters in real-time with high efficiency. Simulation and experiment are conducted to validate the effectiveness of the proposed method in accurate parameter identification and degradation monitoring of capacitor and MOSFET.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Emneord
boost converter, Digital twin, health monitoring, neural network, parameter identification
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-342813 (URN)10.1109/ECCE53617.2023.10362778 (DOI)2-s2.0-85182948515 (Scopus ID)
Konferanse
2023 IEEE Energy Conversion Congress and Exposition, ECCE 2023, Nashville, United States of America, Oct 29 2023 - Nov 2 2023
Merknad

Part of proceedings ISBN 9798350316445

QC 20240201

Tilgjengelig fra: 2024-01-31 Laget: 2024-01-31 Sist oppdatert: 2024-02-01bibliografisk kontrollert
Zhang, M., Xu, Q., Zhang, C., Nordström, L. & Blaabjerg, F. (2023). Decentralized Coordination and Stabilization of Hybrid Energy Storage Systems in DC Microgrids. In: 2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM: . Paper presented at IEEE-Power-and-Energy-Society General Meeting (PESGM), JUL 16-20, 2023, Orlando, FL. Institute of Electrical and Electronics Engineers (IEEE)
Åpne denne publikasjonen i ny fane eller vindu >>Decentralized Coordination and Stabilization of Hybrid Energy Storage Systems in DC Microgrids
Vise andre…
2023 (engelsk)Inngår i: 2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, Institute of Electrical and Electronics Engineers (IEEE) , 2023Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Hybrid energy storage system (HESS) is an attractive solution to compensate power balance issues caused by intermittent renewable generations and pulsed power load in DC microgrids. The purpose of HESS is to ensure optimal usage of heterogeneous storage systems with different characteristics. In this context, power allocation for different energy storage units is a major concern. At the same time, the wide integration of power electronic converters in DC microgrids would possibly cause the constant power load instability issue. This paper proposes a composite model predictive control based decentralized dynamic power sharing strategy for HESS. First, a composite model predictive controller (MPC) is proposed for a system with a single ESS and constant power loads (CPLs). It consists of a baseline MPC for optimized transient performance and a sliding mode observer to estimate system disturbances. Then, a coordinated scheme is developed for HESS by using the proposed composite MPC with a virtual resistance droop controller for the battery system and with a virtual capacitance droop controller for the supercapacitor (SC) system. With the proposed scheme, the battery only supplies smooth power at steady state, while the SC compensates all the fast fluctuations. The proposed scheme achieves a decentralized dynamic power sharing and optimized transient performance under large variation of sources and loads. The proposed approach is verified by simulations and experiments.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Serie
IEEE Power and Energy Society General Meeting PESGM, ISSN 1944-9925
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-340196 (URN)10.1109/PESGM52003.2023.10253066 (DOI)001084633401235 ()
Konferanse
IEEE-Power-and-Energy-Society General Meeting (PESGM), JUL 16-20, 2023, Orlando, FL
Merknad

Part of ISBN 978-1-6654-6441-3

QC 20231130

Tilgjengelig fra: 2023-11-30 Laget: 2023-11-30 Sist oppdatert: 2024-01-02bibliografisk kontrollert
Liu, R., Zhang, M. & Wang, Z. (2023). Disturbance Observer-Based Model Predictive Power Synchronization Control for Suppression of Synchronous Oscillation. In: IECON 2023 - 49th Annual Conference of the IEEE Industrial Electronics Society: . Paper presented at 49th Annual Conference of the IEEE Industrial Electronics Society, IECON 2023, Singapore, Singapore, Oct 16 2023 - Oct 19 2023. Institute of Electrical and Electronics Engineers (IEEE)
Åpne denne publikasjonen i ny fane eller vindu >>Disturbance Observer-Based Model Predictive Power Synchronization Control for Suppression of Synchronous Oscillation
2023 (engelsk)Inngår i: IECON 2023 - 49th Annual Conference of the IEEE Industrial Electronics Society, Institute of Electrical and Electronics Engineers (IEEE) , 2023Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Grid-forming (GFM) converters can achieve self-synchronization oriented by the active power balance, which is a promising solution for the high penetration of power electronics. Unfortunately, GFM control suffers from the synchronous oscillation (SO) issue, which may result in system instability. This paper proposes a disturbance observer-based model predictive power synchronization approach to suppress SOs of GFM converters. The mechanism of SO is investigated by the small-signal model of the grid-tied GFM converter, and it is revealed that the SO is induced by the electromagnetic dynamics of the power transfer in the transmission line and the power synchronization dynamics dominate this issue. Then, a model predictive power synchronization controller is proposed for mitigating SOs. In addition, a disturbance observer is developed to compensate the influence of disturbances/uncertainties in the system to improve the performance of power tracking. The proposed control approach is verified by simulations.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Emneord
Grid-forming converter, model predictive control, synchronous oscillation
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-341624 (URN)10.1109/IECON51785.2023.10312124 (DOI)2-s2.0-85179510741 (Scopus ID)
Konferanse
49th Annual Conference of the IEEE Industrial Electronics Society, IECON 2023, Singapore, Singapore, Oct 16 2023 - Oct 19 2023
Merknad

Part of ISBN 9798350331820

QC 20231228

Tilgjengelig fra: 2023-12-28 Laget: 2023-12-28 Sist oppdatert: 2023-12-28bibliografisk kontrollert
Agredano Torres, M., Xu, Q., Zhang, M., Söder, L. & Cornell, A. M. (2023). Dynamic power allocation control for frequency regulation using hybrid electrolyzer systems. In: 2023 IEEE Applied Power Electronics Conference And Exposition, APEC: . Paper presented at IEEE Applied Power Electronics Conference and Exposition (APEC), MAR 19-23, 2023, Orlando, FL, United States of America (pp. 2991-2998). Institute of Electrical and Electronics Engineers (IEEE)
Åpne denne publikasjonen i ny fane eller vindu >>Dynamic power allocation control for frequency regulation using hybrid electrolyzer systems
Vise andre…
2023 (engelsk)Inngår i: 2023 IEEE Applied Power Electronics Conference And Exposition, APEC, Institute of Electrical and Electronics Engineers (IEEE) , 2023, s. 2991-2998Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

The increase in hydrogen production to support the energy transition in different sectors, such as the steel industry, leads to the utilization of large scale electrolyzers. These electrolyzers have the ability to become a fundamental tool for grid stability providing grid services, especially frequency regulation, for power grids with a high share of renewable energy sources. Alkaline electrolyzers (AELs) have low cost and long lifetime, but their slow dynamics make them unsuitable for fast frequency regulation, especially in case of contingencies. Proton Exchange Membrane electrolyzers (PEMELs) have fast dynamic response to provide grid services, but they have higher costs. This paper proposes a dynamic power allocation control strategy for hybrid electrolyzer systems to provide frequency regulation with reduced cost, making use of advantages of AELs and PEMELs. Simulations and experiments are conducted to verify the proposed control strategy.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Serie
Annual IEEE Applied Power Electronics Conference and Exposition (APEC), ISSN 1048-2334
Emneord
Hydrogen, alkaline electrolyzer, PEM electrolyzer, frequency response, hybrid systems, low-inertia power systems
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-335124 (URN)10.1109/APEC43580.2023.10131557 (DOI)001012113603019 ()2-s2.0-85162217474 (Scopus ID)
Konferanse
IEEE Applied Power Electronics Conference and Exposition (APEC), MAR 19-23, 2023, Orlando, FL, United States of America
Merknad

QC 20230901

Tilgjengelig fra: 2023-09-01 Laget: 2023-09-01 Sist oppdatert: 2023-09-01bibliografisk kontrollert
Zhang, M., Xu, Q. & Wang, X. (2023). Physics-Informed Neural Network Based Online Impedance Identification of Voltage Source Converters. IEEE Transactions on Industrial Electronics, 70(4), 3717-3728
Åpne denne publikasjonen i ny fane eller vindu >>Physics-Informed Neural Network Based Online Impedance Identification of Voltage Source Converters
2023 (engelsk)Inngår i: IEEE Transactions on Industrial Electronics, ISSN 0278-0046, E-ISSN 1557-9948, Vol. 70, nr 4, s. 3717-3728Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

The wide integration of voltage source converters (VSCs) in power grids as the interface of renewables causes the converter-grid interaction stability challenge. The black-box impedance of VSCs identified at the converter terminal is the key to facilitate the study of converter-grid interaction stability. However, since the limited impedance data amount in online measurement, the existing impedance identification methods cannot accurately capture characteristics of the impedance model in various operating scenarios with the changing profiles of renewables and loads. In this article, a physics-informed neural network based impedance identification is proposed to fill this research gap. The physics knowledge of the VSC is used to compress the artificial neural network, which can reduce the calculation burden of online impedance identification. Meanwhile, the two-steps impedance identification is developed with the inspiration of the transfer learning theory to further increase the online impedance identification efficiency. This method can significantly reduce the required data amount used in online impedance identification for the online stability analysis with the changing operating points. The case studies confirm the effectiveness of the proposed method. 

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
Emneord
Grid-converter interaction, online impedance identification, physics-informed neural network, renewables, transfer learning, Electric power transmission networks, Phase locked loops, Power converters, System stability, Impedance, Impedance measurement, Neural-networks, Physic informed neural network, Power systems stability, Voltage source, Neural networks
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-324562 (URN)10.1109/TIE.2022.3177791 (DOI)000928140500044 ()2-s2.0-85131734638 (Scopus ID)
Merknad

QC 20230308

Tilgjengelig fra: 2023-03-08 Laget: 2023-03-08 Sist oppdatert: 2023-08-28bibliografisk kontrollert
Organisasjoner
Identifikatorer
ORCID-id: ORCID iD iconorcid.org/0000-0003-0746-0221