kth.sePublications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 57) Show all publications
Li, B. & Xu, Q. (2024). A Machine Learning-Assisted Distributed Optimization Method for Inverter-Based Volt-VAR Control in Active Distribution Networks. IEEE Transactions on Power Systems, 39(2), 2668-2681
Open this publication in new window or tab >>A Machine Learning-Assisted Distributed Optimization Method for Inverter-Based Volt-VAR Control in Active Distribution Networks
2024 (English)In: IEEE Transactions on Power Systems, ISSN 0885-8950, E-ISSN 1558-0679, Vol. 39, no 2, p. 2668-2681Article in journal (Refereed) Published
Abstract [en]

The number of smart inverters in active distribution networks is growing rapidly, making it challenging to realize a fast, distributed Volt/Var control (VVC). This work proposes a machine learning-assisted distributed algorithm to accelerate the solution of the VVC strategy. We first observe the convergence process of the Alternating Direction Method of Multipliers (ADMM)-based VVC problem and explore the potential relationships between the convergence and time-series regression. Then, the long short-term memory (LSTM) technique is applied to learn the convergence process and regress the converged values of the dual and global variables with previous ADMM observations. After that, the LSTM-assisted ADMM algorithm is proposed, where the regressions are used for ADMM parameter updates. In this algorithm, the inputs of the LSTM-model are carefully designed since the complementary conditions implied in the conventional ADMM should be considered. Unlike existing methods, the proposed method does not use the LSTM to determine the VVC strategy directly, indicating that it is non-intrusive and can satisfy all safety constraints during operations. The proof of its optimality and convergence is also given. The numerical simulations on the 33-bus distribution system demonstrate the effectiveness and efficiency of the proposed method.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Active distribution system, Volt/Var control, reactive power control, long short-term memory, alternating direction method of multipliers, data-driven optimization
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-348593 (URN)10.1109/TPWRS.2023.3279303 (DOI)001177135800020 ()2-s2.0-85161022439 (Scopus ID)
Note

QC 20240626

Available from: 2024-06-26 Created: 2024-06-26 Last updated: 2024-06-26Bibliographically approved
Lu, Y., Ghandhari Alavijh, M. & Xu, Q. (2024). Composite Control Scheme Based on Practical Droop and Tube Model Predictive Control for Electric Vehicles in Grid Frequency Regulation. In: ICIT 2024 - 2024 25th International Conference on Industrial Technology: . Paper presented at 25th IEEE International Conference on Industrial Technology, ICIT 2024, Bristol, United Kingdom of Great Britain and Northern Ireland, Mar 25 2024 - Mar 27 2024. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Composite Control Scheme Based on Practical Droop and Tube Model Predictive Control for Electric Vehicles in Grid Frequency Regulation
2024 (English)In: ICIT 2024 - 2024 25th International Conference on Industrial Technology, Institute of Electrical and Electronics Engineers (IEEE) , 2024Conference paper, Published paper (Refereed)
Abstract [en]

Power imbalances between generation and consumption will cause frequency deviations in the grid. In modern power systems, intermittent renewable energy sources (RES) have resulted in more frequent frequency violations, as traditional power plants cannot compensate for power gaps timely. Electric vehicles (EVs) can participate in load frequency control (LFC) through aggregators and are capable of reacting faster to control commands than conventional frequency control reserves (FCR) in generators. Thus EVs hold great promise in assisting with LFC. This paper proposes a composite control scheme that fully utilizes EVs for LFC in both normal scenarios and contingencies. The designed droop control can greatly reduce instantaneous frequency deviations (IFD) in emergencies, while the tube model predictive control (Tube MPC) can ensure smooth frequency trajectories during normal operations. Based on realistic models, simulation results illustrate the effectiveness of the proposed method.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Series
Proceedings of the IEEE International Conference on Industrial Technology, ISSN 2641-0184
Keywords
Electric Vehicle, Load Frequency Control, Tube MPC
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-348276 (URN)10.1109/ICIT58233.2024.10541023 (DOI)2-s2.0-85195805620 (Scopus ID)
Conference
25th IEEE International Conference on Industrial Technology, ICIT 2024, Bristol, United Kingdom of Great Britain and Northern Ireland, Mar 25 2024 - Mar 27 2024
Note

QC 20240624

Part of ISBN 979-835034026-6

Available from: 2024-06-20 Created: 2024-06-20 Last updated: 2024-06-24Bibliographically approved
Bhadoria, S., Xu, Q., Wang, X. & Nee, H.-P. (2024). Concept of Enabling Over-Current Capability of Silicon-Carbide-Based Power Converters with Gate Voltage Augmentation. Energies, 17(17), 4319
Open this publication in new window or tab >>Concept of Enabling Over-Current Capability of Silicon-Carbide-Based Power Converters with Gate Voltage Augmentation
2024 (English)In: Energies, E-ISSN 1996-1073, Vol. 17, no 17, p. 4319-Article in journal (Refereed) Published
Abstract [en]

An increasing share of fluctuating and intermittent renewable energy sources can cause over-currents (OCs) in the power system. The heat generated during OCs increases the junction temperature of semiconductor devices and could even lead to thermal runaway if thermal limits are reached. In order to keep the junction temperature within the thermal limit of the semiconductor, the power module structure with heat-absorbing material below the chip is investigated through COMSOL Multiphysics simulations. The upper limits of the junction temperature for Silicon (Si) and Silicon Carbide (SiC) are assumed to be 175 and 250 ∘∘C, respectively. The heat-absorbing materials considered for analysis are a copper block and a copper block with phase change materials (PCMs). Two times, three times, and four times of OCs would be discussed for durations of a few hundred milliseconds and seconds. This article also discusses the thermal performance of a copper block and a copper block with PCMs. PCMs used for Si and SiC are LM108 and Lithium, respectively. It is concluded that the copper block just below the semiconductor chip would enable OC capability in Si and SiC devices and would be more convenient to manufacture as compared to the copper block with PCM.

Place, publisher, year, edition, pages
MDPI, 2024
National Category
Energy Engineering
Identifiers
urn:nbn:se:kth:diva-342424 (URN)10.3390/en17174319 (DOI)001149106000001 ()2-s2.0-85203862699 (Scopus ID)
Note

QC 20240925

Available from: 2024-01-18 Created: 2024-09-12 Last updated: 2024-09-27Bibliographically approved
Zhang, M., Guo, G., Magnusson, S., Pilawa-Podgurski, R. C. N. & Xu, Q. (2024). Data Driven Decentralized Control of Inverter Based Renewable Energy Sources Using Safe Guaranteed Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Sustainable Energy, 15(2), 1288-1299
Open this publication in new window or tab >>Data Driven Decentralized Control of Inverter Based Renewable Energy Sources Using Safe Guaranteed Multi-Agent Deep Reinforcement Learning
Show others...
2024 (English)In: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, no 2, p. 1288-1299Article in journal (Refereed) Published
Abstract [en]

The wide integration of inverter based renewable energy sources (RESs) in modern grids may cause severe voltage violation issues due to high stochastic fluctuations of RESs. Existing centralized approaches can achieve optimal results for voltage regulation, but they have high communication burdens; existing decentralized methods only require local information, but they cannot achieve optimal results. Deep reinforcement learning (DRL) based methods are effective to deal with uncertainties, but it is difficult to guarantee secure constraints in existing DRL training. To address the above challenges, this paper proposes a projection embedded multi-agent DRL algorithm to achieve decentralized optimal control of distribution grids with guaranteed 100% safety. The safety of the DRL training is guaranteed via an embedded safe policy projection, which could smoothly and effectively restrict the DRL agent action space, and avoid any violation of physical constraints in distribution grid operations. The multi-agent implementation of the proposed algorithm enables the optimal solution achieved in a decentralized manner that does not require real-time communication for practical deployment. The proposed method is tested in modified IEEE 33-bus distribution and compared with existing methods; the results validate the effectiveness of the proposed method in achieving decentralized optimal control with guaranteed 100% safety and without the requirement of real-time communications.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Voltage control, Safety, Renewable energy sources, Uncertainty, Reinforcement learning, Real-time systems, Optimization, Inverter based renewable energy sources, deep neural network, deep reinforcement learning, safe, decentralized control
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-345993 (URN)10.1109/TSTE.2023.3341632 (DOI)001194520300027 ()2-s2.0-85180336097 (Scopus ID)
Note

QC 20240429

Available from: 2024-04-29 Created: 2024-04-29 Last updated: 2024-04-29Bibliographically approved
Agredano Torres, M., Zhang, M., Söder, L. & Xu, Q. (2024). Decentralized Dynamic Power Sharing Control for Frequency Regulation Using Hybrid Hydrogen Electrolyzer Systems. IEEE Transactions on Sustainable Energy, 15(3), 1847-1858
Open this publication in new window or tab >>Decentralized Dynamic Power Sharing Control for Frequency Regulation Using Hybrid Hydrogen Electrolyzer Systems
2024 (English)In: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, no 3, p. 1847-1858Article in journal (Refereed) Published
Abstract [en]

Hydrogen electrolyzers are promising tools for frequency regulation of future power systems with high penetration of renewable energies and low inertia. This is due to both the increasing demand for hydrogen and their flexibility as controllable load. The two main electrolyzer technologies are Alkaline Electrolyzers (AELs) and Proton Exchange Membrane Electrolyzers (PEMELs). However, they have trade-offs: dynamic response speed for AELs, and cost for PEMELs. This paper proposes the combination of both technologies into a Hybrid Hydrogen Electrolyzer System (HHES) to obtain a fast response for frequency regulation with reduced costs. A decentralized dynamic power sharing control strategy is proposed where PEMELs respond to the fast component of the frequency deviation, and AELs respond to the slow component, without the requirement of communication. The proposed decentralized approach facilitates a high reliability and scalability of the system, what is essential for expansion of hydrogen production. The effectiveness of the proposed strategy is validated in simulations and experimental results.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-348840 (URN)10.1109/tste.2024.3381491 (DOI)001252808200047 ()2-s2.0-85189352236 (Scopus ID)
Funder
Swedish Energy Agency, 52650-1
Note

QC 20240628

Available from: 2024-06-27 Created: 2024-06-27 Last updated: 2024-07-05Bibliographically approved
Zhang, M., Guo, G., Zhao, T. & Xu, Q. (2024). DNN Assisted Projection based Deep Reinforcement Learning for Safe Control of Distribution Grids. IEEE Transactions on Power Systems, 39(4), 5687-5698
Open this publication in new window or tab >>DNN Assisted Projection based Deep Reinforcement Learning for Safe Control of Distribution Grids
2024 (English)In: IEEE Transactions on Power Systems, ISSN 0885-8950, E-ISSN 1558-0679, Vol. 39, no 4, p. 5687-5698Article in journal (Refereed) Published
Abstract [en]

Deep reinforcement learning (DRL) is a promising solution for voltage control of distribution grids with high penetration of inverter-based renewable energy sources (RESs). Yet, when adopting the DRL-based control method, the safe and optimal operation of the system cannot be guaranteed at the same time, as the conventional DRL agent is not designed to solve the hard constraint problem. To address this challenge, this paper proposes a deep neural network (DNN) assisted projection based DRL method for safe control of distribution grids. First, a finite iteration projection algorithm is proposed to guarantee hard constraints by converting a non-convex optimization problem into a finite iteration problem. Next, a DNN assisted projection method is proposed to accelerate the calculation of projection and achieve the practical implementation of hard constraints in DRL problem. Finally, a DNN Projection embedded twin-delayed deep deterministic policy gradient (DPe-TD3) method is proposed to achieve optimal operation of distribution grids with guaranteed 100% safety of the distribution grid. The safety of the DRL training is guaranteed via the embedded Projection DNN in TD3 with participation in gradient return process, which could smoothly and effectively project the DRL agent actions into the feasible area, thus guaranteeing the safety of data driven control and the optimal operation at the same time. The case studies and comparisons are conducted in the IEEE 33 bus system to show the effectiveness of the proposed method.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Artificial neural networks, deep neural network, deep reinforcement learning, distribution grid, inverter interfaced RESs, Inverters, Optimization, projection, safety, Safety, Security, Training, Voltage control
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-350174 (URN)10.1109/TPWRS.2023.3336614 (DOI)001252602200041 ()2-s2.0-85179111088 (Scopus ID)
Note

QC 20240709

Available from: 2024-07-09 Created: 2024-07-09 Last updated: 2024-07-15Bibliographically approved
Luo, X., Gao, R., Li, X., Fu, Y., Xu, Q. & Guan, X. (2024). Event-Based Attack Detection and Mitigation for DC Microgrids via Adaptive LQR Approach. IEEE Transactions on Smart Grid, 15(4), 4196-4206
Open this publication in new window or tab >>Event-Based Attack Detection and Mitigation for DC Microgrids via Adaptive LQR Approach
Show others...
2024 (English)In: IEEE Transactions on Smart Grid, ISSN 1949-3053, E-ISSN 1949-3061, Vol. 15, no 4, p. 4196-4206Article in journal (Refereed) Published
Abstract [en]

Data manipulation attacks have become one of the main threats to cyber-physical direct current (DC) microgrids, but how to ensure voltage and current restoration under cyber attacks has not been well explored. In this paper, the event-based attack detection and mitigation problem for DC microgrids is considered. Specifically, an attack detection mechanism is designed to detect whether an attack has occurred. Then the proposed resilient secondary control strategy is only activated when the detection mechanism generates an attack event. For unknown types of attacks that aim at tampering with the information transmitted in the communication network, an adaptive linear quadratic regulator (LQR) based control strategy is designed to mitigate the effects such that the voltage and current restoration is achieved. Finally, the effectiveness of the proposed strategy is verified through simulationthis.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Microgrids, Cyberattack, Voltage control, Stability analysis, Decentralized control, Electronic mail, Communication networks, Cyber-physical systems, attack defense, DC microgrid, distributed control, event-based detection
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-350505 (URN)10.1109/TSG.2024.3365498 (DOI)001252808400029 ()2-s2.0-85187296348 (Scopus ID)
Note

QC 20240716

Available from: 2024-07-16 Created: 2024-07-16 Last updated: 2024-07-16Bibliographically approved
You, Y., Ye, Y., Xiao, G. & Xu, Q. (2024). Fast Incremental ADMM for Decentralized Consensus Multi-Agent Optimization. In: 2024 IEEE 18th International Conference on Control and Automation, ICCA 2024: . Paper presented at 18th IEEE International Conference on Control and Automation, ICCA 2024, Reykjavik, Iceland, Jun 18 2024 - Jun 21 2024 (pp. 473-477). IEEE Computer Society
Open this publication in new window or tab >>Fast Incremental ADMM for Decentralized Consensus Multi-Agent Optimization
2024 (English)In: 2024 IEEE 18th International Conference on Control and Automation, ICCA 2024, IEEE Computer Society , 2024, p. 473-477Conference paper, Published paper (Refereed)
Abstract [en]

The alternating direction method of multipliers (ADMM) has been recently recognized as well-suited for solving distributed optimization problems among multiple agents. Nonetheless, there remains a scarcity of research exploring ADMM's communication costs. Especially for large-scale multi-agent systems, the impact of communication costs becomes more significant. On the other hand, it is well-known that the convergence property of ADMM is significantly influenced by the different parameters while tuning these parameters arbitrarily would disrupt the convergence of ADMM. To this end, inspired by the preliminary works on incremental ADMM, we propose a fast incremental ADMM algorithm that can solve large-scale multi-agent optimization problems with enhanced communication efficiency and fast convergence speed. The proposed algorithm can improve the convergence speed by introducing an extra adjustable parameter to modify the penalty parameter ? in both primal and dual updates of incremental ADMM. With several mild assumptions, we provide the convergence analysis of our proposed algorithm. Finally, the numerical experiments demonstrate the superiority of the proposed fast incremental ADMM algorithm compared to the other incremental ADMM-type methods.

Place, publisher, year, edition, pages
IEEE Computer Society, 2024
National Category
Control Engineering Computer Sciences
Identifiers
urn:nbn:se:kth:diva-351969 (URN)10.1109/ICCA62789.2024.10591813 (DOI)2-s2.0-85200372307 (Scopus ID)
Conference
18th IEEE International Conference on Control and Automation, ICCA 2024, Reykjavik, Iceland, Jun 18 2024 - Jun 21 2024
Note

QC20240829Part of ISBN [9798350354409]

Available from: 2024-08-19 Created: 2024-08-19 Last updated: 2024-08-29Bibliographically approved
You, Y., Xu, Q. & Fischione, C. (2024). Hierarchical Online Game-Theoretic Framework for Real-Time Energy Trading in Smart Grid. IEEE Transactions on Smart Grid, 15(2), 1634-1645
Open this publication in new window or tab >>Hierarchical Online Game-Theoretic Framework for Real-Time Energy Trading in Smart Grid
2024 (English)In: IEEE Transactions on Smart Grid, ISSN 1949-3053, E-ISSN 1949-3061, Vol. 15, no 2, p. 1634-1645Article in journal (Refereed) Published
Abstract [en]

In this paper, the real-time energy trading problem between the energy provider and the consumers in a smart grid system is studied. The problem is formulated as a hierarchical game, where the energy provider acts as a leader who determines the pricing strategy that maximizes its profits, while the consumers act as followers who react by adjusting their energy demand to save their energy costs and enhance their energy consumption utility. In particular, the energy provider employs a pricing strategy that depends on the aggregated amount of energy requested by the consumers, which suits a commodity-limited market. With this price setting, the consumers' energy demand response strategies are designed under a non-cooperative game framework, where a unique generalized Nash equilibrium point is shown to exist. As an extension, the consumers are assumed to be unaware of their future energy consumption behaviors due to uncertain personal needs. To address this issue, an online distributed energy trading framework is proposed, where the energy provider and the consumers can design their strategies only based on the historical knowledge of consumers' energy consumption behavior at each bidding stage. Besides, the proposed framework can be implemented in a distributed manner such that the consumers can design their demand responses by only exchanging information with their neighboring consumers, which requires much fewer communication resources and would thus be more suitable for the practical operation of the grid. As a theoretical guarantee, the proposed framework is further proved to asymptotically achieve the same performance as the offline solution for both energy provider and consumers' optimization problems. The performance of practical designs of the proposed online distributed energy trading framework is finally illustrated in numerical experiments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Demand response, real-time pricing, utility-cost trade-off, non-cooperative game, generalized Nash equilibrium seeking, online learning
National Category
Energy Systems
Identifiers
urn:nbn:se:kth:diva-345543 (URN)10.1109/TSG.2023.3308055 (DOI)001174148100032 ()2-s2.0-85168735178 (Scopus ID)
Note

QC 20240415

Available from: 2024-04-15 Created: 2024-04-15 Last updated: 2024-04-15Bibliographically approved
Wang, B., Li, Z., Fan, H., Wan, X., Xian, L., Zhang, M. & Xu, Q. (2024). Higher Order Sliding Mode Observer Based Fast Composite Backstepping Control for HESS in DC Microgrids. IEEE Transactions on Sustainable Energy, 15(3), 1627-1639
Open this publication in new window or tab >>Higher Order Sliding Mode Observer Based Fast Composite Backstepping Control for HESS in DC Microgrids
Show others...
2024 (English)In: IEEE Transactions on Sustainable Energy, ISSN 1949-3029, E-ISSN 1949-3037, Vol. 15, no 3, p. 1627-1639Article in journal (Refereed) Published
Abstract [en]

Hybrid energy storage system (HESS) is effective to compensate for fluctuation power in renewables and fast fluctuation loads in DC microgrids. To regulate DC bus voltage, a power management strategy is an essential issue. In the meantime, the increasing integration of constant power loads (CPLs) in DC microgrids brings great challenges to stable operation due to their negative incremental impedance. In this paper, a fast composite backstepping control (FBC) method is proposed for the HESS to achieve faster dynamics, smaller voltage variations, and large-signal stabilization. In the FBC method, a higher order sliding mode observer (HOSMO) is adopted to estimate the coupled disturbances. Furthermore, the FBC method is integrated with the droop control; so that the FBC-based decentralized power allocation (FBC-DPA) strategy for HESS in DC microgrids is developed. The proposed FBC method is designed based on the Lyapunov function to ensure its stability. Moreover, the design guidelines are provided to facilitate the application of the proposed method. Both simulation and experimental studies under different operating scenarios show that the proposed method achieves faster voltage recovery and smaller voltage variations than the conventional backstepping control method.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Microgrids, Voltage control, Stability analysis, Observers, Resource management, Energy storage, Backstepping, Backstepping control, higher order sliding mode observer, decentralized control, constant power loads, hybrid energy storage system, dc microgrid
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-350504 (URN)10.1109/TSTE.2024.3364653 (DOI)001252808200035 ()2-s2.0-85187280431 (Scopus ID)
Note

QC 20240716

Available from: 2024-07-16 Created: 2024-07-16 Last updated: 2024-07-16Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-2793-9048

Search in DiVA

Show all publications