kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Energy Management of Smart Homes with Electric Vehicles Using Deep Reinforcement Learning
KTH, School of Electrical Engineering and Computer Science (EECS), Electrical Engineering, Electric Power and Energy Systems.
KTH, School of Electrical Engineering and Computer Science (EECS), Electrical Engineering, Electric Power and Energy Systems.ORCID iD: 0000-0002-2793-9048
KTH, School of Electrical Engineering and Computer Science (EECS), Electrical Engineering, Electric Power and Energy Systems.ORCID iD: 0000-0003-3014-5609
2022 (English)In: 2022 24th european conference on power electronics and applications (EPE'22 ECCE europe), IEEE, 2022Conference paper, Published paper (Refereed)
Abstract [en]

The proliferation of electric vehicles (EVs) has resulted in new charging infrastructure at all levels, including domestically. These new domestic EVs can potentially provide vehicle to home (V2H) services where EVs are used as energy storage systems (ESSs) for the home when they are not in use. Energy management systems (EMSs) can control these EVs to minimize the electricity cost to the owner but must satisfy constraints. Uncertainty in EV availability and the microgrid environment is also a challenge and can be addressed through real-time operation. Hence this paper formulates the EV charge/discharge scheduling problem as a Markov Decision Process (MDP). A safe implementation of Proximal Policy Optimization (PPO) is proposed for real-time optimization and compared to a day-ahead Mixed Integer Linear Programming (MILP) benchmark. The resulting PPO agent is able to minimize RA and SD costs for a typical EV user 3% better than the MILP solution. It obtains a 39% higher electricity cost than MILP, but unlike MILP does not require accurate forecasting data and operates in real-time.

Place, publisher, year, edition, pages
IEEE, 2022.
Series
European Conference on Power Electronics and Applications, ISSN 2325-0313
Keywords [en]
Energy Management System (EMS), Microgrid, Electric Vehicle, Energy storage, Deep learning, Safety
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:kth:diva-323920ISI: 000886231600108Scopus ID: 2-s2.0-85141585101OAI: oai:DiVA.org:kth-323920DiVA, id: diva2:1739608
Conference
24th European Conference on Power Electronics and Applications (EPE ECCE Europe), SEP 05-09, 2022, Hanover, GERMANY
Note

QC 20230227

Available from: 2023-02-27 Created: 2023-02-27 Last updated: 2023-06-14Bibliographically approved

Open Access in DiVA

No full text in DiVA

Scopus

Authority records

Weiss, XavierXu, QianwenNordström, Lars

Search in DiVA

By author/editor
Weiss, XavierXu, QianwenNordström, Lars
By organisation
Electric Power and Energy Systems
Other Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 106 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf