Machine Learning-Based Control of Electric Vehicle Charging for Practical Distribution Systems With Solar Generation

• Published in: IEEE transactions on smart grid Vol. 15; no. 3; pp. 3098 - 3113
• Main Authors: Calero, Ivan, Canizares, Claudio A., Farrokhabadi, Mostafa, Bhattacharya, Kankar
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.05.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Batteries; Controllers; Costs; Deep deterministic policy gradient; Deep learning; deep reinforcement learning; demand response; distribution system; electric vehicle; Electric vehicle charging; Electric vehicles; Households; Load modeling; Low voltage; Machine learning; photovoltaic; Photovoltaic cells; State of charge; Transformers; Voltage control
• ISSN: 1949-3053; 1949-3061
• DOI: 10.1109/TSG.2023.3333789

The adoption of Electric Vehicles (EVs) and solar Photovoltaic (PV) generation by households is rapidly and significantly increasing. Utilities are facing the challenge of efficiently managing EV and PV resources to help mitigate the undesirable effects on grid operation. Existing approaches to solve these issues depend on accurate but hard to predict behavior of EVs and PVs, detailed knowledge of customers, and grid infrastructure, all of which complicate the effective deployment of these resources. Motivated by these practical challenges and in collaboration with industry partners working on addressing these issues, this paper proposes a two-level data-driven smart controller for EV charging in distribution systems. The controller is modeled as a Deep Reinforcement Learning (DRL) agent, which coordinates the charging rates of multiple EVs connected to a realistic residential feeder with high penetration of PV generation. The first level coordinates the aggregated EV load at distribution Medium Voltage (MV) level to provide Demand Response (DR) services; at the Low Voltage (LV) level it aims to maximize the EVs' state of charge at departure while avoiding the overloading of the MV/LV distribution transformers. The controller is verified through simulations on an actual utility grid facing the aforementioned challenges, demonstrating the effectiveness and practicality of the proposed DRL-based smart charging approach.