Optimizing electric vehicle charging scheduling using enhanced multi-agent neural networks with dynamic pricing

• Published in: Journal of energy storage Vol. 99; p. 113317
• Main Authors: Zulfiqar, M., ul Abdeen, Zain, Kamran, Muhammad
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 10.10.2024
• Subjects: Dynamic pricing; EV charging scheduling; Markov decision process; Neural network; Queuing model; Dynamic pricing; Markov decision process; Queuing model; Neural network; EV charging scheduling
• ISSN: 2352-152X
• DOI: 10.1016/j.est.2024.113317

Electric vehicles have gained widespread recognition as an environmentally conscious mode of transportation, primarily due to significant technological advancements and reduced emissions. When seamlessly integrated into the smart grid infrastructure, these vehicles can serve as flexible energy consumers and potential energy storage units. However, the efficient management of charging stations due to dynamic load demand & pricing poses a significant challenge, aiming to reduce wait times for electric vehicle owners and reduce electricity costs. To overcome this challenge, this study proposes a solution based on dynamic pricing policy and the adaptive Markov decision process. The approach utilizes a reinforcement learning-enabled enhanced multi-agent neural network (EMANN) to optimize charging schedules. This adaptive Markov decision process achieved optimal scheduling by minimizing charging costs during off-peak hours while completing charging in the shortest possible time. Furthermore, a constrained policy is employed to train the enhanced neural network using reinforcement learning, allowing the network to learn and solve adaptive Markov decision processes directly. To evaluate the effectiveness of this solution, the study conducted a numerical experiment using real-time data from Tesla electric vehicles. Combined with queuing models, the EMANN yielded impressive results, including a peak savings of 19.05% and an average profit of $376.1 per kilowatt-hour, achieved within a network convergence time of 512 s. The proposed algorithm for scheduling electric vehicles has been proven to be efficient in addressing the complexities associated with managing electric vehicle charging stations. •Efficient charging station management is crucial due to dynamic load demand and pricing.•A solution proposes dynamic pricing policies and adaptive Markov decision processes.•It employs a reinforcement learning-enabled Enhanced Multi-Agent Neural Network (EMANN) for optimal scheduling.•Numerical experiments using Tesla EV data showed peak savings of 19.05% and an average profit of $376.1 per kilowatt-hour within 512 s.•The solution effectively addresses dynamic load and pricing challenges.