Error-Tolerant Iterative Adaptive Dynamic Programming for Optimal Renewable Home Energy Scheduling and Battery Management

• Published in: IEEE transactions on industrial electronics (1982) Vol. 64; no. 12; pp. 9527 - 9537
• Main Authors: Qinglai Wei, Lewis, Frank L., Guang Shi, Ruizhuo Song
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptive algorithms; Adaptive control; Adaptive critic designs; adaptive dynamic programming (ADP); Algorithms; approximate dynamic programming; Batteries; Convergence; Dynamic programming; Electric rates; Electricity; Electricity consumption; Energy management; Heuristic algorithms; home energy systems; Iterative algorithms; Iterative methods; Laws; Neural networks; Optimal control; Performance indices; Periodic functions; Power management; Renewable energy; Renewable energy sources; Residential energy; Scheduling; smart grid
• ISSN: 0278-0046; 1557-9948
• DOI: 10.1109/TIE.2017.2711499

In this paper, a novel error-tolerant iterative adaptive dynamic programming (ADP) algorithm is developed to solve optimal battery control and management problems in smart home environments with renewable energy. A main contribution for the iterative ADP algorithm is to implement with the electricity rate, home load demand, and renewable energy as quasi-periodic functions, instead of accurate periodic functions, where the discount factor can adaptively be regulated in each iteration to guarantee the convergence of the iterative value function. A new analysis method is developed to guarantee the iterative value function to converge to a finite neighborhood of the optimal performance index function, in spite of the differences of the electricity rate, the home load demand, and the renewable energy in different periods. Neural networks are employed to approximate the iterative value function and control law, respectively, for facilitating the implementation of the iterative ADP algorithm. Numerical results and comparisons are given to illustrate the performance of the developed algorithm.