Data-driven control based on simultaneous perturbation stochastic approximation with adaptive weighted gradient estimation

• Published in: IET control theory & applications Vol. 10; no. 2; pp. 201 - 209
• Main Authors: Dong, Na, Wu, Chun-Ho, Gao, Zhong-Ke, Chen, Zeng-qiang, Ip, Wai-Hung
• Format: Journal Article
• Language: English
• Published: The Institution of Engineering and Technology 19.01.2016
• Subjects: Adaptive control systems; adaptive estimation; adaptive weighted gradient estimation method; Approximation; Computer simulation; Controllers; convergence; convergence analysis; data‐driven control strategy; discrete time systems; discrete‐time nonlinear plants; function approximation; function approximator; general discrete nonlinear systems; gradient methods; Mathematical analysis; Mathematical models; neural network; Neural networks; neurocontrollers; NN controller; nonlinear control systems; nonlinear tracking problems; Nonlinearity; parametric estimation; perturbation techniques; simultaneous perturbation stochastic approximation; stochastic processes; wastewater treatment system; nonlinear tracking problems; perturbation techniques; discrete time systems; convergence; wastewater treatment system; discrete-time nonlinear plants; data-driven control strategy; neural network; parametric estimation; function approximator; convergence analysis; function approximation; neurocontrollers; nonlinear control systems; general discrete nonlinear systems; simultaneous perturbation stochastic approximation; adaptive weighted gradient estimation method; stochastic processes; gradient methods; NN controller; adaptive estimation
• ISSN: 1751-8644; 1751-8652; 1751-8652
• DOI: 10.1049/iet-cta.2015.0636

This study proposes one novel data-driven control strategy based upon the simultaneous perturbation stochastic approximation method with adaptive weighted gradient estimation for general discrete non-linear systems. A function approximator is used to construct the controller, and here, it is fixed as a neural network (NN), whose structure is fixed previously, while allowing its connecting weights to be updated. The control parameters are then the connecting weights of the NN controller. The biggest advantage of this data-driven control approach is that it can generate a control signal to affect system's future performance without establishing the plant's mathematical model first. In this novel approach, to improve the control ability and accuracy, an adaptive weighted gradient estimation method is designed to do the parametric estimation with convergence analysis. Non-linear tracking problems for typical discrete-time non-linear plants are introduced for simulation comparison tests, and the convergence and feasibility of this newly proposed data-driven control strategy are well demonstrated through the simulation results. Finally, empirical study on a simulated wastewater treatment system is carried out to further illustrate the effectiveness of this newly proposed approach.