Reinforcement learning‐based optimized backstepping control for strict‐feedback nonlinear systems subject to external disturbances

• Published in: Optimal control applications & methods Vol. 44; no. 5; pp. 2724 - 2743
• Main Authors: Qin, Yan, Cao, Liang, Lu, Qing, Pan, Yingnan
• Format: Journal Article
• Language: English
• Published: Glasgow Wiley Subscription Services, Inc 01.09.2023
• Subjects: Algorithms; Control systems; Disturbances; Feedback; Liapunov functions; Machine learning; Neural networks; Nonlinear systems; Optimal control
• ISSN: 0143-2087; 1099-1514
• DOI: 10.1002/oca.3001

This article investigates a reinforcement learning‐based optimal backstepping control strategy for strict‐feedback nonlinear systems, which contain output constraints, external disturbances and uncertain unknown dynamics. The simplified reinforcement learning algorithm with the identifier‐critic‐actor architecture is constructed in the control design to build optimal virtual and actual controllers. To compensate for the disturbance, a lemma is adopted to transform external disturbances into an unknown “bounding functions‘’, which satisfy a triangular condition. Moreover, the unknown nonlinear functions, which composed of unknown dynamics and external disturbances, approximated by neural networks. Meanwhile, in order to avoid violating output constraints, a barrier‐type Lyapunov function approach is integrated into the optimal control strategy to satisfy output constraints requirements under the framework of backstepping technique. Furthermore, the presented optimal control strategy guarantees that all signals in the closed‐loop system are semi‐globally uniformly ultimately bounded. Finally, the effectiveness of the proposed optimal control approach is performed by a numerical example.