Optimal Resilient Tracking Control for Networked Systems With Multichannels Under Attacks

• Published in: IEEE transactions on industrial electronics (1982) Vol. 71; no. 3; pp. 3001 - 3011
• Main Authors: Yu, Yi, Liu, Guo-Ping, Huang, Yi, Hu, Wenshan
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.03.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Control algorithms; Control systems; Control systems design; Control theory; Controllers; Cyber-physical system (CPS); Cyber-physical systems; Cyberattack; Denial of service attacks; denial-of-service (DoS) attacks; Denial-of-service attack; Design; Discrete time systems; Game theory; Interference; Kalman filter; Kalman filters; Machine learning; Markov game; Markov processes; Nash equilibrium; Nash q-learning; Regulation; Remote sensors; resilient output tracking control; Signal to noise ratio; State estimation; Strategy; Tracking; Tracking control; Zero sum games
• ISSN: 0278-0046; 1557-9948
• DOI: 10.1109/TIE.2023.3269465

This article is concerned with the problem of resilient output tracking control for a class of discrete-time linear cyber-physical systems (CPSs) subject to denial-of-service attacks. The remote information exchange between the sensor and controller in CPSs employs a multichannel network because of its inherent advantages of resistance to destruction as well as to attacks. In order to design defense strategies to mitigate the negative impact of network attacks on the tracking performance of CPSs, considering the goals and energy constraints of both sides, the interaction process between them is modeled as a zero-sum stochastic game. Then, the Nash equilibrium of the problem is found with the help of the proposed Q-learning algorithm through an artfully designed state-based adaptive one-stage reward function. On the basis of the obtained optimal mixed strategy, the resilient output tracking controller is designed. Different from the work focusing on remote state estimation by means of game theory, this study makes the first effort to design a resilient output tracking control algorithm for CPSs with multiple channels using a stochastic game approach. Finally, the effectiveness of the proposed resilient controller with the optimal defense strategy is validated on a renewable energy generation system prototype by extensive case studies.