Adaptive trajectory controller design for unmanned surface vehicles based on SAC-PID

• Published in: Brodogradnja Vol. 76; no. 2; pp. 1 - 22
• Main Authors: Guan, Wei, Xi, Zhaoyong, Cui, Zhewen, Zhang, Xianku
• Format: Journal Article Paper
• Language: English
• Published: Sveučilište u Zagrebu Fakultet strojarstva i brodogradnje 01.01.2025; Faculty of Mechanical Engineering and Naval Architecture
• Subjects: Deep reinforcement learning; PID tuning; soft actor critic; unmanned surface vehicle
• ISSN: 0007-215X; 1845-5859
• DOI: 10.21278/brod76206

An adaptive proportional integral derivative (PID) controller based on the soft actor-critic (SAC) algorithm for trajectory control of unmanned surface vehicles (USV) is proposed in this paper. The gains of the PID controller need to be manually adjusted based on experience in the original formulation. Furthermore, once tuned, these gains remain fixed and making further modifications becomes time-consuming and labor-intensive. To address these limitations, the SAC algorithm is introduced, enabling online tuning of PID gains through agent-environment interaction. Additionally, the strategy of combining SAC algorithm with PID controller mitigates concerns regarding interpretability and security often associated with DRL. In this study, stability analysis of the adaptive trajectory controller based on the SAC-PID algorithm is conducted. This paper horizontally compares the proposed method with traditional PID tuning methods, genetic algorithms (GA), and deep deterministic policy gradient (DDPG) algorithm to highlight the superiority of the SAC-PID approach. Finally, experiments in different scenarios are performed to compare generalization capabilities between DDPG and SAC algorithms. Results demonstrate that the proposed SAC-PID algorithm exhibits excellent stability properties, fast convergence speed, and strong generalization ability.