High-speed Autonomous Racing using Trajectory-aided Deep Reinforcement Learning

The classical method of autonomous racing uses real-time localisation to follow a precalculated optimal trajectory. In contrast, end-to-end deep reinforcement learning (DRL) can train agents to race using only raw LiDAR scans. While classical methods prioritise optimization for high-performance raci...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Evans, Benjamin David, Herman Arnold Engelbrecht, Jordaan, Hendrik Willem
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 12.06.2023
Subjects
Algorithms
Deep learning
Racing
Trajectory optimization
Online AccessGet full text

Cover

More Information
Summary:The classical method of autonomous racing uses real-time localisation to follow a precalculated optimal trajectory. In contrast, end-to-end deep reinforcement learning (DRL) can train agents to race using only raw LiDAR scans. While classical methods prioritise optimization for high-performance racing, DRL approaches have focused on low-performance contexts with little consideration of the speed profile. This work addresses the problem of using end-to-end DRL agents for high-speed autonomous racing. We present trajectory-aided learning (TAL) that trains DRL agents for high-performance racing by incorporating the optimal trajectory (racing line) into the learning formulation. Our method is evaluated using the TD3 algorithm on four maps in the open-source F1Tenth simulator. The results demonstrate that our method achieves a significantly higher lap completion rate at high speeds compared to the baseline. This is due to TAL training the agent to select a feasible speed profile of slowing down in the corners and roughly tracking the optimal trajectory.
ISSN:2331-8422