Scaling Is All You Need: Autonomous Driving with JAX-Accelerated Reinforcement Learning

Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. However, running reinforcement learning experiments on the required scale for autonomous driving is extremely difficult. Building a large scale reinforcement learning system and distr...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Harmel, Moritz, Paras, Anubhav, Pasternak, Andreas, Roy, Nicholas, Linscott, Gary
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 08.02.2024
Subjects
Failure rates
Machine learning
Policies
Simulation
Simulators
Online AccessGet full text

Cover

More Information
Summary:Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. However, running reinforcement learning experiments on the required scale for autonomous driving is extremely difficult. Building a large scale reinforcement learning system and distributing it across many GPUs is challenging. Gathering experience during training on real world vehicles is prohibitive from a safety and scalability perspective. Therefore, an efficient and realistic driving simulator is required that uses a large amount of data from real-world driving. We bring these capabilities together and conduct large-scale reinforcement learning experiments for autonomous driving. We demonstrate that our policy performance improves with increasing scale. Our best performing policy reduces the failure rate by 64% while improving the rate of driving progress by 25% compared to the policies produced by state-of-the-art machine learning for autonomous driving.
ISSN:2331-8422