Exploration of Reinforcement Learning for Event Camera using Car-like Robots

• Main Authors: Arakawa, Riku, Shiba, Shintaro
• Format: Journal Article
• Language: English
• Published: 01.04.2020
• Subjects: Computer Science - Artificial Intelligence; Computer Science - Learning; Computer Science - Robotics
• DOI: 10.48550/arxiv.2004.00801

We demonstrate the first reinforcement-learning application for robots equipped with an event camera. Because of the considerably lower latency of the event camera, it is possible to achieve much faster control of robots compared with the existing vision-based reinforcement-learning applications using standard cameras. To handle a stream of events for reinforcement learning, we introduced an image-like feature and demonstrated the feasibility of training an agent in a simulator for two tasks: fast collision avoidance and obstacle tracking. Finally, we set up a robot with an event camera in the real world and then transferred the agent trained in the simulator, resulting in successful fast avoidance of randomly thrown objects. Incorporating event camera into reinforcement learning opens new possibilities for various robotics applications that require swift control, such as autonomous vehicles and drones, through end-to-end learning approaches.