Reinforcement Learning in Railway Timetable Rescheduling

Real-time railway traffic management is important for the daily operations of railway systems. It predicts and resolves operational conflicts caused by events like excessive passenger boardings/alightings. Traditional optimization methods for this problem are restricted by the size of the problem in...

Full description

Saved in:
Bibliographic Details
Published in2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC) pp. 1 - 6
Main Authors Zhu, Yongqiu, Wang, Hongrui, Goverde, Rob M.P.
Format Conference Proceeding
LanguageEnglish
Published IEEE 20.09.2020
Subjects
Delays
Heuristic algorithms
Junctions
Rail transportation
Reinforcement learning
Tracking
Training
Online AccessGet full text

Cover

More Information
Summary:Real-time railway traffic management is important for the daily operations of railway systems. It predicts and resolves operational conflicts caused by events like excessive passenger boardings/alightings. Traditional optimization methods for this problem are restricted by the size of the problem instances. Therefore, this paper proposes a reinforcement learning-based timetable rescheduling method. Our method learns how to reschedule a timetable off-line and then can be applied online to make an optimal dispatching decision immediately by sensing the current state of the railway environment. Experiments show that the rescheduling solution obtained by the proposed reinforcement learning method is affected by the state representation of the railway environment. The proposed method was tested to a part of the Dutch railways considering scenarios with single initial train delays and multiple initial train delays. In both cases, our method found high-quality rescheduling solutions within limited training episodes.
DOI:10.1109/ITSC45102.2020.9294188