Ghasempour, T;
Heydecker, B;
(2020)
Adaptive railway traffic control using approximate dynamic programming.
Transportation Research Part C: Emerging Technologies
, 113
pp. 91-107.
10.1016/j.trc.2019.04.002.
Preview |
Text
Taha Ghasempour-ISTTT23_v7.pdf - Accepted Version Download (1MB) | Preview |
Abstract
This study presents an adaptive railway traffic controller for real-time operations based on approximate dynamic programming (ADP). By assessing requirements and opportunities, the controller aims to limit consecutive delays resulting from trains that entered a control area behind schedule by sequencing them at a critical location in a timely manner, thus representing the practical requirements of railway operations. This approach depends on an approximation to the value function of dynamic programming after optimisation from a specified state, which is estimated dynamically from operational experience using reinforcement learning techniques. By using this approximation, the ADP avoids extensive explicit evaluation of performance and so reduces the computational burden substantially. In this investigation, we explore formulations of the approximation function and variants of the learning techniques used to estimate it. Evaluation of the ADP methods in a stochastic simulation environment shows considerable improvements in consecutive delays by comparison with the current industry practice of First-Come-First-Served sequencing. We also found that estimates of parameters of the approximate value function are similar across a range of test scenarios with different mean train entry delays.
| Type: | Article |
|---|---|
| Title: | Adaptive railway traffic control using approximate dynamic programming |
| Event: | 23rd International Symposium on Transportation and Traffic Theory, ISTTT 23 |
| Location: | Lausanne, Switzerland |
| Dates: | 24-26 July 2019 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.trc.2019.04.002 |
| Publisher version: | https://doi.org/10.1016/j.trc.2019.04.002 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Approximate Dynamic Programming; Railway Traffic Management; Adaptive Control; Reinforcement Learning |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10067679 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
