Doherty, Michael; Beghelli, Alejandra; (2025) Reinforcement Learning with Graph Attention for Routing and Wavelength Assignment with Lightpath Reuse. In: 2025 International Conference on Optical Network Design and Modeling (ONDM). (pp. pp. 1-6). IEEE

Preview

Text 2502.14741v2-3.pdf - Accepted Version Download (618kB) | Preview

Abstract

Many works have investigated reinforcement learning (RL) for routing and spectrum assignment on flex-grid networks but only one work has examined RL for fixed-grid with flex-rate transponders, despite production systems using this paradigm. Flex-rate transponders allow existing lightpaths to accommodate new services, a task we term routing and wavelength assignment with lightpath reuse (RWA-LR). We re-examine this problem case and present a thorough benchmarking of heuristic algorithms for RWA-LR, which are shown to have 6% increased throughput when candidate paths are ordered by number of hops, rather than total length. We train an RL agent for RWA-LR with graph attention networks for the policy and value functions to exploit the graph-structured data. We provide details of our methodology and open source all of our code for reproduction. We outperform the previous state-of-the-art RL approach by 2.5% (17.4 Tbps mean additional throughput) and the best heuristic by 1.2% (8.5 Tbps mean additional throughput). This marginal gain highlights the difficulty in learning effective RL policies on long horizon resource allocation tasks.

Download activity - last month

Export as JSONCSVXML

Download activity - last 12 months

Export as JSONCSVXML

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item