Staffolani, Alessandro;
Darvariu, Victor-Alexandru;
Foschini, Luca;
Girolami, Michele;
Bellavista, Paolo;
Musolesi, Mirco;
(2024)
PRORL: Proactive Resource Orchestrator for Open RANs Using Deep Reinforcement Learning.
IEEE Transactions on Network and Service Management
, 2023
10.1109/TNSM.2024.3373606.
(In press).
Preview |
Text
tsnm24_prorl.pdf - Accepted Version Download (7MB) | Preview |
Abstract
Open Radio Access Network (O-RAN) is an emerging paradigm proposed for enhancing the 5G network infrastructure. O-RAN promotes open vendor-neutral interfaces and virtualized network functions that enable the decoupling of network components and their optimization through intelligent controllers. The decomposition of base station functions enables better resource usage, but also opens new technical challenges concerning their efficient orchestration and allocation. In this paper, we propose Proactive Resource Orchestrator based on Reinforcement Learning (PRORL), a novel solution for the efficient and dynamic allocation of resources in O-RAN infrastructures. We frame the problem as a Markov Decision Process and solve it using Deep Reinforcement Learning; one relevant feature of PRORL is that it learns demand patterns from experience for proactive resource allocation. We extensively evaluate our proposal by using both synthetic and real-world data, showing that we can significantly outperform the existing algorithms, which are typically based on the analysis of static demands. More specifically, we achieve an improvement of 90% over greedy baselines and deal with complex trade-offs in terms of competing objectives such as demand satisfaction, resource utilization, and the inherent cost associated with allocating resources.
Type: | Article |
---|---|
Title: | PRORL: Proactive Resource Orchestrator for Open RANs Using Deep Reinforcement Learning |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1109/TNSM.2024.3373606 |
Publisher version: | https://doi.org/10.1109/TNSM.2024.3373606 |
Language: | English |
Additional information: | © The Author(s), 2024. This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. https://creativecommons.org/licenses/by/4.0/ |
Keywords: | O-RAN, reinforcement learning, resource allocation, multi-objective optimization |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10189737 |
Archive Staff Only
View Item |