Song, Y;
Jiang, H;
Zhang, H;
Tian, Z;
Zhang, W;
Wang, J;
(2024)
Boosting Studies of Multi-Agent Reinforcement Learning on Google Research Football Environment: the Past, Present, and Future.
In:
Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS.
(pp. pp. 1772-1781).
Association for Computing Machinery (ACM): Auckland, New Zealand.
Preview |
Text
2309.12951v1.pdf - Accepted Version Download (20MB) | Preview |
Abstract
Even though Google Research Football (GRF) was initially bench-marked and studied as a single-agent environment in its original paper [19], recent years have witnessed an increasing focus on its multi-agent nature by researchers utilizing it as a testbed for Multi-Agent Reinforcement Learning (MARL), especially in the cooperative scenarios. However, the absence of standardized environment settings and unified evaluation metrics for multi-agent scenarios hampers the consistent understanding of various studies. Furthermore, the challenging 5 vs 5 and 11 vs 11 full-game scenarios have received limited thorough examination due to their substantial training complexities. To address these gaps, this paper extends the original environment by not only standardizing the environment settings and benchmarking cooperative learning algorithms across different scenarios, including the most challenging full-game scenarios, but also by discussing approaches to enhance football AI from diverse perspectives and introducing related research tools for learning beyond multi-agent cooperation. Specifically, we provide a distributed and asynchronous population-based self-play framework with diverse pre-trained policies for faster training, two football-specific analytical tools for deeper investigation, and an online leaderboard for broader evaluation. The overall expectation of this work is to advance the study of Multi-Agent Reinforcement Learning both on and with Google Research Football environment, with the ultimate goal of deploying these technologies to real-world applications, such as sports analysis.
| Type: | Proceedings paper |
|---|---|
| Title: | Boosting Studies of Multi-Agent Reinforcement Learning on Google Research Football Environment: the Past, Present, and Future |
| Event: | AAMAS '24: International Conference on Autonomous Agents and Multiagent Systems |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.5555/3635637.3663039 |
| Publisher version: | https://dl.acm.org/doi/10.5555/3635637.3663039 |
| Language: | English |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10206801 |
Archive Staff Only
 |
View Item |
