Zhao, Z;
Ma, C;
Mi, Q;
Yang, N;
Yan, X;
Yang, M;
Zhang, H;
... Yang, Y; + view all
(2025)
Mean Field Correlated Imitation Learning.
In:
AAMAS '25: Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems.
(pp. pp. 2364-2372).
ACM (Association for Computing Machinery): Detroit, MI, USA.
Preview |
Text
2404.09324v2.pdf - Accepted Version Download (870kB) | Preview |
Abstract
Modeling the behaviors of many-agent games is crucial for capturing the dynamics of large-scale complex systems. This is typically achieved by recovering policies from demonstrations within the Mean Field Game Imitation Learning (MFGIL) framework. However, most MFGIL methods assume that demonstrations are collected from Mean Field Nash Equilibrium (MFNE), implying that agents make decisions independently. When directly applied to situations where agents' decisions are coordinated, such as publicly routed traffic networks, these techniques often fall short. In this paper, we propose the Adaptive Mean Field Correlated Equilibrium (AMFCE), which introduces a generalized assumption that effectively integrates the correlated behaviors common in real-world systems. We prove the existence of AMFCE under mild conditions and theoretically show that MFNE is a special case of AMFCE. Building upon this, we introduce a new Mean Field Correlated Imitation Learning (MFCIL) algorithm, which recovers expert policy more accurately in scenarios where agents' decisions are coordinated. We also provide a theoretical upper bound for the error in recovering the expert policy, which is tighter than that of existing methods. Empirical results on real-world traffic flow prediction and large-scale economic simulations demonstrate that MFCIL significantly improves the predictive performance of large populations' behaviors compared to existing MFGIL baselines. This improvement highlights potential of MFCIL to model real-world multi-agent systems.
| Type: | Proceedings paper |
|---|---|
| Title: | Mean Field Correlated Imitation Learning |
| Event: | AAMAS '25: 24th International Conference on Autonomous Agents and Multiagent Systems |
| Location: | MI, Detroit |
| Dates: | 19 May 2025 - 23 May 2025 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.5555/3709347.3743877 |
| Publisher version: | https://dl.acm.org/doi/10.5555/3709347.3743877 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Imitation Learning, Mean Field Games, Correlated Equilibrium |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10217056 |
Archive Staff Only
 |
View Item |
