Madjiheurem, S; Toni, L; (2019) Representation Learning on Graphs: A Reinforcement Learning Application. In: Chaudhuri, K and Sugiyama, M, (eds.) The 22nd International Conference on Artificial Intelligence and Statistics, 16-18 April 2019. Proceedings of Machine Learning Research (PMLR): Naha, Okinawa, Japan.

Preview

Text AISTATS2019-7-2.pdf - Accepted Version Download (2MB) | Preview

Abstract

In this work, we study value function approximation in reinforcement learning (RL) problems with high dimensional state or action spaces via a generalized version of representation policy iteration (RPI). We consider the limitations of proto-value functions (PVFs) at accurately approximating the value function in low dimensions and we highlight the importance of features learning for an improved low-dimensional value function approximation. Then, we adopt different representation learning algorithms on graphs to learn the basis functions that best represent the value function. We empirically show that node2vec, an algorithm for scalable feature learning in networks, and Graph Auto-Encoder constantly outperform the commonly used smooth proto-value functions in low-dimensional feature space.

Download activity - last month

Export as XMLJSONCSV

Download activity - last 12 months

Export as XMLJSONCSV

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item