Küttler, H; Nardelli, N; Miller, AH; Raileanu, R; Selvatici, M; Grefenstette, E; Rocktäschel, T; (2020) The NetHack learning environment. In: Advances in Neural Information Processing Systems 33 (NeurIPS 2020). NeurIPS: Vancouver, Canada.

Preview

Text 2006.13760v2.pdf - Other Download (4MB) | Preview

Abstract

Progress in Reinforcement Learning (RL) algorithms goes hand-in-hand with the development of challenging environments that test the limits of current methods. While existing RL environments are either sufficiently complex or based on fast simulation, they are rarely both. Here, we present the NetHack Learning Environment (NLE), a scalable, procedurally generated, stochastic, rich, and challenging environment for RL research based on the popular single-player terminal-based roguelike game, NetHack. We argue that NetHack is sufficiently complex to drive long-term research on problems such as exploration, planning, skill acquisition, and language-conditioned RL, while dramatically reducing the computational resources required to gather a large amount of experience. We compare NLE and its task suite to existing alternatives, and discuss why it is an ideal medium for testing the robustness and systematic generalization of RL agents. We demonstrate empirical success for early stages of the game using a distributed Deep RL baseline and Random Network Distillation exploration, alongside qualitative analysis of various agents trained in the environment. NLE is open source and available at https://github.com/facebookresearch/nle.

Downloads since deposit

Loading...

9Downloads

Download activity - last month

Export as JSONCSVXML

Loading...

Download activity - last 12 months

Export as XMLJSONCSV

Loading...

Downloads by country - last 12 months

Export as CSVJSONXML

Loading...

Archive Staff Only

View Item