UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Learning to win by reading manuals in a Monte-Carlo framework

Branavan, SRK; Barzilay, R; Silver, D; (2011) Learning to win by reading manuals in a Monte-Carlo framework. In: ACL-HLT 2011 - Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. (pp. 268 - 277).

Full text not available from this repository.

Abstract

This paper presents a novel approach for leveraging automatically extracted textual knowledge to improve the performance of control applications such as games. Our ultimate goal is to enrich a stochastic player with high-level guidance expressed in text. Our model jointly learns to identify text that is relevant to a given game state in addition to learning game strategies guided by the selected text. Our method operates in the Monte-Carlo search framework, and learns both text analysis and game strategies based only on environment feedback. We apply our approach to the complex strategy game Civilization II using the official game manual as the text guide. Our results show that a linguistically-informed game-playing agent significantly outperforms its language-unaware counterpart, yielding a 27% absolute improvement and winning over 78% of games when playing against the builtin AI of Civilization II. © 2011 Association for Computational Linguistics.

Type:Proceedings paper
Title:Learning to win by reading manuals in a Monte-Carlo framework
UCL classification:UCL > School of BEAMS > Faculty of Engineering Science > Computer Science

Archive Staff Only: edit this record