UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Mastering the game of Go without human knowledge

Silver, D; Schrittwieser, J; Simonyan, K; Antonoglou, I; Huang, A; Guez, A; Hubert, T; ... Hassabis, D; + view all (2017) Mastering the game of Go without human knowledge. Nature , 550 (7676) pp. 354-359. 10.1038/nature24270. Green open access

[thumbnail of agz_unformatted_nature.pdf]
Preview
Text
agz_unformatted_nature.pdf - Accepted Version

Download (2MB) | Preview

Abstract

A long-standing goal of artificial intelligence is an algorithm that learns, tabula rasa, superhuman proficiency in challenging domains. Recently, AlphaGo became the first program to defeat a world champion in the game of Go. The tree search in AlphaGo evaluated positions and selected moves using deep neural networks. These neural networks were trained by supervised learning from human expert moves, and by reinforcement learning from self-play. Here we introduce an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules. AlphaGo becomes its own teacher: a neural network is trained to predict AlphaGo’s own move selections and also the winner of AlphaGo’s games. This neural network improves the strength of the tree search, resulting in higher quality move selection and stronger self-play in the next iteration. Starting tabula rasa, our new program AlphaGo Zero achieved superhuman performance, winning 100–0 against the previously published, champion-defeating AlphaGo.

Type: Article
Title: Mastering the game of Go without human knowledge
Open access status: An open access version is available from UCL Discovery
DOI: 10.1038/nature24270
Publisher version: http://doi.org/10.1038/nature24270
Language: English
Additional information: © 2017 Macmillan Publishers Limited, part of Springer Nature. All rights reserved. This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Science & Technology, Multidisciplinary Sciences, Science & Technology - Other Topics, COMPUTER GO, TREE-SEARCH, WORLD, PLAY
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10045895
Downloads since deposit
76,942Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item