UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Reinforcement learning of local shape in the game of go

Silver, D; Sutton, R; Müller, M; (2007) Reinforcement learning of local shape in the game of go. In: (pp. pp. 1053-1058).

Full text not available from this repository.


We explore an application to the game of Go of a reinforcement learning approach based on a linear evaluation function and large numbers of binary features. This strategy has proved effective in game playing programs and other reinforcement learning applications. We apply this strategy to Go by creating over a million features based on templates for small fragments of the board, and then use temporal difference learning and self-play. This method identifies hundreds of low level shapes with recognisable significance to expert Go players, and provides quantitive estimates of their values. We analyse the relative contributions to performance of templates of different types and sizes. Our results show that small, translation-invariant templates are surprisingly effective. We assess the performance of our program by playing against the Average Liberty Player and a variety of computer opponents on the 9x9 Computer Go Server. Our linear evaluation function appears to outperform all other static evaluation functions that do not incorporate substantial domain knowledge.

Type: Proceedings paper
Title: Reinforcement learning of local shape in the game of go
URI: http://discovery.ucl.ac.uk/id/eprint/1347371
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item