UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Compositional planning using optimal option models

Silver, D; Ciosek, K; (2012) Compositional planning using optimal option models. In: (pp. pp. 1063-1070).

Full text not available from this repository.

Abstract

In this paper we introduce a framework for option model composition. Option models are temporal abstractions that, like macrooperators in classical planning, jump directly from a start state to an end state. Prior work has focused on constructing option models from primitive actions, by intra-option model learning; or on using option models to construct a value function, by inter-option planning. We present a unified view of intra- and inter-option model learning, based on a major generalisation of the Bellman equation. Our fundamental operation is the recursive composition of option models into other option models. This key idea enables compositional planning over many levels of abstraction. We illustrate our framework using a dynamic programming algorithm that simultaneously constructs optimal option models for multiple subgoals, and also searches over those option models to provide rapid progress towards other subgoals. Copyright 2012 by the author(s)/owner(s).

Type: Proceedings paper
Title: Compositional planning using optimal option models
ISBN-13: 9781450312851
URI: http://discovery.ucl.ac.uk/id/eprint/1347368
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item