UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Hippocampal contributions to control: The third way

Lengyel, M; Dayan, P; (2009) Hippocampal contributions to control: The third way. In: Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference.

Full text not available from this repository.

Abstract

Recent experimental studies have focused on the specialization of different neural structures for different types of instrumental behavior. Recent theoretical work has provided normative accounts for why there should be more than one control system, and how the output of different controllers can be integrated. Two particlar controllers have been identified, one associated with a forward model and the prefrontal cortex and a second associated with computationally simpler, habitual, actor-critic methods and part of the striatum. We argue here for the normative appropriateness of an additional, but so far marginalized control system, associated with episodic memory, and involving the hippocampus and medial temporal cortices. We analyze in depth a class of simple environments to show that episodic control should be useful in a range of cases characterized by complexity and inferential noise, and most particularly at the very early stages of learning, long before habitization has set in. We interpret data on the transfer of control from the hippocampus to the striatum in the light of this hypothesis.

Type:Proceedings paper
Title:Hippocampal contributions to control: The third way
UCL classification:UCL > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neuroscience Unit

Archive Staff Only: edit this record