UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

The anatomy of choice: active inference and agency.

Friston, K; Schwartenbeck, P; Fitzgerald, T; Moutoussis, M; Behrens, T; Dolan, RJ; (2013) The anatomy of choice: active inference and agency. Front Hum Neurosci , 7 , Article 598. 10.3389/fnhum.2013.00598. Green open access

[thumbnail of fnhum-07-00598.pdf]
Preview
PDF
fnhum-07-00598.pdf

Download (2MB)

Abstract

This paper considers agency in the setting of embodied or active inference. In brief, we associate a sense of agency with prior beliefs about action and ask what sorts of beliefs underlie optimal behavior. In particular, we consider prior beliefs that action minimizes the Kullback-Leibler (KL) divergence between desired states and attainable states in the future. This allows one to formulate bounded rationality as approximate Bayesian inference that optimizes a free energy bound on model evidence. We show that constructs like expected utility, exploration bonuses, softmax choice rules and optimism bias emerge as natural consequences of this formulation. Previous accounts of active inference have focused on predictive coding and Bayesian filtering schemes for minimizing free energy. Here, we consider variational Bayes as an alternative scheme that provides formal constraints on the computational anatomy of inference and action-constraints that are remarkably consistent with neuroanatomy. Furthermore, this scheme contextualizes optimal decision theory and economic (utilitarian) formulations as pure inference problems. For example, expected utility theory emerges as a special case of free energy minimization, where the sensitivity or inverse temperature (of softmax functions and quantal response equilibria) has a unique and Bayes-optimal solution-that minimizes free energy. This sensitivity corresponds to the precision of beliefs about behavior, such that attainable goals are afforded a higher precision or confidence. In turn, this means that optimal behavior entails a representation of confidence about outcomes that are under an agent's control.

Type: Article
Title: The anatomy of choice: active inference and agency.
Open access status: An open access version is available from UCL Discovery
DOI: 10.3389/fnhum.2013.00598
Publisher version: http://dx.doi.org/10.3389/fnhum.2013.00598
Additional information: © 2013 Friston, Schwartenbeck, FitzGerald, Moutoussis, Behrens and Dolan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Keywords: Bayesian, active inference, agency, bounded rationality, embodied cognition, free energy, inference, utility theory
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Imaging Neuroscience
URI: https://discovery.ucl.ac.uk/id/eprint/1423324
Downloads since deposit
341Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item