Bruineberg, J;
Rietveld, E;
Parr, T;
van Maanen, L;
Friston, KJ;
(2018)
Free-energy minimization in joint agent-environment systems: A niche construction perspective.
Journal of Theoretical Biology
, 455
pp. 161-178.
10.1016/j.jtbi.2018.07.002.
Preview |
Text
1-s2.0-S0022519318303151-main.pdf - Published Version Download (2MB) | Preview |
Abstract
The free-energy principle is an attempt to explain the structure of the agent and its brain, starting from the fact that an agent exists (Friston and Stephan, 2007; Friston et al., 2010). More specifically, it can be regarded as a systematic attempt to understand the ‘fit’ between an embodied agent and its niche, where the quantity of free-energy is a measure for the ‘misfit’ or disattunement (Bruineberg and Rietveld, 2014) between agent and environment. This paper offers a proof-of-principle simulation of niche construction under the free-energy principle. Agent-centered treatments have so far failed to address situations where environments change alongside agents, often due to the action of agents themselves. The key point of this paper is that the minimum of free-energy is not at a point in which the agent is maximally adapted to the statistics of a static environment, but can better be conceptualized an attracting manifold within the joint agent-environment state-space as a whole, which the system tends toward through mutual interaction. We will provide a general introduction to active inference and the free-energy principle. Using Markov Decision Processes (MDPs), we then describe a canonical generative model and the ensuing update equations that minimize free-energy. We then apply these equations to simulations of foraging in an environment; in which an agent learns the most efficient path to a pre-specified location. In some of those simulations, unbeknownst to the agent, the ‘desire paths’ emerge as a function of the activity of the agent (i.e. niche construction occurs). We will show how, depending on the relative inertia of the environment and agent, the joint agent-environment system moves to different attracting sets of jointly minimized free-energy.
| Type: | Article |
|---|---|
| Title: | Free-energy minimization in joint agent-environment systems: A niche construction perspective |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.jtbi.2018.07.002 |
| Publisher version: | https://doi.org/10.1016/j.jtbi.2018.07.002 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Active inference, Free energy principle, Markov decision processes, Niche construction, Agent-environment complementarity, Adaptive environments, Desire paths |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Imaging Neuroscience |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10053769 |
Archive Staff Only
 |
View Item |
