UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Orthogonal representations for robust context-dependent task performance in brains and neural networks

Flesch, Timo; Juechems, Keno; Dumbalska, Tsvetomira; Saxe, Andrew; Summerfield, Christopher; (2022) Orthogonal representations for robust context-dependent task performance in brains and neural networks. Neuron , 110 (7) pp. 1258-1270. 10.1016/j.neuron.2022.01.005. Green open access

[thumbnail of Saxe_1-s2.0-S0896627322000058-main_.pdf]
Preview
Text
Saxe_1-s2.0-S0896627322000058-main_.pdf

Download (11MB) | Preview

Abstract

How do neural populations code for multiple, potentially conflicting tasks? Here we used computational simulations involving neural networks to define “lazy” and “rich” coding solutions to this context-dependent decision-making problem, which trade off learning speed for robustness. During lazy learning the input dimensionality is expanded by random projections to the network hidden layer, whereas in rich learning hidden units acquire structured representations that privilege relevant over irrelevant features. For context-dependent decision-making, one rich solution is to project task representations onto low-dimensional and orthogonal manifolds. Using behavioral testing and neuroimaging in humans and analysis of neural signals from macaque prefrontal cortex, we report evidence for neural coding patterns in biological brains whose dimensionality and neural geometry are consistent with the rich learning regime.

Type: Article
Title: Orthogonal representations for robust context-dependent task performance in brains and neural networks
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.neuron.2022.01.005
Publisher version: https://doi.org/10.1016/j.neuron.2022.01.005
Language: English
Additional information: © 2022 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Keywords: Representational geometry; artificial neural networks; task learning; functional magnetic resonance imaging; orthogonal manifolds
UCL classification: UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neurosci Unit
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10142700
Downloads since deposit
90Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item