UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networks

Frey, Markus; Doeller, Christian F; Barry, Caswell; (2023) Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networks. In: Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). (pp. pp. 2113-2121). IEEE: Vancouver, Canada. Green open access

[thumbnail of Frey_Probing_Neural_Representations_of_Scene_Perception_in_a_Hippocampally_Dependent_CVPR_2023_paper.pdf]
Preview
Text
Frey_Probing_Neural_Representations_of_Scene_Perception_in_a_Hippocampally_Dependent_CVPR_2023_paper.pdf - Accepted Version

Download (4MB) | Preview

Abstract

Deep artificial neural networks (DNNs) trained through back propagation provide effective models of the mammalian visual system, accurately capturing the hierarchy of neural responses through primary visual cortex to inferior temporal cortex (IT) [41, 43]. However, the ability of these networks to explain representations in higher cortical areas is relatively lacking and considerably less well researched. For example, DNNs have been less successful as a model of the egocentric to allocentric transformation embodied by circuits in retrosplenial and posterior parietal cortex. We describe a novel scene perception benchmark inspired by a hippocampal dependent task, designed to probe the ability of DNNs to transform scenes viewed from different egocentric perspectives. Using a network architecture inspired by the connectivity between temporal lobe structures and the hippocampus, we demonstrate that DNNs trained using a triplet loss can learn this task. Moreover, by enforcing a factorized latent space, we can split information propagation into “what” and “wdere” pathways, which we use to reconstruct the input. This allows us to beat the state-of-the-art for unsupervised object segmentation on the CATER and MOVi-A, B, C benchmarks.

Type: Proceedings paper
Title: Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networks
Event: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Location: CANADA, Vancouver
Dates: 17 Jun 2023 - 24 Jun 2023
ISBN-13: 979-8-3503-0129-8
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/CVPR52729.2023.00210
Publisher version: https://doi.org/10.1109/CVPR52729.2023.00210
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Scene analysis and understanding
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences > Cell and Developmental Biology
URI: https://discovery.ucl.ac.uk/id/eprint/10187094
Downloads since deposit
9Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item