Frey, Markus;
Doeller, Christian F;
Barry, Caswell;
(2023)
Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networks.
In:
Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
(pp. pp. 2113-2121).
IEEE: Vancouver, Canada.
Preview |
Text
Frey_Probing_Neural_Representations_of_Scene_Perception_in_a_Hippocampally_Dependent_CVPR_2023_paper.pdf - Accepted Version Download (4MB) | Preview |
Abstract
Deep artificial neural networks (DNNs) trained through back propagation provide effective models of the mammalian visual system, accurately capturing the hierarchy of neural responses through primary visual cortex to inferior temporal cortex (IT) [41, 43]. However, the ability of these networks to explain representations in higher cortical areas is relatively lacking and considerably less well researched. For example, DNNs have been less successful as a model of the egocentric to allocentric transformation embodied by circuits in retrosplenial and posterior parietal cortex. We describe a novel scene perception benchmark inspired by a hippocampal dependent task, designed to probe the ability of DNNs to transform scenes viewed from different egocentric perspectives. Using a network architecture inspired by the connectivity between temporal lobe structures and the hippocampus, we demonstrate that DNNs trained using a triplet loss can learn this task. Moreover, by enforcing a factorized latent space, we can split information propagation into “what” and “wdere” pathways, which we use to reconstruct the input. This allows us to beat the state-of-the-art for unsupervised object segmentation on the CATER and MOVi-A, B, C benchmarks.
Type: | Proceedings paper |
---|---|
Title: | Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networks |
Event: | 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
Location: | CANADA, Vancouver |
Dates: | 17 Jun 2023 - 24 Jun 2023 |
ISBN-13: | 979-8-3503-0129-8 |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1109/CVPR52729.2023.00210 |
Publisher version: | https://doi.org/10.1109/CVPR52729.2023.00210 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Scene analysis and understanding |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences > Cell and Developmental Biology |
URI: | https://discovery.ucl.ac.uk/id/eprint/10187094 |
Archive Staff Only
View Item |