Sexton, Nicholas J;
Love, Bradley C;
(2022)
Reassessing hierarchical correspondences between brain and deep networks through direct interface.
Science Advances
, 8
(28)
10.1126/sciadv.abm2219.
Preview |
Text
sciadv.abm2219.pdf - Published Version Download (1MB) | Preview |
Abstract
Functional correspondences between deep convolutional neural networks (DCNNs) and the mammalian visual system support a hierarchical account in which successive stages of processing contain ever higher-level information. However, these correspondences between brain and model activity involve shared, not task-relevant, variance. We propose a stricter account of correspondence: If a DCNN layer corresponds to a brain region, then replacing model activity with brain activity should successfully drive the DCNN’s object recognition decision. Using this approach on three datasets, we found that all regions along the ventral visual stream best corresponded with later model layers, indicating that all stages of processing contained higher-level information about object category. Time course analyses suggest that long-range recurrent connections transmit object class information from late to early visual areas.
| Type: | Article |
|---|---|
| Title: | Reassessing hierarchical correspondences between brain and deep networks through direct interface |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1126/sciadv.abm2219 |
| Publisher version: | https://doi.org/10.1126/sciadv.abm22 |
| Language: | English |
| Additional information: | Copyright © 2022 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution License 4.0 (CC BY). |
| UCL classification: | UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10152253 |
Archive Staff Only
 |
View Item |
