Boboeva, Vezha;
Brasselet, Romain;
Treves, Alessandro;
(2018)
The Capacity for Correlated Semantic Memories in the Cortex.
Entropy
, 20
(11)
, Article 824. 10.3390/e20110824.
Preview |
Text
BoboevaEtAl2018.pdf - Published Version Download (3MB) | Preview |
Abstract
A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through “factors” that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a dataset of nouns. We find that such correlations reduce the storage capacity of a Potts network to a limited extent, so that the number of concepts that can be stored and retrieved in a large, human-scale cortical network may still be of order 107, as originally estimated without correlations. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.
Type: | Article |
---|---|
Title: | The Capacity for Correlated Semantic Memories in the Cortex |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.3390/e20110824 |
Publisher version: | https://doi.org/10.3390/e20110824 |
Language: | English |
Additional information: | c 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
Keywords: | Potts network; attractor neural networks; autoassociative memory; cortex; semantic memory |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > The Sainsbury Wellcome Centre |
URI: | https://discovery.ucl.ac.uk/id/eprint/10204624 |
Archive Staff Only
![]() |
View Item |