UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Interactive reservoir computing for chunking information streams

Asabuki, T; Hiratani, N; Fukai, T; (2018) Interactive reservoir computing for chunking information streams. PLoS Computational Biology , 14 (10) , Article e1006400. 10.1371/journal.pcbi.1006400. Green open access

[thumbnail of Asabuki_ournal.pcbi.1006400.pdf]
Preview
Text
Asabuki_ournal.pcbi.1006400.pdf - Published Version

Download (4MB) | Preview

Abstract

Chunking is the process by which frequently repeated segments of temporal inputs are concatenated into single units that are easy to process. Such a process is fundamental to time-series analysis in biological and artificial information processing systems. The brain efficiently acquires chunks from various information streams in an unsupervised manner; however, the underlying mechanisms of this process remain elusive. A widely-adopted statistical method for chunking consists of predicting frequently repeated contiguous elements in an input sequence based on unequal transition probabilities over sequence elements. However, recent experimental findings suggest that the brain is unlikely to adopt this method, as human subjects can chunk sequences with uniform transition probabilities. In this study, we propose a novel conceptual framework to overcome this limitation. In this process, neural networks learn to predict dynamical response patterns to sequence input rather than to directly learn transition patterns. Using a mutually supervising pair of reservoir computing modules, we demonstrate how this mechanism works in chunking sequences of letters or visual images with variable regularity and complexity. In addition, we demonstrate that background noise plays a crucial role in correctly learning chunks in this model. In particular, the model can successfully chunk sequences that conventional statistical approaches fail to chunk due to uniform transition probabilities. In addition, the neural responses of the model exhibit an interesting similarity to those of the basal ganglia observed after motor habit formation.

Type: Article
Title: Interactive reservoir computing for chunking information streams
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1371/journal.pcbi.1006400
Publisher version: https://doi.org/10.1371/journal.pcbi.1006400
Language: English
Additional information: © 2018 Asabuki et al. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neurosci Unit
URI: https://discovery.ucl.ac.uk/id/eprint/10059554
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item