UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Multi-time resolution analysis of speech: Evidence from psychophysics

Chait, M; Greenberg, S; Arai, T; Simon, JZ; Poeppel, D; (2015) Multi-time resolution analysis of speech: Evidence from psychophysics. Frontiers in Neuroscience , 9 10.3389/fnins.2015.00214. Green open access

[thumbnail of fnins-09-00214.pdf]

Download (1MB) | Preview


How speech signals are analyzed and represented remains a foundational challenge both for cognitive science and neuroscience. A growing body of research, employing various behavioral and neurobiological experimental techniques, now points to the perceptual relevance of both phoneme-sized (10-40 Hz modulation frequency) and syllable-sized (2-10 Hz modulation frequency) units in speech processing. However, it is not clear how information associated with such different time scales interacts in a manner relevant for speech perception. We report behavioral experiments on speech intelligibility employing a stimulus that allows us to investigate how distinct temporal modulations in speech are treated separately and whether they are combined. We created sentences in which the slow (~ 4Hz; S<inf>low</inf>) and rapid (~ 33Hz; S<inf>high</inf>) modulations - corresponding to ~250 ms and ~30 ms, the average duration of syllables and certain phonetic properties, respectively - were selectively extracted. Although S<inf>low</inf> and S<inf>high</inf> have low intelligibility when presented separately, dichotic presentation of S<inf>high</inf> with S<inf>low</inf> results in supra-additive performance, suggesting a synergistic relationship between low- and high-modulation frequencies. A second experiment desynchronized presentation of the S<inf>low</inf> + S<inf>high</inf> signals. Desynchronizing signals relative to one another had no impact on intelligibility when delays were less than ~45 ms. Longer delays resulted in a steep intelligibility decline, providing further evidence of integration or binding of information within restricted temporal windows. Our data suggest that human speech perception uses multi-time resolution processing. Signals are concurrently analyzed on at least two separate time scales, the intermediate representations of these analyses are integrated, and the resulting bound percept has significant consequences for speech intelligibility - a view compatible with recent insights from neuroscience implicating multi-timescale auditory processing.

Type: Article
Title: Multi-time resolution analysis of speech: Evidence from psychophysics
Open access status: An open access version is available from UCL Discovery
DOI: 10.3389/fnins.2015.00214
Publisher version: http://dx.doi.org/10.3389/fnins.2015.00214
Language: English
Additional information: © 2015 Chait, Greenberg, Arai, Simon and Poeppel. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Keywords: Auditory processing, Modulation spectrum, Phoneme, Speech perception, Speech segmentation, Syllable, Temporal processing
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > The Ear Institute
URI: https://discovery.ucl.ac.uk/id/eprint/1472143
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item