Chen, Yue;
Yingming, Gao;
Yi, Xu;
(2022)
Computational Modelling of Tone Perception Based on Direct Processing of f0 Contours.
Brain Sciences
, 12
(3)
, Article 337. 10.3390/brainsci12030337.
Preview |
Text
brainsci-12-00337.pdf - Published Version Download (1MB) | Preview |
Abstract
It has been widely assumed that in speech perception it is imperative to first detect a set of distinctive properties or features and then use them to recognize phonetic units like consonants, vowels, and tones. Those features can be auditory cues or articulatory gestures, or a combination of both. There have been no clear demonstrations of how exactly such a two-phase process would work in the perception of continuous speech, however. Here we used computational modelling to explore whether it is possible to recognize phonetic categories from syllable-sized continuous acoustic signals of connected speech without intermediate featural representations. We used Support Vector Machine (SVM) and Self-organizing Map (SOM) to simulate tone perception in Mandarin, by either directly processing f0 trajectories, or extracting various tonal features. The results show that direct tone recognition not only yields better performance than any of the feature extraction schemes, but also requires less computational power. These results suggest that prior extraction of features is unlikely the operational mechanism of speech perception.
Type: | Article |
---|---|
Title: | Computational Modelling of Tone Perception Based on Direct Processing of f0 Contours |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.3390/brainsci12030337 |
Publisher version: | https://doi.org/10.3390/brainsci12030337 |
Language: | English |
Additional information: | This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited |
Keywords: | Speech perception; Mandarin tones; tone recognition; tone features |
UCL classification: | UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL |
URI: | https://discovery.ucl.ac.uk/id/eprint/10144532 |
Archive Staff Only
View Item |