Mouawad, P;
Dubnov, S;
(2017)
On modeling affect in audio with non-linear symbolic dynamics.
Advances in Science, Technology and Engineering Systems
, 2
(3)
pp. 1727-1740.
10.25046/aj0203212.
Preview |
Text
ASTESJ_2017.pdf - Published Version Download (1MB) | Preview |
Abstract
The discovery of semantic information from complex signals is a task concerned with connecting humans' perceptions and/or intentions with the signals content. In the case of audio signals, complex perceptions are appraised in a listener's mind, that trigger affective responses that may be relevant for well-being and survival. In this paper we are interested in the broader question of relations between uncertainty in data as measured using various information criteria and emotions, and we propose a novel method that combines nonlinear dynamics analysis with a method of adaptive time series symbolization that finds the meaningful audio structure in terms of symbolized recurrence properties. In a first phase we obtain symbolic recurrence quantification measures from symbolic recurrence plots, without the need to reconstruct the phase space with embedding. Then we estimate symbolic dynamical invariants from symbolized time series, after embedding. The invariants are: correlation dimension, correlation entropy and Lyapunov exponent. Through their application for the logistic map, we show that our measures are in agreement with known methods from literature. We further show that one symbolic recurrence measure, namely the symbolic Shannon entropy, correlates positively with the positive Lyapunov exponents. Finally we evaluate the performance of our measures in emotion recognition through the implementation of classification tasks for different types of audio signals, and show that in some cases, they perform better than state-of-the-art methods that rely on low-level acoustic features.
| Type: | Article |
|---|---|
| Title: | On modeling affect in audio with non-linear symbolic dynamics |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.25046/aj0203212 |
| Publisher version: | http://dx.doi.org/10.25046/aj0203212 |
| Language: | English |
| Additional information: | This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > The Ear Institute |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10195338 |
Archive Staff Only
 |
View Item |
