UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Movement Sonification Expectancy Model: Leveraging Musical Expectancy Theory to Create Movement-Altering Sonifications

Newbold, J; Gold, N; Berthouze, N; (2020) Movement Sonification Expectancy Model: Leveraging Musical Expectancy Theory to Create Movement-Altering Sonifications. Journal on Multimodal User Interfaces , 14 pp. 153-166. 10.1007/s12193-020-00322-2. Green open access

[img]
Preview
Text
Berthouze_Newbold2020_Article_MovementSonificationExpectancy.pdf - Published version

Download (1MB) | Preview

Abstract

When designing movement sonifications, their effect on people’s movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people’s expectations of their movement is not well explained. This is especially important when considering musical sonifications, to which people bring their own associations and musical expectation, and which can, in turn, alter their perception of the sonification. This paper presents a Movement Expectation Sonification Model, based on theories of motor-feedback and expectation, to explore how musical sonification can impact the way people perceive their movement. Secondly, we present a study that validates the predictions of this model by exploring how harmonic stability within sonification interacts with contextual cues in the environment to impact movement behaviour and perceptions. We show how musical expectancy can be built to either reward or encourage movement, and how such an effect is mediated through the presence of additional cues. This model offers a way for sonification designers to create movement sonifications that not only inform movement but can be used to encourage progress and reward successes.

Type: Article
Title: Movement Sonification Expectancy Model: Leveraging Musical Expectancy Theory to Create Movement-Altering Sonifications
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/s12193-020-00322-2
Publisher version: https://doi.org/10.1007/s12193-020-00322-2
Language: English
Additional information: This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Keywords: Sonification design, Musical expectancy, Movement perception
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10093832
Downloads since deposit
4Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item