UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Sonification of surface tapping changes behavior, surface perception, and emotion

Tajadura-Jimenez, A; Bianchi-Berthouze, N; Furfaro, E; Bevilacqua, F; (2015) Sonification of surface tapping changes behavior, surface perception, and emotion. IEEE Multimedia , 22 (1) 48 - 57. 10.1109/MMUL.2015.14. Green open access

[thumbnail of Furfaro_etal_IEEE_Multimedia_revision_FINAL.pdf]
Preview
Text
Furfaro_etal_IEEE_Multimedia_revision_FINAL.pdf

Download (708kB) | Preview

Abstract

The audio feedback resulting from object interaction provides information about the material of the surface and about one's own motor behavior. With the current developments in interactive sonification, it's now possible to digitally change this audio feedback, making the use of interactive sonification a compelling approach to shape tactile surface interactions. Here, the authors present a prototype for a sonic interactive surface, capable of delivering surface tapping sounds in real time when triggered by users' taps on a real surface or on an imagined 'virtual' surface. In this system, the delivered audio feedback can be varied so that the tapping sounds correspond to different applied strengths during tapping. The authors also propose a multidimensional measurement approach to evaluate user experiences of multimodal interactive systems. They evaluated their system by looking at the effect of the altered tapping sounds on emotional action-related responses, the users' interactions with the surface, and perceived surface hardness. Results show the influence of the sonification of tapping at all levels: emotional, behavioral, and perceptual. These results have implications on the design of interactive sonification displays and tangible auditory interfaces aiming to change perceived and subsequent motor behavior as well as perceived material properties.

Type: Article
Title: Sonification of surface tapping changes behavior, surface perception, and emotion
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/MMUL.2015.14
Publisher version: http://dx.doi.org/10.1109/MMUL.2015.14
Language: English
Additional information: © 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Keywords: emotional design, interaction styles, interactive sonification, multimedia, multimodal interactive system, multimodal interfaces, surface interaction, user experience, virtual surface
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
URI: https://discovery.ucl.ac.uk/id/eprint/1464806
Downloads since deposit
256Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item