UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Using sound in multi-touch interfaces to change materiality and touch behavior

Tajadura-Jiménez, A; Liu, B; Bianchi-Berthouze, N; Bevilacqua, F; (2014) Using sound in multi-touch interfaces to change materiality and touch behavior. Proceedings of the NordiCHI 2014: The 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational 199 - 202. 10.1145/2639189.2639217. Green open access

[img] PDF
p199-tajadura-jimenez.pdf

Download (351kB)

Abstract

Current development in multimodal interfaces allows us to interact with digitally represented objects. Sadly, these representations are often poor due to technical limitations in representing some of the sensorial properties. Here we explore the possibility of overcoming these limitations by exploiting multisensory integration processes and propose a sound-based interaction technique to alter the perceived materiality of a surface being touched and to shape users' touch behavior. The latter can be seen both as a cue of, and as a means to reinforce, the altered perception. We designed a prototype that dynamically alters the texture-related sound feedback based on touch behavior, as in natural surface touch interactions. A user study showed that the frequency of the sound feedback alters texture perception (coldness and material type) and touch behavior (velocity and pressure). We conclude by discussing lessons learnt from this work in terms of HCI applications and questions opened by this research. Copyright is held by the owner/author(s).

Type: Article
Title: Using sound in multi-touch interfaces to change materiality and touch behavior
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/2639189.2639217
Publisher version: http://dx.doi.org/10.1145/2639189.2639217
Additional information: Copyright is held by the owner/author(s).
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
URI: https://discovery.ucl.ac.uk/id/eprint/1458218
Downloads since deposit
102Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item