UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Using visual and auditory cues to locate out-of-view objects in head-mounted augmented reality

Binetti, N; Wu, L; Chen, S; Kruijff, E; Julier, S; Brumby, DP; (2021) Using visual and auditory cues to locate out-of-view objects in head-mounted augmented reality. Displays , 69 , Article 102032. 10.1016/j.displa.2021.102032. Green open access

[thumbnail of Displays_UCL_OA.pdf]
Preview
Text
Displays_UCL_OA.pdf - Accepted Version

Download (726kB) | Preview

Abstract

When looking for an object in a complex visual scene, Augmented Reality (AR) can assist search with visual cues persistently pointing in the target's direction. The effectiveness of these visual cues can be reduced if they are placed at a different visual depth plane to the target they are indicating. To overcome this visual-depth problem, we test the effectiveness of adding simultaneous spatialized auditory cues that are fixed at the target's location. In an experiment we manipulated which cue(s) were available (visual-only vs. visual + auditory), and which disparity plane relative to the target the visual cue was displayed on. Results show that participants were slower at finding targets when the visual cue was placed on a different disparity plane to the target. However, this slowdown in search performance could be substantially reduced with auditory cueing. These results demonstrate the importance of AR cross-modal cueing under conditions of visual uncertainty and show that designers should consider augmenting visual cues with auditory ones.

Type: Article
Title: Using visual and auditory cues to locate out-of-view objects in head-mounted augmented reality
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.displa.2021.102032
Publisher version: https://doi.org/10.1016/j.displa.2021.102032
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10130700
Downloads since deposit
174Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item