UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding

Zhao, J; Parry, CJ; dos Anjos, R; Anslow, C; Rhee, T; (2020) Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding. In: Proceedings of the 2020 35th International Conference on Image and Vision Computing New Zealand (IVCNZ). IEEE: Wellington, New Zealand. (In press). Green open access

[thumbnail of ICIVCNZ.pdf]
Preview
Text
ICIVCNZ.pdf - Published Version

Download (228kB) | Preview

Abstract

Voice interaction with natural language understanding (NLU) has been extensively explored in desktop computers, handheld devices, and human-robot interaction. However, there is limited research into voice interaction with NLU in augmented reality (AR). There are benefits of using voice interaction in AR, such as high naturalness and being hands-free. In this project, we introduce VOARLA, an NLU-powered AR voice interface, which navigate courier driver delivery a package. A user study was completed to evaluate VOARLA against an AR voice interface without NLU to investigate the effectiveness of NLU in the navigation interface in AR. We evaluated from three aspects: accuracy, productivity, and commands learning curve. Results found that using NLU in AR increases the accuracy of the interface by 15%. However, higher accuracy did not correlate to an increase in productivity. Results suggest that NLU helped users remember the commands on the first run when they were unfamiliar with the system. This suggests that using NLU in an AR hands-free application can make the learning curve easier for new users.

Type: Proceedings paper
Title: Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding
Event: 35th International Conference on Image and Vision Computing New Zealand (IVCNZ)
Dates: 25 November 2020 - 27 November 2020
ISBN: 978-1-7281-8579-8
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/ivcnz51579.2020.9290643
Publisher version: https://doi.org/10.1109/IVCNZ51579.2020.9290643
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10122482
Downloads since deposit
Loading...
254Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item