Zhao, J;
Parry, CJ;
dos Anjos, R;
Anslow, C;
Rhee, T;
(2020)
Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding.
In:
Proceedings of the 2020 35th International Conference on Image and Vision Computing New Zealand (IVCNZ).
IEEE: Wellington, New Zealand.
(In press).
Preview |
Text
ICIVCNZ.pdf - Published Version Download (228kB) | Preview |
Abstract
Voice interaction with natural language understanding (NLU) has been extensively explored in desktop computers, handheld devices, and human-robot interaction. However, there is limited research into voice interaction with NLU in augmented reality (AR). There are benefits of using voice interaction in AR, such as high naturalness and being hands-free. In this project, we introduce VOARLA, an NLU-powered AR voice interface, which navigate courier driver delivery a package. A user study was completed to evaluate VOARLA against an AR voice interface without NLU to investigate the effectiveness of NLU in the navigation interface in AR. We evaluated from three aspects: accuracy, productivity, and commands learning curve. Results found that using NLU in AR increases the accuracy of the interface by 15%. However, higher accuracy did not correlate to an increase in productivity. Results suggest that NLU helped users remember the commands on the first run when they were unfamiliar with the system. This suggests that using NLU in an AR hands-free application can make the learning curve easier for new users.
Type: | Proceedings paper |
---|---|
Title: | Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding |
Event: | 35th International Conference on Image and Vision Computing New Zealand (IVCNZ) |
Dates: | 25 November 2020 - 27 November 2020 |
ISBN: | 978-1-7281-8579-8 |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1109/ivcnz51579.2020.9290643 |
Publisher version: | https://doi.org/10.1109/IVCNZ51579.2020.9290643 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10122482 |




Archive Staff Only
![]() |
View Item |