UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

TipTrap: A Co-located Direct Manipulation Technique for Acoustically Levitated Content

Jankauskis, E; Elizondo, S; Montano Murillo, R; Marzo, A; Martinez Plasencia, D; (2022) TipTrap: A Co-located Direct Manipulation Technique for Acoustically Levitated Content. In: Agrawala, Maneesh and Wobbrock, Jacob O. and Adar, Eytan and Setlur, Vidya, (eds.) UIST 2022 - Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. ACM: Bend, OR, USA. Green open access

[thumbnail of Martinez Plasencia_TipTrap___CHI_2022.pdf]
Preview
PDF
Martinez Plasencia_TipTrap___CHI_2022.pdf - Accepted Version

Download (36MB) | Preview

Abstract

Acoustic levitation has emerged as a promising approach for mid-air displays, by using multiple levitated particles as 3D voxels, cloth and thread props, or high-speed tracer particles, under the promise of creating 3D displays that users can see, hear and feel with their bare eyes, ears and hands. However, interaction with this mid-air content always occurred at a distance, since external objects in the display volume (e.g. user's hands) can disturb the acoustic fields and make the particles fall. This paper proposes TipTrap, a co-located direct manipulation technique for acoustically levitated particles. TipTrap leverages the reflection of ultrasound on the users' skin and employs a closed-loop system to create functional acoustic traps 2.1 mm below the fingertips, and addresses its 3 basic stages: selection, manipulation and deselection. We use Finite-Differences Time Domain (FDTD) simulations to explain the principles enabling TipTrap, and explore how finger reflections and user strategies influence the quality of the traps (e.g. approaching direction, orientation and tracking errors), and use these results to design our technique. We then implement the technique, characterizing its performance with a robotic hand setup and finish with an exploration of the ability of TipTrap to manipulate different types of levitated content.

Type: Proceedings paper
Title: TipTrap: A Co-located Direct Manipulation Technique for Acoustically Levitated Content
Event: UIST '22: The 35th Annual ACM Symposium on User Interface Software and Technology
ISBN-13: 9781450393201
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3526113.3545675
Publisher version: http://doi.org/10.1145/3526113.3545675
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: co-located direct manipulation, acoustic levitation, interaction techniques, spatial interaction
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10169282
Downloads since deposit
15Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item