UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Model Retrieval by 3D Sketching in Immersive Virtual Reality

Giunchi, D; James, S; Steed, A; (2018) Model Retrieval by 3D Sketching in Immersive Virtual Reality. Presented at: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Reutlingen, Germany. Green open access

[img]
Preview
Text
DGiunchi_IEEEVR2018_poster.pdf - Accepted version

Download (5MB) | Preview

Abstract

We describe a novel method for searching 3D model collections using free-form sketches within a virtual environment as queries. As opposed to traditional Sketch Retrieval, our queries are drawn directly onto an example model. Using immersive virtual reality the user can express their query through a sketch that demonstrates the desired structure, color and texture. Unlike previous sketch-based retrieval methods, users remain immersed within the environment without relying on textual queries or 2D projections which can disconnect the user from the environment. We show how a convolutional neural network (CNN) can create multi-view representations of colored 3D sketches. Using such a descriptor representation, our system is able to rapidly retrieve models and in this way, we provide the user with an interactive method of navigating large object datasets. Through a preliminary user study we demonstrate that by using our VR 3D model retrieval system, users can perform quick and intuitive search. Using our system users can rapidly populate a virtual environment with specific models from a very large database, and thus the technique has the potential to be broadly applicable in immersive editing systems.

Type: Poster
Title: Model Retrieval by 3D Sketching in Immersive Virtual Reality
Event: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
Location: Reutlingen, Germany
Dates: 18 March 2018 - 22 March 2018
Open access status: An open access version is available from UCL Discovery
Publisher version: https://doi.org/10.1109/VR.2018.8446609
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10058867
Downloads since deposit
29Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item