eprintid: 10058867
rev_number: 27
eprint_status: archive
userid: 608
dir: disk0/10/05/88/67
datestamp: 2019-10-29 07:42:13
lastmod: 2021-09-17 22:55:11
status_changed: 2019-10-29 07:42:13
type: poster
metadata_visibility: show
creators_name: Giunchi, D
creators_name: James, S
creators_name: Steed, A
title: Model Retrieval by 3D Sketching in Immersive Virtual Reality
divisions: UCL
divisions: B04
divisions: C05
divisions: F48
note: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
abstract: We describe a novel method for searching 3D model collections using free-form sketches within a virtual environment as queries. As opposed to traditional Sketch Retrieval, our queries are drawn directly onto an example model. Using immersive virtual reality the user can express their query through a sketch that demonstrates the desired structure, color and texture. Unlike previous sketch-based retrieval methods, users remain immersed within the environment without relying on textual queries or 2D projections which can disconnect the user from the environment. We show how a convolutional neural network (CNN) can create multi-view representations of colored 3D sketches. Using such a descriptor representation, our system is able to rapidly retrieve models and in this way, we provide the user with an interactive method of navigating large object datasets. Through a preliminary user study we demonstrate that by using our VR 3D model retrieval system, users can perform quick and intuitive search. Using our system users can rapidly populate a virtual environment with specific models from a very large database, and thus the technique has the potential to be broadly applicable in immersive editing systems.
date: 2018-08-24
date_type: published
official_url: https://doi.org/10.1109/VR.2018.8446609
oa_status: green
full_text_type: other
language: eng
primo: open
primo_central: open_green
verified: verified_manual
elements_id: 1593476
lyricists_name: Giunchi, Daniele
lyricists_name: James, Stuart
lyricists_name: Steed, Anthony
lyricists_id: DGIUN06
lyricists_id: SJAME46
lyricists_id: ASTEE91
actors_name: Giunchi, Daniele
actors_id: DGIUN06
actors_role: owner
full_text_status: public
event_title: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
event_location: Reutlingen, Germany
event_dates: 18 March 2018 - 22 March 2018
citation:        Giunchi, D;    James, S;    Steed, A;      (2018)    Model Retrieval by 3D Sketching in Immersive Virtual Reality.                   Presented at: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Reutlingen, Germany.       Green open access   
 
document_url: https://discovery.ucl.ac.uk/id/eprint/10058867/1/DGiunchi_IEEEVR2018_poster.pdf