Giunchi, D;
James, S;
Steed, A;
(2018)
3D Sketching for Interactive Model Retrieval in Virtual Reality.
In:
Expressive '18: Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering.
(pp. Art. 1).
Association for Computing Machinery (ACM)
Preview |
Text
3d-sketching-interactive.pdf - Accepted Version Download (10MB) | Preview |
Abstract
We describe a novel method for searching 3D model collections using free-form sketches within a virtual environment as queries. As opposed to traditional sketch retrieval, our queries are drawn directly onto an example model. Using immersive virtual reality the user can express their query through a sketch that demonstrates the desired structure, color and texture. Unlike previous sketch-based retrieval methods, users remain immersed within the environment without relying on textual queries or 2D projections which can disconnect the user from the environment. We perform a test using queries over several descriptors, evaluating the precision in order to select the most accurate one. We show how a convolutional neural network (CNN) can create multi-view representations of colored 3D sketches. Using such a descriptor representation, our system is able to rapidly retrieve models and in this way, we provide the user with an interactive method of navigating large object datasets. Through a user study we demonstrate that by using our VR 3D model retrieval system, users can perform search more quickly and intuitively than with a naive linear browsing method. Using our system users can rapidly populate a virtual environment with specific models from a very large database, and thus the technique has the potential to be broadly applicable in immersive editing systems.
| Type: | Proceedings paper |
|---|---|
| Title: | 3D Sketching for Interactive Model Retrieval in Virtual Reality |
| Event: | Expressive 2018, Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, 17-19 August 2018, Victoria, British Columbia, Canada |
| Location: | Victoria, British Columbia,Canada |
| Dates: | 17 August 2018 - 19 August 2018 |
| ISBN-13: | 9781450358927 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3229147.3229166 |
| Publisher version: | https://dx.doi.org/10.1145/3229147.3229166 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Sketch, Virtual Reality, CNN, HCI |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10060176 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
