UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

SmartAnnotator An Interactive Tool for Annotating Indoor RGBD Images

Wong, Y-S; Chu, H-K; Mitra, NJ; (2015) SmartAnnotator An Interactive Tool for Annotating Indoor RGBD Images. Computer Graphics Forum , 34 (2) pp. 447-457. 10.1111/cgf.12574. Green open access

[thumbnail of Mitra_1403.5718v1.pdf]
Preview
Text
Mitra_1403.5718v1.pdf - Accepted version

Download (8MB) | Preview

Abstract

RGBD images with high quality annotations, both in the form of geometric (i.e., segmentation) and structural (i.e., how do the segments mutually relate in 3D) information, provide valuable priors for a diverse range of applications in scene understanding and image manipulation. While it is now simple to acquire RGBD images, annotating them, automatically or manually, remains challenging. We present SmartAnnotator, an interactive system to facilitate annotating raw RGBD images. The system performs the tedious tasks of grouping pixels, creating potential abstracted cuboids, inferring object interactions in 3D, and generates an ordered list of hypotheses. The user simply has to flip through the suggestions for segment labels, finalize a selection, and the system updates the remaining hypotheses. As annotations are finalized, the process becomes simpler with fewer ambiguities to resolve. Moreover, as more scenes are annotated, the system makes better suggestions based on the structural and geometric priors learned from previous annotation sessions. We test the system on a large number of indoor scenes across different users and experimental settings, validate the results on existing benchmark datasets, and report significant improvements over low-level annotation alternatives. (Code and benchmark datasets are publicly available on the project page.)

Type: Article
Title: SmartAnnotator An Interactive Tool for Annotating Indoor RGBD Images
Location: Zurich, SWITZERLAND
Open access status: An open access version is available from UCL Discovery
DOI: 10.1111/cgf.12574
Publisher version: http://dx.doi.org/10.1111/cgf.12574
Language: English
Additional information: This is the peer reviewed version of the following article: Wong, Y-S; Chu, H-K; Mitra, NJ; (2015) SmartAnnotator An Interactive Tool for Annotating Indoor RGBD Images. Computer Graphics Forum, 34 (2) pp. 447-457, which has been published in final form at: http://dx.doi.org/10.1111/cgf.12574. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving (http://olabout.wiley.com/WileyCDA/Section/id-828039.html#terms).
Keywords: Science & Technology, Technology, Computer Science, Software Engineering, Computer Science
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/1529303
Downloads since deposit
60Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item