Guerrero, P;
Mitra, NJ;
Wonka, P;
(2016)
RAID: A relation-augmented image descriptor.
ACM Transactions on Graphics
, 35
(4)
, Article 46. 10.1145/2897824.2925939.
Preview |
Text
Guerrero RAID A relation-augmented image descriptor VoR.pdf Download (15MB) | Preview |
Abstract
As humans, we regularly interpret scenes based on how objects are related, rather than based on the objects themselves. For example, we see a person riding an object X or a plank bridging two objects. Current methods provide limited support to search for content based on such relations. We present RAID, a relation-augmented image descriptor that supports queries based on inter-region relations. The key idea of our descriptor is to encode region-to-region relations as the spatial distribution of point-to-region relationships between two image regions. RAID allows sketch-based retrieval and requires minimal training data, thus making it suited even for querying uncommon relations. We evaluate the proposed descriptor by querying into large image databases and successfully extract nontrivial images demonstrating complex inter-region relations, which are easily missed or erroneously classified by existing methods. We assess the robustness of RAID on multiple datasets even when the region segmentation is computed automatically or very noisy.
Type: | Article |
---|---|
Title: | RAID: A relation-augmented image descriptor |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1145/2897824.2925939 |
Publisher version: | https://doi.org/10.1145/2897824.2925939 |
Language: | English |
Additional information: | Copyright © 2016 The owner/author(s). This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) (https://creativecommons.org/licenses/by/4.0/) |
Keywords: | spatial relationships, image descriptors, relation-based query, sketch-based query, image retrieval |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment > Bartlett School Env, Energy and Resources |
URI: | https://discovery.ucl.ac.uk/id/eprint/1502253 |
Archive Staff Only
View Item |