UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Unsupervised Texture Transfer from Images to Model Collections

Wang, TY; Su, H; Huang, Q; Huang, J; Guibas, L; Mitra, NJ; (2016) Unsupervised Texture Transfer from Images to Model Collections. ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2016 , 35 (6) , Article 177. 10.1145/2980179.2982404. Green open access

[thumbnail of Mitra_texture_transfer (1).pdf]
Preview
Text
Mitra_texture_transfer (1).pdf - Accepted Version

Download (88MB) | Preview

Abstract

Large 3D model repositories of common objects are now ubiquitous and are increasingly being used in computer graphics and computer vision for both analysis and synthesis tasks. However, images of objects in the real world have a richness of appearance that these repositories do not capture, largely because most existing 3D models are untextured. In this work we develop an automated pipeline capable of transporting texture information from images of real objects to 3D models of similar objects. This is a challenging problem, as an object's texture as seen in a photograph is distorted by many factors, including pose, geometry, and illumination. These geometric and photometric distortions must be undone in order to transfer the pure underlying texture to a new object --- the 3D model. Instead of using problematic dense correspondences, we factorize the problem into the reconstruction of a set of base textures (materials) and an illumination model for the object in the image. By exploiting the geometry of the similar 3D model, we reconstruct certain reliable texture regions and correct for the illumination, from which a full texture map can be recovered and applied to the model. Our method allows for large-scale unsupervised production of richly textured 3D models directly from image data, providing high quality virtual objects for 3D scene design or photo editing applications, as well as a wealth of data for training machine learning algorithms for various inference tasks in graphics and vision.

Type: Article
Title: Unsupervised Texture Transfer from Images to Model Collections
Event: SIGGRAPH ASIA 2016
Location: Macao, China
Dates: 05 December 2016 - 08 December 2016
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/2980179.2982404
Publisher version: http://doi.org/10.1145/2980179.2982404
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Science & Technology, Technology, Computer Science, Software Engineering, Computer Science, data-driven graphics, shape analysis, appearance transfer, texture, illumination, SEGMENTATION
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/1533270
Downloads since deposit
65Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item