Wang, TY;
Su, H;
Huang, Q;
Huang, J;
Guibas, L;
Mitra, NJ;
(2016)
Unsupervised Texture Transfer from Images to Model Collections.
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2016
, 35
(6)
, Article 177. 10.1145/2980179.2982404.
Preview |
Text
Mitra_texture_transfer (1).pdf - Accepted Version Download (88MB) | Preview |
Abstract
Large 3D model repositories of common objects are now ubiquitous and are increasingly being used in computer graphics and computer vision for both analysis and synthesis tasks. However, images of objects in the real world have a richness of appearance that these repositories do not capture, largely because most existing 3D models are untextured. In this work we develop an automated pipeline capable of transporting texture information from images of real objects to 3D models of similar objects. This is a challenging problem, as an object's texture as seen in a photograph is distorted by many factors, including pose, geometry, and illumination. These geometric and photometric distortions must be undone in order to transfer the pure underlying texture to a new object --- the 3D model. Instead of using problematic dense correspondences, we factorize the problem into the reconstruction of a set of base textures (materials) and an illumination model for the object in the image. By exploiting the geometry of the similar 3D model, we reconstruct certain reliable texture regions and correct for the illumination, from which a full texture map can be recovered and applied to the model. Our method allows for large-scale unsupervised production of richly textured 3D models directly from image data, providing high quality virtual objects for 3D scene design or photo editing applications, as well as a wealth of data for training machine learning algorithms for various inference tasks in graphics and vision.
| Type: | Article |
|---|---|
| Title: | Unsupervised Texture Transfer from Images to Model Collections |
| Event: | SIGGRAPH ASIA 2016 |
| Location: | Macao, China |
| Dates: | 05 December 2016 - 08 December 2016 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/2980179.2982404 |
| Publisher version: | http://doi.org/10.1145/2980179.2982404 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Science & Technology, Technology, Computer Science, Software Engineering, Computer Science, data-driven graphics, shape analysis, appearance transfer, texture, illumination, SEGMENTATION |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1533270 |
Archive Staff Only
 |
View Item |
