UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Transferring Image-based Edits for Multi-Channel Compositing

Hennessey, JW; Li, W; Russell, B; Shechtman, E; Mitra, NJ; (2017) Transferring Image-based Edits for Multi-Channel Compositing. In: ACM Transactions on Graphics (TOG). Association for Computing Machinery (ACM): New York, NY, USA. Green open access

[thumbnail of 0_edit_transfer.pdf]
Preview
Text
0_edit_transfer.pdf - Accepted Version

Download (89MB) | Preview

Abstract

A common way to generate high-quality product images is to start with a physically-based render of a 3D scene, apply image-based edits on individual render channels, and then composite the edited channels together (in some cases, on top of a background photograph). This workflow requires users to manually select the right render channels, prescribe channel-specific masks, and set appropriate edit parameters. Unfortunately, such edits cannot be easily reused for global variations of the original scene, such as a rigid-body transformation of the 3D objects or a modified viewpoint, which discourages iterative refinement of both global scene changes and image-based edits. We propose a method to automatically transfer such user edits across variations of object geometry, illumination, and viewpoint. This transfer problem is challenging since many edits may be visually plausible but non-physical, with a successful transfer dependent on an unknown set of scene attributes that may include both photometric and non-photometric features. To address this challenge, we present a transfer algorithm that extends the image analogies formulation to include an augmented set of photometric and non-photometric guidance channels and, more importantly, adaptively estimate weights for the various candidate channels in a way that matches the characteristics of each individual edit. We demonstrate our algorithm on a variety of complex edit-transfer scenarios for creating high-quality product images.

Type: Proceedings paper
Title: Transferring Image-based Edits for Multi-Channel Compositing
Event: 10th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Location: Bangkok, THAILAND
Dates: 27 November 2017 - 30 November 2017
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3130800.3130842
Publisher version: https://doi.org/10.1145/3130800.3130842
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10069697
Downloads since deposit
50Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item