UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Controllable Continuous Gaze Redirection

Xia, W; Yang, Y; Xue, J; Feng, W; (2020) Controllable Continuous Gaze Redirection. In: MM '20: Proceedings of the 28th ACM International Conference on Multimedia. (pp. pp. 1782-1790). ACM Green open access

[thumbnail of WeihaoXia-ACMMM2020-accepted.pdf]
Preview
Text
WeihaoXia-ACMMM2020-accepted.pdf - Accepted Version

Download (1MB) | Preview

Abstract

In this work, we present interpGaze, a novel framework for controllable gaze redirection that achieves both precise redirection and continuous interpolation. Given two gaze images with different attributes, our goal is to redirect the eye gaze of one person into any gaze direction depicted in the reference image or to generate continuous intermediate results. To accomplish this, we design a model including three cooperative components: an encoder, a controller and a decoder. The encoder maps images into a well-disentangled and hierarchically-organized latent space. The controller adjusts the magnitudes of latent vectors to the desired strength of corresponding attributes by altering a control vector. The decoder converts the desired representations from the attribute space to the image space. To facilitate covering the full space of gaze directions, we introduce a high-quality gaze image dataset with a large range of directions, which also benefits researchers in related areas. Extensive experimental validation and comparisons to several baseline methods show that the proposed interpGaze outperforms state-of-the-art methods in terms of image quality and redirection precision.

Type: Proceedings paper
Title: Controllable Continuous Gaze Redirection
Event: ACM Multimedia 2020
Dates: 12 October 2020 - 16 October 2020
Open access status: An open access version is available from UCL Discovery
DOI: 10.1145/3394171.3413868
Publisher version: https://doi.org/10.1145/3394171.3413868
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/10110889
Downloads since deposit
135Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item