UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Unsupervised multi-domain multimodal image-to-image translation with explicit domain-constrained disentanglement

Xia, W; Yang, Y; Xue, J-H; (2020) Unsupervised multi-domain multimodal image-to-image translation with explicit domain-constrained disentanglement. Neural Networks , 131 pp. 50-63. 10.1016/j.neunet.2020.07.023. Green open access

[thumbnail of WeihaoXia-NEUNET-2020-UCL.pdf]
Preview
Text
WeihaoXia-NEUNET-2020-UCL.pdf - Accepted Version

Download (9MB) | Preview

Abstract

Image-to-image translation has drawn great attention during the past few years. It aims to translate an image in one domain to a target image in another domain. However, three big challenges remain in image-to-image translation: (1) the lack of large amounts of aligned training pairs for various tasks; (2) the ambiguity of multiple possible outputs from a single input image; and (3) the lack of simultaneous training for multi-domain translation with a single network. Therefore in this paper, we propose a unified framework for learning to generate diverse outputs using unpaired training data and allow for simultaneous multi-domain translation via a single model. Moreover, we also observed from experiments that the implicit disentanglement of content and style could lead to undesirable results. Thus we investigate how to extract domain-level signal as explicit supervision so as to achieve better image-to-image translation. Extensive experiments show that the proposed method outperforms or is comparable with the state-of-the-art methods for various applications.

Type: Article
Title: Unsupervised multi-domain multimodal image-to-image translation with explicit domain-constrained disentanglement
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.neunet.2020.07.023
Publisher version: http://dx.doi.org/10.1016/j.neunet.2020.07.023
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Deep neural networks, Generative adversarial network, Image-to-image translation
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/10106592
Downloads since deposit
57Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item