Abdal, Rameen; Zhu, Peihao; Mitra, Niloy J; Wonka, Peter; (2022) Labels4Free: Unsupervised Segmentation using StyleGAN. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV). (pp. pp. 13950-13959). IEEE: Montreal, QC, Canada.

Preview

PDF lab4free.pdf - Accepted Version Download (6MB) | Preview

Abstract

We propose an unsupervised segmentation framework for StyleGAN generated objects. We build on two main observations. First, the features generated by StyleGAN hold valuable information that can be utilized towards training segmentation networks. Second, the foreground and background can often be treated to be largely independent and be swapped across images to produce plausible composited images. For our solution, we propose to augment the StyleGAN2 generator architecture with a segmentation branch and to split the generator into a foreground and background network. This enables us to generate soft segmentation masks for the foreground object in an unsupervised fashion. On multiple object classes, we report comparable results against state-of-the-art supervised segmentation networks, while against the best unsupervised segmentation approach we demonstrate a clear improvement, both in qualitative and quantitative metrics. Project Page: https:/rameenabdal.github.io/Labels4Free.

Download activity - last month

Export as JSONCSVXML

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item