Weder, S; Garcia-Hernando, G; Monszpart, Á; Pollefeys, M; Brostow, G; Firman, M; Vicente, S; (2023) Removing Objects From Neural Radiance Fields. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). (pp. pp. 16528-16538). IEEE: Vancouver, BC, Canada.

Preview

Text Weder_Removing_Objects_From_Neural_Radiance_Fields_CVPR_2023_paper.pdf - Accepted Version Download (5MB) | Preview

Abstract

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be desirable to remove personal information or unsightly objects. Such removal is not easily achieved with the current NeRF editing frameworks. We propose a framework to remove objects from a NeRF representation created from an RGBD sequence. Our NeRF inpainting method leverages recent work in 2D image inpainting and is guided by a userprovided mask. Our algorithm is underpinned by a confidence based view selection procedure. It chooses which of the individual 2D inpainted images to use in the creation of the NeRF, so that the resulting inpainted NeRF is 3D consistent. We show that our method for NeRF editing is effective for synthesizing plausible inpaintings in a multi-view coherent manner, outperforming competing methods. We validate our approach by proposing a new and still-challenging dataset for the task of NeRF inpainting.

Download activity - last month

Export as CSVJSONXML

Download activity - last 12 months

Export as XMLJSONCSV

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item