Kuffner Dos Anjos, Rafael;
Walton, David R;
Aksit, Kaan;
Friston, Sebastian;
Swapp, David;
Steed, Anthony;
Ritschel, Tobias;
(2022)
Metameric Inpainting for Image Warping.
IEEE Transactions on Visualization and Computer Graphics
10.1109/TVCG.2022.3216712.
(In press).
Preview |
Text
09928218.pdf - Accepted Version Download (6MB) | Preview |
Abstract
Image-warping, a per-pixel deformation of one image into another, is an essential component in immersive visual experiences such as virtual reality or augmented reality. The primary issue with image warping is disocclusions, where occluded (and hence unknown) parts of the input image would be required to compose the output image. We introduce a new image warping method, Metameric image inpainting - an approach for hole-filling in real-time with foundations in human visual perception. Our method estimates image feature statistics of disoccluded regions from their neighbours. These statistics are inpainted and used to synthesise visuals in real-time that are less noticeable to study participants, particularly in peripheral vision. Our method offers speed improvements over the standard structured image inpainting methods while improving realism over colour-based inpainting such as push-pull. Hence, our work paves the way towards future applications such as depth image-based rendering, 6-DoF 360 rendering, and remote render-streaming.
| Type: | Article |
|---|---|
| Title: | Metameric Inpainting for Image Warping |
| Location: | United States |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TVCG.2022.3216712 |
| Publisher version: | https://doi.org/10.1109/TVCG.2022.3216712 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Inpainting, warping, perception, real-time rendering |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10158438 |
Loading...
Loading...Loading...| 1. |  United States | 23 |
| 2. |  China | 6 |
| 3. |  United Kingdom | 6 |
| 4. |  Korea, Republic of | 4 |
| 5. |  France | 4 |
| 6. |  Russian Federation | 3 |
| 7. |  Germany | 2 |
| 8. |  Singapore | 2 |
| 9. |  Taiwan | 2 |
| 10. |  Poland | 2 |
Archive Staff Only
 |
View Item |
