Walton, DR;
Anjos, RKD;
Friston, S;
Swapp, D;
Akşit, K;
Steed, A;
Ritschel, T;
(2021)
Beyond blur: real-time ventral metamers for foveated rendering.
ACM Transactions on Graphics
, 40
(4)
, Article 48. 10.1145/3450626.3459943.
Preview |
Text
Steed_Practical_Metamer_Rendering_for_Foveated_Display.pdf - Accepted Version Download (39MB) | Preview |
Abstract
To peripheral vision, a pair of physically different images can look the same. Such pairs are metamers relative to each other, just as physically-different spectra of light are perceived as the same color. We propose a real-time method to compute such ventral metamers for foveated rendering where, in particular for near-eye displays, the largest part of the framebuffer maps to the periphery. This improves in quality over state-of-the-art foveation methods which blur the periphery. Work in Vision Science has established how peripheral stimuli are ventral metamers if their statistics are similar. Existing methods, however, require a costly optimization process to find such metamers. To this end, we propose a novel type of statistics particularly well-suited for practical real-time rendering: smooth moments of steerable filter responses. These can be extracted from images in time constant in the number of pixels and in parallel over all pixels using a GPU. Further, we show that they can be compressed effectively and transmitted at low bandwidth. Finally, computing realizations of those statistics can again be performed in constant time and in parallel. This enables a new level of quality for foveated applications such as such as remote rendering, level-of-detail and Monte-Carlo denoising. In a user study, we finally show how human task performance increases and foveation artifacts are less suspicious, when using our method compared to common blurring.
| Type: | Article |
|---|---|
| Title: | Beyond blur: real-time ventral metamers for foveated rendering |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3450626.3459943 |
| Publisher version: | https://doi.org/10.1145/3450626.3459943 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10133356 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
