Wolski, K;
Giunchi, D;
Ye, N;
Piotr, D;
Myszkowski, K;
Mantiuk, R;
Seidel, H-P;
... Mantiuk, R; + view all
(2018)
Dataset and metrics for predicting local visible differences.
ACM Transactions on Graphics
, 37
(5)
, Article 172. 10.1145/3196493.
Preview |
Text
Giunchi_wolski2018local_metric.pdf - Accepted Version Download (8MB) | Preview |
Abstract
A large number of imaging and computer graphics applications require localized information on the visibility of image distortions. Existing image quality metrics are not suitable for this task as they provide a single quality value per image. Existing visibility metrics produce visual difference maps, and are specifically designed for detecting just noticeable distortions but their predictions are often inaccurate. In this work, we argue that the key reason for this problem is the lack of large image collections with a good coverage of possible distortions that occur in different applications. To address the problem, we collect an extensive dataset of reference and distorted image pairs together with user markings indicating whether distortions are visible or not. We propose a statistical model that is designed for the meaningful interpretation of such data, which is affected by visual search and imprecision of manual marking. We use our dataset for training existing metrics and we demonstrate that their performance significantly improves. We show that our dataset with the proposed statistical model can be used to train a new CNN-based metric, which outperforms the existing solutions. We demonstrate the utility of such a metric in visually lossless JPEG compression, super-resolution and watermarking.
Type: | Article |
---|---|
Title: | Dataset and metrics for predicting local visible differences |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1145/3196493 |
Publisher version: | https://doi.org/10.1145/3196493 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | visual perception, visual difference predictor, visual metric, distortion visibility, image quality, data-driven metric, dataset, convolutional neural network |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10048057 |
Archive Staff Only
![]() |
View Item |