Song, P;
Deng, X;
Mota, JFC;
Deligiannis, N;
Dragotti, PL;
Rodrigues, MRD;
(2019)
Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries.
IEEE Transactions on Computational Imaging
10.1109/TCI.2019.2916502.
(In press).
Preview |
Text
Rodrigues_1709.08680v2.pdf - Accepted Version Download (9MB) | Preview |
Abstract
Real-world data processing problems often involve various image modalities associated with a certain scene, including RGB images, infrared images or multi-spectral images. The fact that different image modalities often share certain attributes, such as certain edges, textures and other structure primitives, represents an opportunity to enhance various image processing tasks. This paper proposes a new approach to construct a high-resolution (HR) version of a low-resolution (LR) image given another HR image modality as reference, based on joint sparse representations induced by coupled dictionaries. Our approach, which captures the similarities and disparities between different image modalities in a learned sparse feature domain in \emph{lieu} of the original image domain, consists of two phases. The coupled dictionary learning phase is used to learn a set of dictionaries that couple different image modalities in the sparse feature domain given a set of training data. In turn, the coupled super-resolution phase leverages such coupled dictionaries to construct a HR version of the LR target image given another related image modality. One of the merits of our sparsity-driven approach relates to the fact that it overcomes drawbacks such as the texture copying artifacts commonly resulting from inconsistency between the guidance and target images. Experiments on real multimodal images demonstrate that incorporating appropriate guidance information via joint sparse representation induced by coupled dictionary learning brings notable benefits in the super-resolution task with respect to the state-of-the-art. Of particular relevance, the proposed approach also demonstrates better robustness than competing deep-learning-based methods in the presence of noise.
| Type: | Article |
|---|---|
| Title: | Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TCI.2019.2916502 |
| Publisher version: | http://doi.org/10.1109/TCI.2019.2916502 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10062095 |
Archive Staff Only
 |
View Item |
