eprintid: 1533069
rev_number: 21
eprint_status: archive
userid: 608
dir: disk0/01/53/30/69
datestamp: 2016-12-24 23:46:19
lastmod: 2021-09-19 23:52:01
status_changed: 2017-02-03 13:15:30
type: article
metadata_visibility: show
creators_name: Toni, L
creators_name: Cheung, G
creators_name: Frossard, P
title: In-Network View Synthesis for Interactive Multiview Video Systems
ispublished: pub
divisions: UCL
divisions: B04
divisions: C05
divisions: F46
keywords: Cloud computing,
Cameras,
Navigation,
Distortion,
Bandwidth,
Three-dimensional displays,
Delays
note: © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
abstract: In multiview applications, camera views can be used as reference views to synthesize additional virtual viewpoints, allowing users to freely navigate within a 3D scene. However, bandwidth constraints may restrict the number of reference views sent to clients, limiting the quality of the synthesized viewpoints. In this work, we study the problem of in-network reference view synthesis aimed at improving the navigation quality at the clients. We consider a distributed cloud network architecture, where data stored in a main cloud is delivered to end users with the help of cloudlets, i.e., resource-rich proxies close to the users. We argue that, in case of limited bandwidth from the cloudlet to the users, re-sampling at the couldlet the viewpoints of the 3D scene (i.e., synthesizing novel virtual views in the cloudlets to be used as new references to the decoder) is beneficial compared to mere subsampling of the original set of camera views. We therefore cast a new reference view selection problem that seeks the subset of views minimizing the distortion over a view navigation window defined by the user under bandwidth constraints. We prove that the problem is NP-hard, and we propose an effective polynomial time algorithm using dynamic programming to solve the optimization problem under general assumptions that cover most of the multiview scenarios in practice. Simulation results confirm the performance gain offered by virtual view synthesis in the network.
date: 2016-03-02
date_type: published
official_url: http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7423748
oa_status: green
full_text_type: other
language: eng
primo: open
primo_central: open_green
article_type_text: Journal Article
verified: verified_manual
elements_id: 1195904
doi: 10.1109/TMM.2016.2537207
lyricists_name: Toni, Laura
lyricists_id: LTONI29
full_text_status: public
publication: IEEE Transactions on Multimedia
volume: 18
number: 5
pagerange: 852-864
issn: 1520-9210
citation:        Toni, L;    Cheung, G;    Frossard, P;      (2016)    In-Network View Synthesis for Interactive Multiview Video Systems.                   IEEE Transactions on Multimedia , 18  (5)   pp. 852-864.    10.1109/TMM.2016.2537207 <https://doi.org/10.1109/TMM.2016.2537207>.       Green open access   
 
document_url: https://discovery.ucl.ac.uk/id/eprint/1533069/1/Toni_1509.00464v1.pdf