UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

In-Network View Synthesis for Interactive Multiview Video Systems

Toni, L; Cheung, G; Frossard, P; (2016) In-Network View Synthesis for Interactive Multiview Video Systems. IEEE Transactions on Multimedia , 18 (5) pp. 852-864. 10.1109/TMM.2016.2537207. Green open access

[thumbnail of Toni_1509.00464v1.pdf]

Download (1MB) | Preview


In multiview applications, camera views can be used as reference views to synthesize additional virtual viewpoints, allowing users to freely navigate within a 3D scene. However, bandwidth constraints may restrict the number of reference views sent to clients, limiting the quality of the synthesized viewpoints. In this work, we study the problem of in-network reference view synthesis aimed at improving the navigation quality at the clients. We consider a distributed cloud network architecture, where data stored in a main cloud is delivered to end users with the help of cloudlets, i.e., resource-rich proxies close to the users. We argue that, in case of limited bandwidth from the cloudlet to the users, re-sampling at the couldlet the viewpoints of the 3D scene (i.e., synthesizing novel virtual views in the cloudlets to be used as new references to the decoder) is beneficial compared to mere subsampling of the original set of camera views. We therefore cast a new reference view selection problem that seeks the subset of views minimizing the distortion over a view navigation window defined by the user under bandwidth constraints. We prove that the problem is NP-hard, and we propose an effective polynomial time algorithm using dynamic programming to solve the optimization problem under general assumptions that cover most of the multiview scenarios in practice. Simulation results confirm the performance gain offered by virtual view synthesis in the network.

Type: Article
Title: In-Network View Synthesis for Interactive Multiview Video Systems
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TMM.2016.2537207
Publisher version: http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumbe...
Language: English
Additional information: © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Keywords: Cloud computing, Cameras, Navigation, Distortion, Bandwidth, Three-dimensional displays, Delays
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/1533069
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item