UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

In-network view re-sampling for interactive free viewpoint video streaming

Toni, L; Cheung, G; Frossard, P; (2015) In-network view re-sampling for interactive free viewpoint video streaming. In: Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP). (pp. pp. 4486-4490). IEEE Green open access

[thumbnail of Toni_main.pdf]
Preview
Text
Toni_main.pdf - Accepted Version

Download (496kB) | Preview

Abstract

Interactive free viewpoint video offers the possibility for each user to independently choose the views of a 3D scene to be displayed at the decoder. The visual content is commonly represented by N texture and depth map pairs that capture different viewpoints. A server selects an appropriate subset of M ≤ N views for transmission, so that the user can freely navigate in the corresponding window of viewpoints without being affected by network delay. During navigation, a user can synthesize any intermediate virtual view image in the navigation window via depth-image-based rendering (DIBR) using two nearby camera views as references. When the available bandwidth is too small to transmit all camera views typically used to synthesize views in the navigation window, we propose to synthesize intermediate virtual views as new references for transmission - a resampling of viewpoints for the 3D scene - so that the synthesized view distortion within the navigation window is minimized. We formulate a combinatorial optimization problem to find the best set of M virtual views to synthesize as new references, and show that the problem is NP-hard. We approximate the original problem with a new reference view equivalence model and derive in this case an optimal dynamic programming algorithm to determine the best set of M views to be transmitted to each user. Experimental results show that synthesizing virtual views as new references for client-side view synthesis can outperform simple selection from camera views by up to 0.73dB in synthesized view quality.

Type: Proceedings paper
Title: In-network view re-sampling for interactive free viewpoint video streaming
Event: 2015 IEEE International Conference on Image Processing (ICIP)
Location: Quebec City, QC, Canada
Dates: 27 September 2015 - 30 September 2015
ISBN-13: 9781479983391
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/ICIP.2015.7351655
Publisher version: http://dx.doi.org/10.1109/ICIP.2015.7351655
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/1533072
Downloads since deposit
73Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item