Toni, L;
Cheung, G;
Frossard, P;
(2015)
In-network view re-sampling for interactive free viewpoint video streaming.
In:
Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP).
(pp. pp. 4486-4490).
IEEE
Preview |
Text
Toni_main.pdf - Accepted Version Download (496kB) | Preview |
Abstract
Interactive free viewpoint video offers the possibility for each user to independently choose the views of a 3D scene to be displayed at the decoder. The visual content is commonly represented by N texture and depth map pairs that capture different viewpoints. A server selects an appropriate subset of M ≤ N views for transmission, so that the user can freely navigate in the corresponding window of viewpoints without being affected by network delay. During navigation, a user can synthesize any intermediate virtual view image in the navigation window via depth-image-based rendering (DIBR) using two nearby camera views as references. When the available bandwidth is too small to transmit all camera views typically used to synthesize views in the navigation window, we propose to synthesize intermediate virtual views as new references for transmission - a resampling of viewpoints for the 3D scene - so that the synthesized view distortion within the navigation window is minimized. We formulate a combinatorial optimization problem to find the best set of M virtual views to synthesize as new references, and show that the problem is NP-hard. We approximate the original problem with a new reference view equivalence model and derive in this case an optimal dynamic programming algorithm to determine the best set of M views to be transmitted to each user. Experimental results show that synthesizing virtual views as new references for client-side view synthesis can outperform simple selection from camera views by up to 0.73dB in synthesized view quality.
| Type: | Proceedings paper |
|---|---|
| Title: | In-network view re-sampling for interactive free viewpoint video streaming |
| Event: | 2015 IEEE International Conference on Image Processing (ICIP) |
| Location: | Quebec City, QC, Canada |
| Dates: | 27 September 2015 - 30 September 2015 |
| ISBN-13: | 9781479983391 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/ICIP.2015.7351655 |
| Publisher version: | http://dx.doi.org/10.1109/ICIP.2015.7351655 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1533072 |
Archive Staff Only
 |
View Item |
