Warp Coding for 3D Video (MPEG)

Project Members

Nikolce Stefanoski (Disney Research Zurich)
Manuel Lang (Disney Research Zurich/ETH Zurich)
Aljoscha Smolic (Disney Research Zurich)

 

PROJECT_WarpCoding_teaser

In this project, methods for efficient warp coding are investigated. Coded warps are transmitted together with stereo or multi-view video to enable additional functionalities at the receiver-side through image-domain-warping, e.g. depth adaption for stereo displays or support of multi-view autostereoscopic displays.

One coding method which we investigate is performed by partitioning warps using a resolution pyramid and predictively exploiting intra and inter partition dependencies. View synthesis is employed within the coding loop to control the overall coding process, i.e. to evaluate the contribution of coded partitions to the synthesis quality. We have shown that coded warps represent a practically negligible portion of about 3.6% of the overall (video+warp) bit rate. Furthermore, we showed that a transmission of warps leads to a reduction of synthesis time up to a factor of 8 in comparison to a fully automatic receiver-side view synthesis which uses only decoded video as input.

A second method we investigate employs state-of-the-art video coding methods for warp coding. We are actively contributing to MPEG with these types of warping coding methods with the goal of extending the syntax of the upcoming video coding standard HEVC to enable a transmission of warps along with video data

Publications

Image Quality vs Rate Optimized Coding of Warps for View Synthesis in 3D Video Applications-Thumbnail

Image Quality vs Rate Optimized Coding of Warps for View Synthesis in 3D Video Applications
September 30, 2012
International Conference on Image Processing (ICIP) 2012
Paper File [pdf, 807.79 KB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.