Warp Coding for 3D Video (MPEG)
In this project, methods for efficient warp coding are investigated. Coded warps are transmitted together with stereo or multi-view video to enable additional functionalities at the receiver-side through image-domain-warping, e.g. depth adaption for stereo displays or support of multi-view autostereoscopic displays.
One coding method which we investigate is performed by partitioning warps using a resolution pyramid and predictively exploiting intra and inter partition dependencies. View synthesis is employed within the coding loop to control the overall coding process, i.e. to evaluate the contribution of coded partitions to the synthesis quality. We have shown that coded warps represent a practically negligible portion of about 3.6% of the overall (video+warp) bit rate. Furthermore, we showed that a transmission of warps leads to a reduction of synthesis time up to a factor of 8 in comparison to a fully automatic receiver-side view synthesis which uses only decoded video as input.
A second method we investigate employs state-of-the-art video coding methods for warp coding. We are actively contributing to MPEG with these types of warping coding methods with the goal of extending the syntax of the upcoming video coding standard HEVC to enable a transmission of warps along with video data