Content-Adaptive Spatial Scalability for Scalable Video Coding Applications

Project Members

Nikolce Stefanoski (Disney Research Zurich)
Aljoscha Smolic (Disney Research Zurich)
Manuel Lang (Disney Research Zurich/ETH Zurich)

PROJECT_ContentAdaptiveVideo_teaser

Today, TV and video services are consumed using various types of display devices, e.g. TV sets, tablets, or smart phones. We have a heterogeneous environment of display devices available, where different display aspect-ratios (e.g. 4:3, 16:9) and resolutions (e.g. SDTV, HDTV) are natively supported. Content is usually distributed using single resolution video coding like H.264/AVC which does not allow to control how video content is retargeted on the consumer side. SVC, the scalable extension of H.264/AVC, allows to jointly transmit several videos with different aspect-ratios and resolutions. If SVC is used, a video with the appropriate aspect-ratio could be decoded, while inherent dependencies between the transmitted videos are exploited for an efficient overall compression. However, SVC supports only retargeting by cropping and linear scaling. Recently, we developed a method for efficient Content-adaptive Video Retargeting, which is considered as one of the currently best performing video retargeting methods known in research. But this result leaves open the question of how to efficiently deliver retargeted video content to consumers with different aspect ratios?

In this project, a scalable video coder is developed, which can simultaneously compress several video streams that have different aspect ratios and have been created by content-adaptive retargeting, MPEG’s Scalable Video Coder is extended for this purpose. Both video streams image warps are encoded in a scalable way, where the warps are exploited for an efficient compression (i.e. exploitation of redundancies between video streams) by using different techniques for inter-layer prediction. With our extension, video content of higher semantic quality can be transmitted in a scalable way by introducing an average overhead in bit rate of 9.3%

Publications

Extending SVC by Content-Adaptive Spatial Scalability-Thumbnail

Extending SVC by Content-Adaptive Spatial Scalability
September 11, 2011
International Conference on Image Processing (ICIP) 2011
Paper File [pdf, 1.13 MB]

Content-Adaptive Spatial Scalability for Scalable Video Coding-Thumbnail

Content-Adaptive Spatial Scalability for Scalable Video Coding
December 7, 2010
Picture Coding Symposium (PCS) 2010
Paper File [pdf, 385.14 KB]

Non-linear Warping and Warp Coding for Content-Adaptive Prediction in Advanced Video Coding Applications-Thumbnail

Non-linear Warping and Warp Coding for Content-Adaptive Prediction in Advanced Video Coding Applications
September 26, 2010
International Conference on Image Processing (ICIP) 2010
Paper File [pdf, 490.51 KB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.