Automatic Multiview Synthesis – Towards a Mobile System on a Chip


Michael Schaffner (Disney Research Zurich)
Frank Gürkaynak (ETH Zurich)
Hubert Kaeslin (ETH Zurich)
Luca Benini (ETH Zurich, University of Bologna)
Aljoscha Smolic (Disney Research Zurich)

International Conference on Visual Communications and Image Processing (VCIP) 2015

December 13, 2015


Over the last couple of years, multiview autostereoscopic displays (MADs) have become commercially available which enable a limited glasses-free 3D experience. The main problem of MADs is that they require several (typically 8 or 9) views, while most of the 3D video content is in stereoscopic 3D (S3D) today. In order to bridge this gap, the research community started to devise automatic multiview synthesis (MVS) methods. These algorithms require real-time processing and should be portable to end-user devices to develop their full potential. In this paper, we present a complete hardware system for fully automatic MVS. We give an overview of the algorithmic flow and corresponding hardware architecture and provide implementation results of a hybrid FPGA/ASIC prototype – which is the first complete hardware system implementing image-domain-warping-based MVS. The proposed hardware IP could be used as a co-processor in a system-on-chip (SoC) targeting 3D TV sets, thereby enabling efficient content generation in real-time.

Download File "Automatic Multiview Synthesis – Towards a Mobile System on a Chip-Paper"
[pdf, 3.32 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.