Non-linear Disparity Mapping for Stereoscopic 3D
Stereoscopic 3D creates the illusion of depth. However, extremely careful design is necessary to ensure an excellent user experience, which has to consider display technology, human visual perception and artistic intent. One important functionality in this context is the ability to change the disparity composition (and with that, the depth perception) of the stereo content AFTER capture. This was not supported satisfactory by any system so far. In this ground-breaking work we developed algorithms that provide full control over disparity of given stereo. Intended manipulations of depth perception are formalized mathematically via a set of disparity operators. Disparities are modified via image domain warping based on sparse disparity and 3D saliency estimation. This approach avoids drawbacks of previous methods based on dense depth estimation, and enables for the first time fully automatic, real-time, accurate, and reliable processing. Application areas include automatic real-time stereo correction for live broadcast, post-production and display adaptation. Besides the more technical features (corrections, adaptations, conversions) also completely new artistic tools and production workflows can be designed, which exploit the fact that depth can be changed as desired in post-production.