Path-Space Motion Estimation and Decomposition for Robust Animation Filtering
Henning Zimmer (Disney Research Zurich)
Fabrice Rousselle (Disney Research Zurich)
Wenzel Jakob (ETH Zurich)
Oliver Wang (Disney Research Zurich)
David Adler (Walt Disney Animation Studios)
Wojciech Jarosz (Disney Research Zurich)
Olga Sorkine-Hornung (ETH Zurich)
Alexander Sorkine-Hornung (Disney Research Zurich)
Eurographics Symposium on Rendering (EGSR) 2015
June 24, 2015
Renderings of animation sequences with physics-based Monte Carlo light transport simulations are exceedingly costly to generate frame-by-frame, yet much of this computation is highly redundant due to the strong coherence in space, time and among samples. A promising approach pursued in prior work entails subsampling the sequence in space, time, and number of samples, followed by image-based spatio-temporal upsampling and denoising. These methods can provide significant performance gains, though major issues remain: firstly, in a multiple scattering simulation, the final pixel color is the composite of many different light transport phenomena, and this conflicting information causes artifacts in image-based methods. Secondly, motion vectors are needed to establish correspondence between the pixels in different frames, but it is unclear how to obtain them for most kinds of light paths (e.g. an object seen through a curved glass panel). To reduce these ambiguities, we propose a general decomposition framework, where the final pixel color is separated into components corresponding to disjoint subsets of the space of light paths. Each component is accompanied by motion vectors and other auxiliary features such as reflectance and surface normals. The motion vectors of specular paths are computed using a temporal extension of manifold exploration, and the remaining components use a specialized variant of optical flow. Our experiments show that this decomposition leads to significant improvements in three image-based applications: denoising, spatial upsampling, and temporal interpolation.
Download File "Path-space Motion Estimation and Decomposition for Robust Animation Filtering-Paper"
[pdf, 10.72 MB]