Detailed Spatio-Temporal Reconstruction of Eyelids

Authors

Amit Bermano (Disney Research Zurich, ETH Zurich)
Thabo Beeler (Disney Research Zurich)
Yeara Kozlov (Disney Research Zurich, ETH Zurich)
Derek Bradley (Disney Research Zurich)
Bernd Bickel (Disney Research Zurich, IST Austria)
Markus Gross (Disney Research Zurich)

ACM SIGGRAPH 2015

July 26, 2015

Detailed Spatio-Temporal Reconstruction of Eyelids-Image

In recent years we have seen numerous improvements on 3D scanning and tracking of human faces, greatly advancing the creation of digital doubles for film and video games. However, despite the high-resolution quality of the reconstruction approaches available, current methods are unable to capture one of the most important regions of the face – the eye region. In this work, we present the first method for detailed spatio-temporal reconstruction of eyelids. Tracking and reconstructing eyelids is extremely challenging, as this region exhibits very complex and unique skin deformation where skin is folded under while opening the eye. Furthermore, eyelids are often only partially visible and obstructed due to self-occlusion and eyelashes. Our approach is to combine a geometric deformation model with image data, leveraging multi-view stereo, optical flow, contour tracking and wrinkle detection from local skin appearance. Our deformation model serves as a prior that enables reconstruction of eyelids even under strong self-occlusions caused by rolling and folding skin as the eye opens and closes. The output is a person-specific, time-varying eyelid reconstruction with anatomically plausible deformations. Our high-resolution detailed eyelids couple naturally with current facial performance capture approaches. As a result, our method can largely increase the fidelity of facial capture and the creation of digital doubles.

Download File "Detailed Spatio-Temporal Reconstruction of Eyelids-Paper"
[pdf, 39.18 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.