High-Quality Single-Shot Capture of Facial Geometry

Project Members

Thabo Beeler (Disney Research Zurich)
Bernd Bickel (Disney Research Zurich)
Paul Beardsley (Disney Research Zurich)
Bob Sumner (Disney Research Zurich)
Markus Gross (Disney Research Zurich)

 

Figure 1: Left: Face model captured using a seven camera studio setup; Center: capture systems; Right: Face model captured using consumer binocular-stereo camera. Facial geometry in all figures is best viewed in the electronic version.

 

[BiBTeX][QuickTime, 115.9MB]

Abstract

This project develops a passive stereo system for capturing the 3D geometry of a face in a single-shot with standard light sources. The system is low-cost and easy to deploy. Results are sub-millimeter accurate and commensurate with those from state-of-the-art systems based on active lighting (e.g., laser scanners), and the models meet the quality requirements of a demanding domain like the movie industry. Recovered models are shown for captures from both high-end cameras in a studio setting and from a consumer binocular-stereo camera, demonstrating scalability across a spectrum of camera deployments, and showing the potential for 3D face modeling to move beyond the professional arena and into the emerging consumer market in stereoscopic photography.

Our primary technical contribution is a modification of standard stereo refinement methods to capture pore-scale geometry, using a qualitative approach that produces visually realistic results. The second technical contribution is a calibration method suited to face capture systems. The systemic contribution includes multiple demonstrations of system robustness and quality. These include capture in a studio setup, capture off a consumer binocular-stereo camera, scanning of faces of varying gender and ethnicity and age, capture of highly-transient facial expression, and scanning a physical mask to provide ground-truth validation.

For more information (click here)

Publications

High-Quality Single-Shot Capture of Facial Geometry
July 25, 2010
Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 40:1-40:9
Paper File [pdf, 39.31 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.