Coupled 3D Reconstruction of Sparse Facial Hair and Skin

Project Members

Thabo Beeler (Disney Research Zurich)
Bernd Bickel (Disney Research Zurich)
Gioacchino Noris (Disney Research Zurich)
Paul Beardsley (Disney Research Zurich)
Steve Marschner (Disney Research, Zurich / Cornell University)
Bob Sumner (Disney Research Zurich)
Markus Gross (Disney Research Zurich)


Figure1: Coupled 3D reconstruction of sparse facial hair and skin applied to various different facial hairstyles.


Although facial hair plays an important role in individual expression, facial-hair reconstruction is not addressed by current face-capture systems. Our research addresses this limitation with an algorithm that treats hair and skin surface capture together in a coupled fashion so that a high-quality representation of hair fibers as well as the underlying skin surface can be reconstructed. We propose a passive, camera-based system that is robust against arbitrary motion since all data is acquired within the time period of a single exposure. Our reconstruction algorithm detects and traces hairs in the captured images and reconstructs them in 3D using a multi-view stereo approach. Our coupled skin-reconstruction algorithm uses information about the detected hairs to deliver a skin surface that lies underneath all hairs irrespective of occlusions. In dense regions like eyebrows, we employ a hair-synthesis method to create hair fibers that plausibly match the image data. We demonstrate our scanning system on a number of individuals and show that it can successfully reconstruct a variety of facial-hair styles together with the underlying skin surface.



Coupled 3D Reconstruction of Sparse Facial Hair and Skin
August 5, 2012
Paper File [pdf, 61.59 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.