Coupled 3D Reconstruction of Sparse Facial Hair and Skin


Thabo Beeler (Disney Research Zurich)
Bernd Bickel (Disney Research Zurich)
Gioacchino Noris (Disney Research Zurich)
Steve Marschner (Cornell University)
Paul Beardsley (Disney Research Zurich)
Bob Sumner (Disney Research Zurich)
Markus Gross (Disney Research Zurich)


August 5, 2012

Coupled 3D Reconstruction of Sparse Facial Hair and Skin

Although facial hair plays an important role in individual expression, facial-hair reconstruction is not addressed by current face-capture systems. Our research addresses this limitation with an algorithm that treats hair and skin surface capture together in a coupled fashion so that a high-quality representation of hair fibers as well as the underlying skin surface can be reconstructed. We propose a passive, camera-based system that is robust against arbitrary motion since all data is acquired within the time period of a single exposure. Our reconstruction algorithm detects and traces hairs in the captured images and reconstructs them in 3D using a multi-view stereo approach. Our coupled skin-reconstruction algorithm uses information about the detected hairs to deliver a skin surface that lies underneath all hairs irrespective of occlusions. In dense regions like eyebrows, we employ a hair-synthesis method to create hair fibers that plausibly match the image data. We demonstrate our scanning system on a number of individuals and show that it can successfully reconstruct a variety of facial-hair styles together with the underlying skin surface.

Download File "Coupled 3D Reconstruction of Sparse Facial Hair and Skin-Paper"
[pdf, 61.59 MB]


Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.