Coupled 3D Reconstruction of Sparse Facial Hair and Skin
Thabo Beeler (Disney Research Zurich)
Bernd Bickel (Disney Research Zurich)
Gioacchino Noris (Disney Research Zurich)
Steve Marschner (Cornell University)
Paul Beardsley (Disney Research Zurich)
Bob Sumner (Disney Research Zurich)
Markus Gross (Disney Research Zurich)
ACM SIGGRAPH 2012
August 5, 2012
Although facial hair plays an important role in individual expression, facial-hair reconstruction is not addressed by current face-capture systems. Our research addresses this limitation with an algorithm that treats hair and skin surface capture together in a coupled fashion so that a high-quality representation of hair ﬁbers as well as the underlying skin surface can be reconstructed. We propose a passive, camera-based system that is robust against arbitrary motion since all data is acquired within the time period of a single exposure. Our reconstruction algorithm detects and traces hairs in the captured images and reconstructs them in 3D using a multi-view stereo approach. Our coupled skin-reconstruction algorithm uses information about the detected hairs to deliver a skin surface that lies underneath all hairs irrespective of occlusions. In dense regions like eyebrows, we employ a hair-synthesis method to create hair ﬁbers that plausibly match the image data. We demonstrate our scanning system on a number of individuals and show that it can successfully reconstruct a variety of facial-hair styles together with the underlying skin surface.
Download File "Coupled 3D Reconstruction of Sparse Facial Hair and Skin-Paper"
[pdf, 61.59 MB]