Content Retargeting Using Parameter-Parallel Facial Layers
Natasha Kholgade (Carnegie Mellon University)
Iain Matthews (Disney Research Pittsburgh)
Yaser Sheikh (Disney Research Pittsburgh, Carnegie Mellon University)
ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA) 2011
August 5, 2011
Facial motion retargeting approaches often transfer expressions by establishing correspondences between shared units of motion, such as action units, or spatial correspondences of landmarks between the source actor and target character faces. When the actor and character are structurally dissimilar, shared units of motion or spatial landmarks may not exist, and subtle styles of performance may differ. We present a method to deconstruct the content of an actor’s facial expression into three layers using an additive composition function, transfer the content to parameter-parallel layers for the character, and reconstruct the character’s expression using the same composition function. Our algorithm uses a parameter-parallel layered model of facial expression for both the actor and character, separating the content of facial expressions into emotion, speech, and eye-blink layers. Facial motion in each layer is embedded in simplicial bases, each of which encodes semantically significant configurations of the face. We show the transfer of facial motion capture and video-based tracking of the eyes and mouth of an actor to a number of faces with dissimilar facial structure and expressive disposition.
Download File "Content Retargeting Using Parameter-Parallel Facial Layers – Paper"
[pdf, 33.80 MB]