Augmenting Physical Avatars Using Projector-Based Illumination

Project Members

Amit Bermano (Disney Research Zurich)
Philipp Brüschweiler (Disney Research Zürich, ETH Zürich)
Anselm Grundhöfer (Disney Research Zurich)
Daisuke Iwai (Osaka University)
Bernd Bickel (Disney Research Zurich)
Markus Gross (Disney Research Zurich)



In this project, we propose a complete process for augmenting physical avatars using projector based illumination, significantly increasing their expressiveness. Given an input animation, the system decomposes the motion into low-frequency motion that can be physically reproduced by the animatronic head and high-frequency details that are added using projected shading. At the core is a spatio-temporal optimization process that compresses the motion in gradient space, ensuring faithful motion replay while respecting the physical limitations of the system. We also propose a complete multi-camera and projection system, including a novel defocused projection and subsurface scattering compensation scheme. The result of our system is a highly expressive physical avatar that features facial details and motion otherwise unreachable due to physical constraints.



Augmenting Physical Avatars Using Projector-Based Illumination
November 5, 2013
Paper File [pdf, 34.65 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.