Real-time Physics-based Motion Capture with Sparse Sensors
Sheldon Andrews (Disney Research Zurich)
Ivan Huerta (Disney Research Zurich)
Taku Komura (Taku Komura University of Edinburgh)
Leonid Sigal (Disney Research Pittsburgh)
Kenny Mitchell (Disney Research Los Angeles)
Conference for Visual Media Production (CVMP) 2016
December 12, 2016
We propose a framework for motion capture using sparse multi-modal sensor sets, including data obtained from optical markers and inertial measurement units. A small number of sensors leaves the performer unencumbered by not requiring dense coverage of the body. An inverse dynamics solver and physics-based body model are used, ensuring physical plausibility by computing joint torques and contact forces. A prior model is also used to give an improved estimate of motion of internal joints. The behavior of our system is evaluated using several black box motion priors. We show that our system can follow and simulate a wide range of dynamic movements including bipedal gait, ballistic movements such as jumping, and interaction with the environment. The reconstructed motion has low error and appears natural. As both the internal forces and contacts are obtained with high credibility, it is also useful for human movement analysis.
Download File "Real-time Physics-based Motion Capture with Sparse Sensors-Paper"
[pdf, 2.78 MB]