Real-time Physics-based Motion Capture with Sparse Sensors

Andrews, Sheldon; Huerta, Ivan; Komura, Taku; Sigal, Leonid; Mitchell, Kenny

Abstract

We propose a framework for real-time tracking of humans using sparse multi-modal sensor sets, including data obtained from optical markers and inertial measurement units. A small number of sensors leaves the performer unencumbered by not requiring dense coverage of the body. An inverse dynamics solver and physics-based body model are used, ensuring physical plausibility by computing joint torques and contact forces. A prior model is also used to give an improved estimate of motion of internal joints. The behaviour of our tracker is evaluated using several black box motion priors. We show that our system can track and simulate a wide range of dynamic movements including bipedal gait, ballistic movements such as jumping, and interaction with the environment. The reconstructed motion has low error and appears natural. As both the internal forces and contacts are obtained with high credibility, it is also useful for human movement analysis.

Citation

Andrews, S., Huerta, I., Komura, T., Sigal, L., & Mitchell, K. (2016, December). Real-time Physics-based Motion Capture with Sparse Sensors. Presented at 13th European Conference on Visual Media Production (CVMP 2016) - CVMP 2016

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 13th European Conference on Visual Media Production (CVMP 2016) - CVMP 2016
• Start Date: Dec 12, 2016
• End Date: Dec 14, 2016
• Acceptance Date: Oct 1, 2016
• Online Publication Date: Dec 12, 2017
• Publication Date: Dec 12, 2016
• Deposit Date: Dec 12, 2017
• Publisher: Association for Computing Machinery (ACM)
• Series Title: ACM International Conference Proceeding Series
• Book Title: Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016)
• Chapter Number: n/a
• ISBN: 9781450347440
• DOI: https://doi.org/10.1145/2998559.2998564
• Keywords: motion capture; character animation; inverse dynamics
• Public URL: http://researchrepository.napier.ac.uk/Output/951430