Ye Pan
MienCap: Performance-based Facial Animation with Live Mood Dynamics
Pan, Ye; Zhang, Ruisi; Wang, Jingying; Chen, Nengfu; Qiu, Yilin; Ding, Yu; Mitchell, Kenny
Authors
Ruisi Zhang
Jingying Wang
Nengfu Chen
Yilin Qiu
Yu Ding
Prof Kenny Mitchell K.Mitchell2@napier.ac.uk
Professor
Abstract
Our purpose is to improve performance-based animation which can drive believable 3D stylized characters that are truly perceptual. By combining traditional blendshape animation techniques with machine learning models, we present a real time motion capture system, called MienCap, which drive character expressions in a geometrically consistent and perceptually valid way. We demon-strate the effectiveness of our system by comparing to a commercial product Faceware. Results reveal that ratings of the recognition of expressions depicted for animated characters via our systems are statistically higher than Faceware. Our results may be implemented into the VR filmmaking and animation pipeline, and provide animators with a system for creating the expressions they wish to use more quickly and accurately.
Citation
Pan, Y., Zhang, R., Wang, J., Chen, N., Qiu, Y., Ding, Y., & Mitchell, K. (2022). MienCap: Performance-based Facial Animation with Live Mood Dynamics. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (645-646). https://doi.org/10.1109/vrw55335.2022.00178
Conference Name | 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) |
---|---|
Conference Location | Christchurch, New Zealand |
Start Date | Mar 12, 2022 |
End Date | Mar 16, 2022 |
Online Publication Date | Apr 20, 2022 |
Publication Date | 2022-03 |
Deposit Date | Jul 15, 2022 |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 645-646 |
Book Title | 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) |
DOI | https://doi.org/10.1109/vrw55335.2022.00178 |
Public URL | http://researchrepository.napier.ac.uk/Output/2889043 |
You might also like
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences
(2024)
Conference Proceeding
Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics
(2023)
Conference Proceeding
DanceGraph: A Complementary Architecture for Synchronous Dancing Online
(2023)
Presentation / Conference
Inaugural Editorial: A Lighthouse for Games and Playable Media
(2023)
Journal Article
Games Futures I
(2023)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search