Anpei Chen
Photo-Realistic Facial Details Synthesis from Single Image
Chen, Anpei; Chen, Zhang; Zhang, Guli; Zhang, Ziheng; Mitchell, Kenny; Yu, Jingyi
Authors
Abstract
We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation and combines supervised and unsupervised learning for facial detail synthesis. On proxy generation, we conduct emotion prediction to determine a new expression-informed proxy. On detail synthesis, we present a Deep Facial Detail Net (DFDN) based on Conditional Generative Adversarial Net (CGAN) that employs both geometry and appearance loss functions. For geometry, we capture 366 high-quality 3D scans from 122 different subjects under 3 facial expressions. For appearance, we use additional 20K in-the-wild face images and apply image-based rendering to accommodate lighting variations. Comprehensive experiments demonstrate that our framework can produce high-quality 3D faces with realistic details under challenging facial expressions.
Citation
Chen, A., Chen, Z., Zhang, G., Zhang, Z., Mitchell, K., & Yu, J. (2019). Photo-Realistic Facial Details Synthesis from Single Image. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (9429-9439). https://doi.org/10.1109/ICCV.2019.00952
Conference Name | 2019 IEEE/CVF International Conference on Computer Vision (ICCV) |
---|---|
Conference Location | Seoul, Korea |
Start Date | Oct 27, 2019 |
End Date | Nov 2, 2019 |
Online Publication Date | Feb 27, 2020 |
Publication Date | 2019 |
Deposit Date | Apr 2, 2019 |
Publicly Available Date | Apr 3, 2019 |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 9429-9439 |
Series ISSN | 2380-7504 |
Book Title | 2019 IEEE/CVF International Conference on Computer Vision (ICCV) |
DOI | https://doi.org/10.1109/ICCV.2019.00952 |
Public URL | http://researchrepository.napier.ac.uk/Output/1702421 |
Files
Photo-Realistic Facial Details Synthesis from Single Image
(5.9 Mb)
PDF
Photo-Realistic Facial Details Synthesis From Single Image
(3.4 Mb)
PDF
Related Outputs
Feature-preserving detailed 3D face reconstruction from a single image
(2018)
Conference Proceeding
You might also like
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences
(2024)
Conference Proceeding
Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics
(2023)
Conference Proceeding
DanceGraph: A Complementary Architecture for Synchronous Dancing Online
(2023)
Presentation / Conference
Inaugural Editorial: A Lighthouse for Games and Playable Media
(2023)
Journal Article
Games Futures I
(2023)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search