Dan A. Calian
From Faces to Outdoor Light Probes
Calian, Dan A.; Lalonde, Jean-François; Gotardo, Paulo; Simon, Tomas; Matthews, Iain; Mitchell, Kenny
Authors
Jean-François Lalonde
Paulo Gotardo
Tomas Simon
Iain Matthews
Prof Kenny Mitchell K.Mitchell2@napier.ac.uk
Professor
Abstract
Image‐based lighting has allowed the creation of photo‐realistic computer‐generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer camera, without specialized calibration targets or equipment. Our insight is to use a person's face as an outdoor light probe. To estimate HDR light probes from LDR faces we use an inverse rendering approach which employs data‐driven priors to guide the estimation of realistic, HDR lighting. We build compact, realistic representations of outdoor lighting both parametrically and in a data‐driven way, by training a deep convolutional autoencoder on a large dataset of HDR sky environment maps. Our approach can recover high‐frequency, extremely high dynamic range lighting environments. For quantitative evaluation of lighting estimation accuracy and relighting accuracy, we also contribute a new database of face photographs with corresponding HDR light probes. We show that relighting objects with HDR light probes estimated by our method yields realistic results in a wide variety of settings.
Citation
Calian, D. A., Lalonde, J.-F., Gotardo, P., Simon, T., Matthews, I., & Mitchell, K. (2018). From Faces to Outdoor Light Probes. Computer Graphics Forum, 37(2), 51-61. https://doi.org/10.1111/cgf.13341
Journal Article Type | Article |
---|---|
Acceptance Date | Dec 11, 2017 |
Online Publication Date | May 22, 2018 |
Publication Date | May 22, 2018 |
Deposit Date | Dec 4, 2018 |
Journal | Computer Graphics Forum |
Print ISSN | 0167-7055 |
Electronic ISSN | 1467-8659 |
Publisher | Wiley |
Peer Reviewed | Peer Reviewed |
Volume | 37 |
Issue | 2 |
Pages | 51-61 |
DOI | https://doi.org/10.1111/cgf.13341 |
Keywords | Image-based lighting, photo-realistic computer-generated content, shading, 3D graphics, |
Public URL | http://researchrepository.napier.ac.uk/Output/1413563 |
Contract Date | Dec 4, 2018 |
You might also like
Structured Teaching Prompt Articulation for Generative-AI Role Embodiment with Augmented Mirror Video Displays
(2024)
Presentation / Conference Contribution
DeFT-Net: Dual-Window Extended Frequency Transformer for Rhythmic Motion Prediction
(2024)
Presentation / Conference Contribution
Auditory Occlusion Based on the Human Body in the Direct Sound Path: Measured and Perceivable Effects
(2024)
Presentation / Conference Contribution
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences
(2024)
Presentation / Conference Contribution
MoodFlow: Orchestrating Conversations with Emotionally Intelligent Avatars in Mixed Reality
(2024)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search