Image Based Proximate Shadow Retargeting

Casas, Llogari; Fauconneau, Matthias; Kosek, Maggie; Mclister, Kieran; Mitchell, Kenny

Abstract

We introduce Shadow Retargeting which maps real shadow appearance to virtual shadows given a corresponding deformation of scene geometry, such that appearance is seamlessly maintained. By performing virtual shadow reconstruction from un-occluded real shadow samples observed in the camera frame, we recover the deformed shadow appearance efficiently. Our method uses geometry priors for the shadow casting object and a planar receiver surface. Inspired by image retargeting approaches we describe a novel local search strategy, steered by importance based deformed shadow estimation. Results are presented on a range of objects, deformations and illumination conditions in real-time Augmented Reality (AR) on a mobile device. We demonstrate the practical application of the method in generating otherwise laborious in-betweening frames for 3D printed stop motion animation.

Citation

Casas, L., Fauconneau, M., Kosek, M., Mclister, K., & Mitchell, K. (2018, September). Image Based Proximate Shadow Retargeting. Presented at Computer Graphics & Visual Computing (CGVC) 2018, Swansea University, United Kingdom

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Computer Graphics & Visual Computing (CGVC) 2018
• Start Date: Sep 13, 2018
• End Date: Sep 14, 2018
• Acceptance Date: Jul 24, 2018
• Online Publication Date: Sep 13, 2018
• Publication Date: 2018
• Deposit Date: Sep 14, 2018
• Journal: EG UK Computer Graphics & Visual Computing
• Publisher: Eurographics Association
• Peer Reviewed: Peer Reviewed
• Book Title: Proceedings of Computer Graphics & Visual Computing (CGVC) 2018
• DOI: https://doi.org/10.2312/cgvc.20181206
• Keywords: CCS Concepts, computing methodologies, mixed / augmented reality, graphics systems and interfaces, perception,
• Public URL: http://researchrepository.napier.ac.uk/Output/1299435