Real-time feature preserving rendering of visual effects on an image of a face

Mitchell, Kenneth J.; Cambra, Llogari Casas; Li, Yue

Abstract

Embodiments provide techniques for rendering augmented reality effects on an image of a user's face in real time. The method generally includes receiving an image of a face of a user. A global facial depth map and a luminance map are generated based on the captured image. The captured image is segmented into a plurality of segments. For each segment in the plurality of segments, a displacement energy of the respective segment is minimized using a least square minimization of a linear system for the respective segment. The displacement energy is generally defined by a relationship between a detailed depth map, the global facial depth map and the luminance map. The detailed depth map is generated based on the minimized displacement energy for each segment in the plurality of segments. One or more visual effects are rendered over the captured image using the generated detailed depth map.

Citation

Mitchell, K. J., Cambra, L. C., & Li, Y. (2022). Real-time feature preserving rendering of visual effects on an image of a face

• Online Publication Date: Mar 29, 2022
• Publication Date: Mar 29, 2022
• Deposit Date: Mar 18, 2025
• Public URL: http://researchrepository.napier.ac.uk/Output/4178284
• Publisher URL: https://ppubs.uspto.gov/dirsearch-public/patents/html/11288859?source=USPAT&requestToken=eyJzdWIiOiIzYTNjZjJlZC0zNWVlLTRjMDUtOWE1My05ZjUxY2Q2OTBhZDEiLCJ2ZXIiOiJhMTEzOGUwMS02MTc5LTRhZjctYmYxMC0wNWViNDk5YmEzOWQiLCJleHAiOjB9
• External URL: https://patents.google.com/patent/US11288859B2/en