TECHNIQUES FOR ENHANCING SKIN RENDERS USING NEURAL NETWORK PROJECTION FOR RENDERING COMPLETION

Techniques are disclosed for generating photorealistic images of head portraits. A rendering application renders a set of images that include the skin of a face and corresponding masks indicating pixels associated with the skin in the images. An inpainting application performs a neural projection te...

Full description

Saved in:
Bibliographic Details
Main Authors ZOSS, Gaspard, RIVIERE, Jeremy, WINBERG, Sebastian Valentin, URNAU GOTARDO, Paulo Fabiano, CHANDRAN, Prashanth, BRADLEY, Derek Edward
Format Patent
LanguageEnglish
Published 28.07.2022
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:Techniques are disclosed for generating photorealistic images of head portraits. A rendering application renders a set of images that include the skin of a face and corresponding masks indicating pixels associated with the skin in the images. An inpainting application performs a neural projection technique to optimize a set of parameters that, when input into a generator model, produces a set of projection images, each of which includes a head portrait in which (1) skin regions resemble the skin regions of the face in a corresponding rendered image; and (2) non-skin regions match the non-skin regions in the other projection images when the rendered set of images are standalone images, or transition smoothly between consecutive projection images in the case when the rendered set of images are frames of a video. The rendered images can then be blended with corresponding projection images to generate composite images that are photorealistic.
Bibliography:Application Number: US202117536777