STREAMING A LIGHT FIELD COMPRESSED UTILIZING LOSSLESS OR LOSSY COMPRESSION

• Main Authors: Boudaoud, Ben, McGuire, Morgan, Pajak, Dawid Stanislaw, Majercik, Alexander, Stengel, Michael
• Format: Patent
• Language: English
• Published: 05.05.2022
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing lossless or lossy compression and one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.