Authentic Eye Region Capture through Artificial Reality Headset

• Main Authors: BAZIN, Jean-Charles, CHAPIRO, Alexandre
• Format: Patent
• Language: English
• Published: 29.02.2024
• Subjects: ADVERTISING; ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION; CALCULATING; COMPUTING; COUNTING; CRYPTOGRAPHY; DISPLAY; EDUCATION; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRIC DIGITAL DATA PROCESSING; ELECTRICITY; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; OPTICAL ELEMENTS, SYSTEMS, OR APPARATUS; OPTICS; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; SEALS

In holographic calling, it is difficult to capture the eyes of a caller due to lighting effects on an artificial reality (XR) headset. However, it can be important to capture the eyes when rendering the caller as they can show emotion, gaze, physical characteristics, etc., that aid in natural communication. Thus, implementations can capture the eyes of the caller using an external image capture device by briefly turning off the lighting effects on the XR headset. Some implementations can trigger the image capture device to capture an image of the eyes by temporal multiplexing in which timers on both the image capture device and the XR headset are synchronized. In other implementations, the image capture device can be an event-based camera that is automatically triggered to capture an image of the eyes based on a detected pixel change caused by deactivation of the lighting effects on the XR headset.