SYSTEM AND METHOD FOR MOTION WARPING USING MULTI-EXPOSURE FRAMES

• Main Authors: GLOTZBACH JOHN W, YANG ANQI, SHEIKH HAMID RAHIM
• Format: Patent
• Language: Chinese; English
• Published: 12.10.2021
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; HANDLING RECORD CARRIERS; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS

A method includes obtaining, a first image frame and multiple second image frames of a scene. Each of the second image frames has an exposure time different from an exposure time of the first image frame. The method also includes generating optical flow information using at least one convolutional neural network, wherein the optical flow information indicates motion information of at least one object in the scene, determining at least one parameter for motion correction process based on the optical flow information, performing the motion correction process on at least one of the first image frame and the plurality of second image frames to generate a first intermediate data, wherein the motion correction process uses the identified at least one parameters, and generating a target image frame from the first intermediate data. 提供了一种方法，包括：获得场景的第一图像帧和多个第二图像帧，所述多个第二图像帧中的每一个具有与所述第一图像帧的曝光时间不同的曝光时间；使用至少一个卷积神经网络生成光流信息，其中，所述光流信息指示所述场景中的至少一个对象的运动信息；基于所述光流信息确定用于运动校正处理的至少一个参数；对所述第一图像帧和所述多个第二图像帧中的至少一个执行所述运动校正处理以生成第一中间数据，其中