SYSTEM AND METHOD FOR 3D VIDEO STABILIZATION BY FUSING ORIENTATION SENSOR READINGS AND IMAGE ALIGNMENT ESTIMATES

• Main Authors: KOZINTSEV IGOR V, HAUSSECKER HORST W, GAT YORAM, NESTARES OSCAR
• Format: Patent
• Language: English; Korean
• Published: 19.12.2011
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION

PURPOSE: A method and system for stabilizing a 3D video are provided to output a stabilized video sequence by fusing the outputs of a high pass filter and a lower pass filter. CONSTITUTION: An output(160) of an orientation sensor of a video camera(110) is received. The output of the orientation sensor is formatted as orientation time series(170). The filtered orientation information is generated by applying a low pass filter(180) to the orientation time series. The video sequence is received from the video camera. An inter-frame 3D camera rotation about a video sequence is estimated(130). The sequential images of the video sequence are aligned by using the estimated camera rotation. The aligned images are formatted as the aligned image time series. The filtered aligned image information is generated by applying a high pass filter to the aligned image time series. The stabilized video sequence is generated by combining the filtered aligned image information with the filtered orientation information.