High-image-quality virtual viewpoint drawing method for free viewpoint video

• Main Authors: ZHU WEI, ZHENG YAYU, CHEN LUYAO, CHEN SIJIE, CEN KUAN
• Format: Patent
• Language: Chinese; English
• Published: 07.07.2020
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; PICTORIAL COMMUNICATION, e.g. TELEVISION

The invention relates to a high-image-quality virtual viewpoint drawing method for a free viewpoint video. The high-image-quality virtual viewpoint drawing method comprises the following steps of: inputting color images, depth images, camera parameters and virtual viewpoint position parameters of two reference viewpoints; calculating a camera parameter matrix of the virtual viewpoints; detecting the edges of reference viewpoint depth maps; carrying out forward mapping on the reference viewpoint depth maps; performing median filtering on a virtual viewpoint depth map; carrying out backward mapping on a virtual viewpoint; expanding a cavity mask pattern in combination with edge information; performing brightness correction and image fusion; and carrying out residual hole interpolation, and outputting a final virtual viewpoint color image. According to the high-image-quality virtual viewpoint drawing method, small holes are improved, false edges are eliminated, unnecessary expansion operation is reduced, foregro