Automatic spectral video matting

• Published in: Pattern recognition Vol. 46; no. 4; pp. 1183 - 1194
• Main Authors: Hu, Wu-Chih, Hsu, Jung-Fu
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier Ltd 01.04.2013; Elsevier
• Subjects: Applied sciences; Complexity; Component matching; Detection, estimation, filtering, equalization, prediction; Exact sciences and technology; Frames; Hue difference; Image detection; Image matting; Information, signal and communications theory; Mattes; Pattern recognition; Signal and communications theory; Signal, noise; Spectra; Spectral matting; State of the art; Telecommunications and information theory; Video matting; Spectral matting; Video matting; Image matting; Component matching; Hue difference; Performance evaluation; State of the art; Adaptive detection
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2012.10.012

This paper proposes automatic spectral video matting based on adaptive component detection and component-matching-based spectral matting. In the proposed automatic spectral video matting, adaptive component detection is used to automatically generate reliable components of a given image according to its complexity. Spectral matting based on the hue difference of components is then used to obtain an accurate alpha matte of the first frame without user intervention. Finally, the component-matching-based spectral matting is used in subsequent frames to obtain automatic video matting. In the proposed video matting method, the reliable components of a given image can be obtained; the accurate alpha mattes of given images can be automatically obtained; and the efficient and accurate video matting can be automatically obtained. Experimental results show that the proposed method outperforms state-of-the-art video matting methods based on spectral matting. ► Adaptive component detection can automatically obtain reliable components of a given image. ► Proposed spectral matting scheme can automatically obtain alpha mattes of given images. ► Proposed video matting scheme can automatically and efficiently obtain video matting.