Video Hashing with Tensor Robust PCA and Histogram of Optical Flow for Copy Detection

• Published in: Computer journal Vol. 67; no. 6; pp. 2162 - 2171
• Main Authors: Yu, Mengzhu, Tang, Zhenjun, Zhang, Hanyun, Liang, Xiaoping, Zhang, Xianquan
• Format: Journal Article
• Language: English
• Published: Oxford University Press 24.06.2024
• Subjects: Charlier moments; histogram of optical flow (HOF); copy detection; video hashing; tensor robust principal component analysis (TRPCA)
• ISSN: 0010-4620; 1460-2067
• DOI: 10.1093/comjnl/bxad130

This paper proposes a novel video hashing with tensor robust Principal Component Analysis (PCA) and Histogram of Optical Flow (HOF) for copy detection. In the proposed hashing, a video is divided into some video groups. For each video group, a low-rank secondary frame is constructed from the low-rank component decomposed by applying tensor robust PCA to the video group. Since the low-rank component can well indicate spatial-temporal intrinsic structure of the video group and it is slightly disturbed by digital operations, feature extraction from the low-rank secondary frames is discriminative and stable. Next, spatial features and temporal features are extracted from low-rank secondary frames by Charlier moments and HOF, respectively. Since the Charlier moments are robust to geometric transform and they can efficiently distinguish video frames with different contents, the use of Charlier moments can make robust and discriminative spatial features. As the HOF can measure the distribution of motion information between frames, the temporal features formed by HOFs can provide good discrimination. Hash is ultimately determined by quantizing the spatial and temporal features and concatenating the quantized results. Numerous experiments on open video datasets indicate that the proposed hashing is superior to some hashing baseline schemes in terms of classification and copy detection.