Tampered video detection method and system based on multi-domain block feature mark point registration

• Main Authors: YAO QISEN, YU XIANGYU, HU YONGJIAN, LIU BEIBEI
• Format: Patent
• Language: Chinese; English
• Published: 01.07.2022
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; HANDLING RECORD CARRIERS; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS

The invention discloses a tampered video detection method and system based on multi-domain block feature mark point registration. The method comprises the following steps: extracting a to-be-detected area of each frame of image; constructing a feature extraction module; calculating an RGB image spatial domain feature and a DCT frequency spectrum of the to-be-detected region; extracting multi-scale spatial domain and frequency domain features and carrying out feature splicing to obtain fusion features; the fusion features are input into an attention module to generate attention guiding features; extracting local block features and key block features from the attention guiding features according to the face mark points; calculating the similarity between the block features and splicing the block features into a similarity matrix, and outputting a dichotomy prediction result; adopting a dichotomy label, a frame image local tampering probability and a frame image edge gradient to supervise network training; and p