A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos

• Published in: Computer journal Vol. 67; no. 6; pp. 2270 - 2285
• Main Authors: Sandhya, Kashyap, Abhishek
• Format: Journal Article
• Language: English
• Published: Oxford University Press 24.06.2024
• Subjects: video forensics; motion residue; DS-layer CNN; spatio-temporal forgery; surveillance videos; object-based forgery; inter-frame forgery
• ISSN: 0010-4620; 1460-2067
• DOI: 10.1093/comjnl/bxae005

The present era is at the peak of technological advancement in image and video processing techniques, with user-friendly accessible tools/techniques. This immersive technology development makes video forensics enormously challenging. Specifically, the passive approaches to object-based forgeries in videos are crucial for legal and judicial matters. Hence, to ensure the integrity of the videos, a scientific, statistical and passive investigation of videos is required to maintain the spatial and temporal information content. This paper aims to develop a passive approach for digging out the forgery traces by applying the motion residue windowing technique for object removal forgery in surveillance videos. The novel max averaging windowing techniques improve visual imprints of the object removal forgery in the videos from the existing methods in the literature. A deep learning approach is the next step for achieving forgery detection in surveillance videos. The proposed lightweight depth-separable layer-optimized CNN has fast execution speed, optimized in terms of parameters without compromising the desired accuracy. This network is trained at a frame level with 98.60% testing accuracy, followed by a pipeline architecture of the proposed model for detection of forgery at video level with 99.01% accuracy. The suggested model works better than current models regarding post-processing operations, compression rates, forged video detection accuracy, precision, recall and F1 score.