Inflated 3D ConvNet context analysis for violence detection

• Published in: Machine vision and applications Vol. 33; no. 1
• Main Authors: Freire-Obregón, David, Barra, Paola, Castrillón-Santana, Modesto, Marsico, Maria De
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.01.2022; Springer Nature B.V
• Subjects: Classifiers; Communications Engineering; Computer Science; Context; Datasets; Image Processing and Computer Vision; Networks; Pattern Recognition; Proposals; Robotics and Intelligent Systems; Special Issue on 25th ICPR - Computer Vision; Special Issue Paper; Training; Violence; Vision systems; I3D model; Transfer learning; Context analysis; Violence detection; People tracking
• ISSN: 0932-8092; 1432-1769
• DOI: 10.1007/s00138-021-01264-9

According to the Wall Street Journal, one billion surveillance cameras will be deployed around the world by 2021. This amount of information can be hardly managed by humans. Using a Inflated 3D ConvNet as backbone, this paper introduces a novel automatic violence detection approach that outperforms state-of-the-art existing proposals. Most of those proposals consider a pre-processing step to only focus on some regions of interest in the scene, i.e., those actually containing a human subject. In this regard, this paper also reports the results of an extensive analysis on whether and how the context can affect or not the adopted classifier performance. The experiments show that context-free footage yields substantial deterioration of the classifier performance (2% to 5%) on publicly available datasets. However, they also demonstrate that performance stabilizes in context-free settings, no matter the level of context restriction applied. Finally, a cross-dataset experiment investigates the generalizability of results obtained in a single-collection experiment (same dataset used for training and testing) to cross-collection settings (different datasets used for training and testing).