UAV-CROWD: Violent and non-violent crowd activity simulator from the perspective of UAV

• Published in: arXiv.org
• Main Authors: Rahmun, Mahieyin, Tonmoay Deb, Shahriar Ali Bijoy, Mayamin Hamid Raha
• Format: Paper Journal Article
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 13.08.2022
• Subjects: Computer Science - Computer Vision and Pattern Recognition; Computer Science - Learning; Frames per second; Image segmentation; Simulation; Unmanned aerial vehicles; Urban environments
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2208.06702

Unmanned Aerial Vehicle (UAV) has gained significant traction in the recent years, particularly the context of surveillance. However, video datasets that capture violent and non-violent human activity from aerial point-of-view is scarce. To address this issue, we propose a novel, baseline simulator which is capable of generating sequences of photo-realistic synthetic images of crowds engaging in various activities that can be categorized as violent or non-violent. The crowd groups are annotated with bounding boxes that are automatically computed using semantic segmentation. Our simulator is capable of generating large, randomized urban environments and is able to maintain an average of 25 frames per second on a mid-range computer with 150 concurrent crowd agents interacting with each other. We also show that when synthetic data from the proposed simulator is augmented with real world data, binary video classification accuracy is improved by 5% on average across two different models.