Social distance and face mask detector system exploiting transfer learning

• Published in: International journal of electrical and computer engineering (Malacca, Malacca) Vol. 12; no. 6; p. 6149
• Main Authors: Sadanand, Vijaya Shetty, Anand, Keerthi, Suresh, Pooja, Kadyada Arun Kumar, Punnya, Mahabaleshwar, Priyanka
• Format: Journal Article
• Language: English
• Published: Yogyakarta IAES Institute of Advanced Engineering and Science 01.12.2022
• Subjects: Accuracy; Algorithms; Deep learning; Euclidean geometry; IP (Internet Protocol); Machine learning; Masks; Object recognition; Real time; Social distancing; Surveillance; Surveillance systems; System effectiveness
• DOI: 10.11591/ijece.v12i6.pp6149-6158
• ISSN: 2088-8708

As time advances, the use of deep learning-based object detection algorithms has also evolved leading to developments of new human-computer interactions, facilitating an exploration of various domains. Considering the automated process of detection, systems suitable for detecting violations are developed. One such applications is the social distancing and face mask detectors to control air-borne diseases. The objective of this research is to deploy transfer learning on object detection models for spotting violations in face masks and physical distance rules in real-time. The common drawbacks of existing models are low accuracy and inability to detect in real-time. The MobileNetV2 object detection model and YOLOv3 model with Euclidean distance measure have been used for detection of face mask and physical distancing. A proactive transfer learning approach is used to perform the functionality of face mask classification on the patterns obtained from the social distance detector model. On implementing the application on various surveillance footage, it was observed that the system could classify masked and unmasked faces and if social distancing was maintained or not with accuracies 99% and 94% respectively. The models exhibited high accuracy on testing and the system can be infused with the existing internet protocol (IP) cameras or surveillance systems for real-time surveillance of face masks and physical distancing rules effectively.