Deep learning for the detection of good hygienic practices control measures for food handlers

• Published in: Food control Vol. 171; p. 111041
• Main Authors: Chen, I-Chun, Chi, Ching-Ho, Ku, Hao-Hsiang
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.05.2025
• Subjects: automation; compliance; computer vision; Convolutional neural network; cross contamination; data collection; Deep learning; Factory management; Food safety; Good hygienic Practice; hand washing; Handwashing procedure; hygiene; Personal protective equipment; protective clothing; safety equipment; vision; Personal protective equipment; Deep learning; Factory management; Convolutional neural network; Food safety; Handwashing procedure; Good hygienic Practice
• ISSN: 0956-7135
• DOI: 10.1016/j.foodcont.2024.111041

Hygiene habits and behaviors of food handlers are critical to ensuring food safety during production. Good Hygiene Practices (GHP) require food handlers to follow strict hygiene standards, including proper handwashing procedures and the use of personal protective equipment (PPE) such as hairnets, masks, gloves, protective clothing, pants, and work shoes to prevent cross-contamination in food factories. However, manual inspections in large-scale operations are often inefficient and impractical. To address this, this study proposes a deep learning-based system that leverages computer vision and Convolutional Neural Networks (CNNs) to automatically detect hand hygiene and PPE compliance before workers enter the production area. This ensures adherence to GHP standards, enhances food safety, improves inspection efficiency, and reduces costs. A dataset of 20,222 entries, comprising 12 handwashing actions from 8 angles and color-coded PPE conditions, was used to train and evaluate 10 models: YOLOv8, YOLOv7, YOLOv6, YOLOv5, ResNet, Dense-Net, MobileNetv2, EfficientNetv2, VGG, and Vision Transformer (ViT). YOLOv6 and YOLOv8 achieved the highest accuracy (0.999) for handwashing recognition, while Dense-Net achieved the highest accuracy (0.956) for PPE detection. This system offers an efficient and automated solution for monitoring hygiene habits, helping to prevent cross-contamination and ensure food safety within factory environments. •Since hygiene impacts food safety, GHP requires hand hygiene and PPE checks.•Use deep learning to check hand washing and personal protective equipment compliance.•Compare model performance in recognizing hand washing steps and PPE detection.•This detector is portable, easy to use, and flexible for hygiene management.•Deep learning can effectively improve efficiency, thereby maintaining food safety.