Dynamic Serpentine Convolution with Attention Mechanism Enhancement for Beef Cattle Behavior Recognition

• Published in: Animals (Basel) Vol. 14; no. 3; p. 466
• Main Authors: Li, Guangbo, Shi, Guolong, Zhu, Changjie
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 31.01.2024
• Subjects: Accuracy; Algorithms; attention mechanism; Beef cattle; beef cattle behavior recognition; Behavior; Cameras; Dairy cattle; Datasets; Deep learning; dynamic snake-shaped convolution; Efficiency; Farming; International economic relations; Livestock; Livestock industry; Machine vision; Neural networks; Sensors; Snakes; target detection; Ventilation; Video recorders; YOLOv8; China; dynamic snake-shaped convolution; target detection; beef cattle behavior recognition; attention mechanism; YOLOv8
• ISSN: 2076-2615; 2076-2615
• DOI: 10.3390/ani14030466

Behavior recognition in beef cattle is a crucial component of beef cattle behavior warning and intelligent farming. Traditional beef cattle behavior recognition faces challenges in both difficulty in identification and low accuracy. In this study, the YOLOv8n_BiF_DSC (Fusion of Dynamic Snake Convolution and BiFormer Attention) algorithm was employed for the non-intrusive recognition of beef cattle behavior. The specific steps are as follows: 45 beef cattle were observed using a fixed camera (A LINE OF DEFENSE) and a mobile phone (Huawei Mate20Pro) to collect and filter posture data, yielding usable videos ranging from 1 to 30 min in length. These videos cover nine different behaviors in various scenarios, including standing, lying, mounting, fighting, licking, eating, drinking, walking, and searching. After data augmentation, the dataset comprised 34,560 samples. The convolutional layer (CONV) was improved by introducing variable convolution and dynamic snake-like convolution modules. The dynamic snake-like convolution, which yielded the best results, expanded the model's receptive field, dynamically perceived key features of beef cattle behavior, and enhanced the algorithm's feature extraction capability. Attention mechanism modules, including SE (Squeeze-and-Excitation Networks), CBAM (Convolutional Block Attention Module), CA (Coordinate Attention), and BiFormer (Vision Transformer with Bi-Level Routing Attention), were introduced. The BiFormer attention mechanism, selected for its optimal performance, improved the algorithm's ability to capture long-distance context dependencies. The model's computational efficiency was enhanced through dynamic and query-aware perception. Experimental results indicated that YOLOv8n_BiF_DSC achieved the best results among all improved algorithms in terms of accuracy, average precision at IoU 50, and average precision at IoU 50:95. The accuracy of beef cattle behavior recognition reached 93.6%, with the average precision at IoU 50 and IoU 50:95 being 96.5% and 71.5%, respectively. This represents a 5.3%, 5.2%, and 7.1% improvement over the original YOLOv8n. Notably, the average accuracy of recognizing the lying posture of beef cattle reached 98.9%. In conclusion, the YOLOv8n_BiF_DSC algorithm demonstrates excellent performance in feature extraction and high-level data fusion, displaying high robustness and adaptability. It provides theoretical and practical support for the intelligent recognition and management of beef cattle.