Tracking and analysing social interactions in dairy cattle with real-time locating system and machine learning

• Published in: Journal of systems architecture Vol. 116; p. 102139
• Main Authors: Ren, Keni, Bernes, Gun, Hetta, Mårten, Karlsson, Johannes
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.06.2021
• Subjects: Agricultural Science; Computer vision; Dairy cows; Jordbruksvetenskap; Machine learning; Other Engineering and Technologies not elsewhere specified; Social interactions; Ultra-wideband; Övrig annan teknik; Dairy cows; Ultra-wideband; Computer vision; Social interactions; Machine learning
• ISSN: 1383-7621; 1873-6165; 1873-6165
• DOI: 10.1016/j.sysarc.2021.102139

There is a need for reliable and efficient methods for monitoring the activity and social behaviour in cows, in order to optimise management in modern dairy farms. This research presents an embedded system that could track individual cows using Ultra-wideband technology. At the same time, social interactions between individuals around the feeding area were analysed with a computer vision module. Detections of the dairy cows’ negative and positive interactions were performed on foreground video stream using a Long-term Recurrent Convolution Networks model. The sensor fusion system was implemented and tested on seven dairy cows during 45 days in an experimental dairy farm. The system performance was evaluated at the feeding area. The real-time locating system based on Ultra-wideband technology reached an accuracy with mean error 0.39 m and standard deviation 0.62 m. The accuracy of detecting the affiliative and agonistic social interactions reached 93.2%. This study demonstrates a potential system for monitoring social interactions between dairy cows.