A review of deep learning algorithms for computer vision systems in livestock

• Published in: Livestock science Vol. 253; p. 104700
• Main Authors: Borges Oliveira, Dario Augusto, Ribeiro Pereira, Luiz Gustavo, Bresolin, Tiago, Pontes Ferreira, Rafael Ehrich, Reboucas Dorea, Joao Ricardo
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.11.2021
• Subjects: animal behavior; animal identification; animal stress; Artificial intelligence; biometry; body weight; Cattle; computer vision; data collection; farm management; feed intake; image analysis; information management; livestock; livestock and meat industry; Machine learning; phenotype; Precision farming; Swine; Precision farming; Cattle; Swine; Artificial intelligence; Machine learning
• ISSN: 1871-1413; 1878-0490
• DOI: 10.1016/j.livsci.2021.104700

•Review of animal science studies that used deep learning in computer vision systems.•Greater adoption of deep learning algorithms for image classification.•The phenotype with greater interest was animal behavior..•Swine was the most frequent species found in the reviewed articles. In livestock operations, systematically monitoring animal body weight, biometric body measurements, animal behavior, feed bunk, and other difficult-to-measure phenotypes is manually unfeasible due to labor, costs, and animal stress. Applications of computer vision are growing in importance in livestock systems due to their ability to generate real-time, non-invasive, and accurate animal-level information. However, the development of a computer vision system requires sophisticated statistical and computational approaches for efficient data management and appropriate data mining, as it involves massive datasets. This article aims to provide an overview of how deep learning has been implemented in computer vision systems used in livestock, and how such implementation can be an effective tool to predict animal phenotypes and to accelerate the development of predictive modeling for precise management decisions. First, we reviewed the most recent milestones achieved with computer vision systems and the respective deep learning algorithms implemented in Animal Science studies. Then, we reviewed the published research studies in Animal Science which used deep learning algorithms as the primary analytical strategy for image classification, object detection, object segmentation, and feature extraction. The great number of reviewed articles published in the last few years demonstrates the high interest and rapid development of deep learning algorithms in computer vision systems across livestock species. Deep learning algorithms for computer vision systems, such as Mask R-CNN, Faster R-CNN, YOLO (v3 and v4), DeepLab v3, U-Net and others have been used in Animal Science research studies. Additionally, network architectures such as ResNet, Inception, Xception, and VGG16 have been implemented in several studies across livestock species. The great performance of these deep learning algorithms suggests an improved predictive ability in livestock applications and a faster inference. However, only a few articles fully described the deep learning algorithms and their implementation. Thus, information regarding hyperparameter tuning, pre-trained weights, deep learning backbone, and hierarchical data structure were missing. We summarized peer-reviewed articles by computer vision tasks (image classification, object detection, and object segmentation), deep learning algorithms, animal species, and phenotypes including animal identification and behavior, feed intake, animal body weight, and many others. Understanding the principles of computer vision and the algorithms used for each application is crucial to develop efficient systems in livestock operations. Such development will potentially have a major impact on the livestock industry by predicting real-time and accurate phenotypes, which could be used in the future to improve farm management decisions, breeding programs through high-throughput phenotyping, and optimized data-driven interventions.