Development and validation of a neural network for the automated detection of horn flies on cattle

• Published in: Computers and electronics in agriculture Vol. 180; p. 105927
• Main Authors: Psota, E.T., Luc, E.K., Pighetti, G.M., Schneider, L.G., Trout Fryxell, R.T., Keele, J.W., Kuehn, L.A.
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.01.2021; Elsevier BV
• Subjects: Automation; Bias; Cattle; Computer vision; Deep learning; Digital imaging; Flies; Fly counting; Horn flies; Livestock; Neural networks; Precision livestock; Weight reduction; Deep learning; Precision livestock; Fly counting; Horn flies
• DOI: 10.1016/j.compag.2020.105927
• ISSN: 0168-1699

•Framework for two-stage processing of high-resolution images for fly counting.•Deep learning methods for detecting and counting horn flies on cattle.•In-depth comparison of the automated method with human scorers.•Insights into the limitations of using computer vision for horn fly burden estimation. When the number of horn flies that blood feed on cattle exceeds the economic threshold, they can adversely affect the health and wellbeing of their hosts. Excessive horn fly burdens also lead to reduced weight gain and, consequently, diminished profits for livestock producers. Effective management and treatment require reliable surveillance methods for estimating the degree of horn fly burden (i.e., counting the number of flies on cattle). Traditionally, these estimates are obtained through human visual estimation, either in-person or by counting images on a photo; however, these methods are costly both in terms of time and labor and are prone to subjectivity and bias. In contrast, automated methods can expedite the counting process and remove subjectivity and bias. To this end, a 2-stage method is presented here that uses computer vision and deep learning to identify the location of flies in digital images. The first stage segments the salient cow from all other parts of the image to remove flies on neighboring cattle from consideration. The second stage processes full-resolution patches of the original image and produces a heat map at the location of flies in the images. The method was trained on a set of 375 human-annotated images and tested on 120 images, where significant variation was observed amongst the human scorers. Counting results are compared to four separate human scorers and demonstrate that the neural network produces consistent results and that the method is reliable. Thus, the developed method can be used for monitoring changes in horn fly populations over time by anyone and allows for increased rigor and repeatability. An examination of individual images where the method was closest to and farthest from the human counts provides valuable insights regarding photographic processes that lead to success and failure.