CentroidNet: A Deep Neural Network for Joint Object Localization and Counting

• Published in: Machine Learning and Knowledge Discovery in Databases Vol. 11053; pp. 585 - 601
• Main Authors: Dijkstra, K., van de Loosdrecht, J., Schomaker, L. R. B., Wiering, M. A.
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2019; Springer International Publishing
• Series: Lecture Notes in Computer Science
• ISBN: 9783030109967; 3030109968
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-10997-4_36

In precision agriculture, counting and precise localization of crops is important for optimizing crop yield. In this paper CentroidNet is introduced which is a Fully Convolutional Neural Network (FCNN) architecture specifically designed for object localization and counting. A field of vectors pointing to the nearest object centroid is trained and combined with a learned segmentation map to produce accurate object centroids by majority voting. This is tested on a crop dataset made using a UAV (drone) and on a cell-nuclei dataset which was provided by a Kaggle challenge. We define the mean Average F1 score (mAF1) for measuring the trade-off between precision and recall. CentroidNet is compared to the state-of-the-art networks YOLOv2 and RetinaNet, which share similar properties. The results show that CentroidNet obtains the best F1 score. We also explicitly show that CentroidNet can seamlessly switch between patches of images and full-resolution images without the need for retraining.