A Crop Image Segmentation and Extraction Algorithm Based on Mask RCNN

• Published in: Entropy (Basel, Switzerland) Vol. 23; no. 9; p. 1160
• Main Authors: Wang, Shijie, Sun, Guiling, Zheng, Bowen, Du, Yawen
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 03.09.2021; MDPI
• Subjects: Accuracy; Agriculture; Algorithms; Crops; Datasets; Deep learning; Design optimization; Feature extraction; Feature maps; Fruits; Image segmentation; instance segmentation; Interpolation; Machine learning; Mask RCNN; Network design; Neural networks; Operators (mathematics); Remote sensing; sobel operator; Spatial data; Target recognition
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e23091160

The wide variety of crops in the image of agricultural products and the confusion with the surrounding environment information makes it difficult for traditional methods to extract crops accurately and efficiently. In this paper, an automatic extraction algorithm is proposed for crop images based on Mask RCNN. First, the Fruits 360 Dataset label is set with Labelme. Then, the Fruits 360 Dataset is preprocessed. Next, the data are divided into a training set and a test set. Additionally, an improved Mask RCNN network model structure is established using the PyTorch 1.8.1 deep learning framework, and path aggregation and features are added to the network design enhanced functions, optimized region extraction network, and feature pyramid network. The spatial information of the feature map is saved by the bilinear interpolation method in ROIAlign. Finally, the edge accuracy of the segmentation mask is further improved by adding a micro-fully connected layer to the mask branch of the ROI output, employing the Sobel operator to predict the target edge, and adding the edge loss to the loss function. Compared with FCN and Mask RCNN and other image extraction algorithms, the experimental results demonstrate that the improved Mask RCNN algorithm proposed in this paper is better in the precision, Recall, Average precision, Mean Average Precision, and F1 scores of crop image extraction results.