Wheat Yield Prediction Using Unmanned Aerial Vehicle RGB-Imagery-Based Convolutional Neural Network and Limited Training Samples

• Published in: Remote sensing (Basel, Switzerland) Vol. 15; no. 23; p. 5444
• Main Authors: Ma, Juncheng, Wu, Yongfeng, Liu, Binhui, Zhang, Wenying, Wang, Bianyin, Chen, Zhaoyang, Wang, Guangcai, Guo, Anqiang
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.12.2023
• Subjects: Adaptability; Agricultural production; Artificial neural networks; Cameras; canopy height; convolutional neural network; Crop management; Crop yield; Crop yields; Deep learning; Drone aircraft; Environmental aspects; Experiments; Feature selection; filling period; Grain; Growth; Image processing; Imagery; Irrigation; Machine learning; Methods; Neural networks; Performance prediction; Precipitation; Predictions; split-merge; Training; Triticum aestivum; UAV RGB imagery; Unmanned aerial vehicles; Water treatment; Wheat; Winter; Winter wheat; yield forecasting; yield prediction; China
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs15235444

Low-cost UAV RGB imagery combined with deep learning models has demonstrated the potential for the development of a feasible tool for field-scale yield prediction. However, collecting sufficient labeled training samples at the field scale remains a considerable challenge, significantly limiting the practical use. In this study, a split-merge framework was proposed to address the issue of limited training samples at the field scale. Based on the split-merge framework, a yield prediction method for winter wheat using the state-of-the-art Efficientnetv2_s (Efficientnetv2_s_spw) and UAV RGB imagery was presented. In order to demonstrate the effectiveness of the split-merge framework, in this study, Efficientnetv2_s_pw was built by directly feeding the plot images to Efficientnetv2_s. The results indicated that the proposed split-merge framework effectively enlarged the training samples, thus enabling improved yield prediction performance. Efficientnetv2_s_spw performed best at the grain-filling stage, with a coefficient of determination of 0.6341 and a mean absolute percentage error of 7.43%. The proposed split-merge framework improved the model ability to extract indicative image features, partially mitigating the saturation issues. Efficientnetv2_s_spw demonstrated excellent adaptability across the water treatments and was recommended at the grain-filling stage. Increasing the ground resolution of input images may further improve the estimation performance. Alternatively, improved performance may be achieved by incorporating additional data sources, such as the canopy height model (CHM). This study indicates that Efficientnetv2_s_spw is a promising tool for field-scale yield prediction of winter wheat, providing a practical solution to field-specific crop management.