A Non-Invasive Method Based on Computer Vision for Grapevine Cluster Compactness Assessment Using a Mobile Sensing Platform under Field Conditions

• Published in: Sensors (Basel, Switzerland) Vol. 19; no. 17; p. 3799
• Main Authors: Palacios, Fernando, Diago, Maria P, Tardaguila, Javier
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 02.09.2019; MDPI
• Subjects: Artificial intelligence; Automation; cluster morphology; Color imagery; Computer vision; Digital cameras; Fungal diseases; Gaussian process; Generalized linear models; Grapevines; Image acquisition; image analysis; Image detection; Laboratories; Machine learning; Methods; Morphology; non-invasive sensing technologies; precision viticulture; proximal sensing; RGB; Root-mean-square errors; Seasons; Sensors; Technology assessment; Vineyards; Wineries & vineyards; United States > US; Japan; Spain; non-invasive sensing technologies; cluster morphology; precision viticulture; RGB; machine learning; image analysis; proximal sensing
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s19173799

Grapevine cluster compactness affects grape composition, fungal disease incidence, and wine quality. Thus far, cluster compactness assessment has been based on visual inspection performed by trained evaluators with very scarce application in the wine industry. The goal of this work was to develop a new, non-invasive method based on the combination of computer vision and machine learning technology for cluster compactness assessment under field conditions from on-the-go red, green, blue (RGB) image acquisition. A mobile sensing platform was used to automatically capture RGB images of grapevine canopies and fruiting zones at night using artificial illumination. Likewise, a set of 195 clusters of four red grapevine varieties of three commercial vineyards were photographed during several years one week prior to harvest. After image acquisition, cluster compactness was evaluated by a group of 15 experts in the laboratory following the International Organization of Vine and Wine (OIV) 204 standard as a reference method. The developed algorithm comprises several steps, including an initial, semi-supervised image segmentation, followed by automated cluster detection and automated compactness estimation using a Gaussian process regression model. Calibration (95 clusters were used as a training set and 100 clusters as the test set) and leave-one-out cross-validation models (LOOCV; performed on the whole 195 clusters set) were elaborated. For these, determination coefficient (R ) of 0.68 and a root mean squared error (RMSE) of 0.96 were obtained on the test set between the image-based compactness estimated values and the average of the evaluators' ratings (in the range from 1-9). Additionally, the leave-one-out cross-validation yielded a R of 0.70 and an RMSE of 1.11. The results show that the newly developed computer vision based method could be commercially applied by the wine industry for efficient cluster compactness estimation from RGB on-the-go image acquisition platforms in commercial vineyards.