Online volume measurement of sweetpotatoes by A LiDAR-based machine vision system

• Published in: Journal of food engineering Vol. 361; p. 111725
• Main Authors: Xu, Jiajun, Lu, Yuzhen, Olaniyi, Ebenezer, Harvey, Lorin
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.01.2024
• Subjects: cameras; color; computer vision; fruits; geometry; humans; lidar; Machine learning; Machine vision; phenotype; Phenotyping; Reconstruction; regression analysis; roller conveyors; storage quality; sweet potatoes; Sweetpotato; Volume; Reconstruction; Sweetpotato; Machine vision; Volume; Machine learning; Phenotyping
• ISSN: 0260-8774
• DOI: 10.1016/j.jfoodeng.2023.111725

Volume is an important phenotype and shape descriptor of sweetpotato storage roots for postharvest quality assessment and breeding programs. The standard water displacement method for measuring fruit volume is laborious, subject to human observation errors, and often destructive. Three-dimensional (3D) imaging-based machine vision provides an alternative for rapid and non-destructive volume estimation. However, existing machine vision-based methods usually require manually positioning samples or sensors to acquire different views of samples and hence are not suited for online, high-throughput applications. This study presents a novel machine vision system that comprises a custom-designed roller conveyor system to simultaneously transport and rotate sweetpotatoes for full-surface imaging, and a consumer-grade LiDAR (light detection and ranging) camera to acquire color and depth images. Sweetpotato storage roots of “Beuregard” were imaged online by the system with six consecutive scans obtained for each sample. Regression models were built for volume estimation using MLR (multiple linear regression), SNN (shallow neural network), and DNN (deep neural network) based on geometric features extracted from segmented fruit masks and the Alpha shape reconstructed from depth images. A feedforward four-hidden-layer DNN pre-trained by stack auto-encoders achieved the best accuracy of 97.9% (R2 = 0.993 and RMSE = 9.5 cm3), compared with the accuracies of 94.2% (R2 = 0.958 and RMSE = 27.2 cm3) and 96.2% (R2 = 0.976 and RMSE = 19.1 cm3) obtained by MLR and SNN, respectively. The developed 3D machine vision system is useful for online, rapid volume measurement of sweetpoatoes and can be potentially applied to other fruits. •A machine vision system was developed for online volume estimation of sweetpotato storage roots.•A LiDAR camera was used to scan sweetpotatoes traveling on a custom-designed roller conveyor.•Volume prediction models were built with geometric features extracted from consecutive scans.•A pretrained deep neural network achieved the volume estimation accuracy of 97.9%.