Visual detection of occluded crop: For automated harvesting

This paper presents a novel crop detection system applied to the challenging task of field sweet pepper (capsicum) detection. The field-grown sweet pepper crop presents several challenges for robotic systems such as the high degree of occlusion and the fact that the crop can have a similar colour to...

Full description

Saved in:
Bibliographic Details
Published in2016 IEEE International Conference on Robotics and Automation (ICRA) pp. 2506 - 2512
Main Authors McCool, Christopher, Inkyu Sa, Dayoub, Feras, Lehnert, Christopher, Perez, Tristan, Upcroft, Ben
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2016
Subjects
Agriculture
Image color analysis
Image segmentation
Lighting
Robots
Robustness
Visualization
Online AccessGet full text

Cover

More Information
Summary:This paper presents a novel crop detection system applied to the challenging task of field sweet pepper (capsicum) detection. The field-grown sweet pepper crop presents several challenges for robotic systems such as the high degree of occlusion and the fact that the crop can have a similar colour to the background (green on green). To overcome these issues, we propose a two-stage system that performs per-pixel segmentation followed by region detection. The output of the segmentation is used to search for highly probable regions and declares these to be sweet pepper. We propose the novel use of the local binary pattern (LBP) to perform crop segmentation. This feature improves the accuracy of crop segmentation from an AUC of 0.10, for previously proposed features, to 0.56. Using the LBP feature as the basis for our two-stage algorithm, we are able to detect 69.2% of field grown sweet peppers in three sites. This is an impressive result given that the average detection accuracy of people viewing the same colour imagery is 66.8%.
DOI:10.1109/ICRA.2016.7487405