A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research

• Published in: Remote sensing of environment Vol. 177; pp. 89 - 100
• Main Authors: Khatami, Reza, Mountrakis, Giorgos, Stehman, Stephen V.
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.05.2016
• Subjects: Algorithms; Classification; Classification accuracy; Classifiers; decision support systems; Environmental monitoring; guidelines; Image classification; Indices; Land cover; Land cover mapping; Machine learning; meta-analysis; Multi-time/angle imagery; neural networks; normalized difference vegetation index; principal component analysis; Remote sensing; Support vector machines; Surface layer; Texture; Support vector machines; Classification accuracy; Multi-time/angle imagery; Machine learning; Land cover mapping; Indices; Environmental monitoring; Texture; Remote sensing
• ISSN: 0034-4257; 1879-0704
• DOI: 10.1016/j.rse.2016.02.028

Classification of remotely sensed imagery for land-cover mapping purposes has attracted significant attention from researchers and practitioners. Numerous studies conducted over several decades have investigated a broad array of input data and classification methods. However, this vast assemblage of research results has not been synthesized to provide coherent guidance on the relative performance of different classification processes for generating land cover products. To address this problem, we completed a statistical meta-analysis of the past 15years of research on supervised per-pixel image classification published in five high-impact remote sensing journals. The two general factors evaluated were classification algorithms and input data manipulation as these are factors that can be controlled by analysts to improve classification accuracy. The meta-analysis revealed that inclusion of texture information yielded the greatest improvement in overall accuracy of land-cover classification with an average increase of 12.1%. This increase in accuracy can be attributed to the additional spatial context information provided by including texture. Inclusion of ancillary data, multi-angle and time images also provided significant improvement in classification overall accuracy, with 8.5%, 8.0%, and 6.9% of average improvements, respectively. In contrast, other manipulation of spectral information such as index creation (e.g. Normalized Difference Vegetation Index) and feature extraction (e.g. Principal Components Analysis) offered much smaller improvements in accuracy. In terms of classification algorithms, support vector machines achieved the greatest accuracy, followed by neural network methods. The random forest classifier performed considerably better than the traditional decision tree classifier. Maximum likelihood classifiers, often used as benchmarking algorithms, offered low accuracy. Our findings will help guide practitioners to decide which classification to implement and also provide direction to researchers regarding comparative studies that will further solidify our understanding of different classification processes. However, these general guidelines do not preclude an analyst from incorporating personal preferences or considering specific algorithmic benefits that may be pertinent to a particular application. •We synthesize results from numerous studies of image classification methods.•Meta-analysis is used to quantify improvements in accuracy of methods.•Including texture information provided greatest improvement in accuracy.•Support vector machines achieved highest accuracy among classification algorithms.•Index creation and feature extraction offered minor improvements.