Object-Oriented Method Combined with Deep Convolutional Neural Networks for Land-Use-Type Classification of Remote Sensing Images

• Published in: Journal of the Indian Society of Remote Sensing Vol. 47; no. 6; pp. 951 - 965
• Main Authors: Jin, Baoxuan, Ye, Peng, Zhang, Xueying, Song, Weiwei, Li, Shihua
• Format: Journal Article
• Language: English
• Published: New Delhi Springer India 01.06.2019; Springer Nature B.V
• Subjects: Algorithms; anthropogenic activities; Artificial neural networks; Classification; data collection; Detection; Earth and Environmental Science; Earth Sciences; Feature extraction; Human influences; Image classification; Image segmentation; lakes; Land cover; Land use; land use and land cover maps; Land use classification; Machine learning; Neural networks; Object recognition; Remote sensing; Remote Sensing/Photogrammetry; Research Article; statistics; Deep learning; Multi-scale segmentation; Convolutional neural networks; Land-use-type classification; Object-oriented
• ISSN: 0255-660X; 0974-3006
• DOI: 10.1007/s12524-019-00945-3

Land-use information provides a direct representation of the effect of human activities on the environment, and an accurate and efficient land-use classification of remote sensing images is an important element of land-use and land-cover change research. To solve the problems associated with traditional land-use classification methods (e.g., rapid increase in dimensionality of data, inadequate feature extraction, and low running efficiency), a method that combines object-oriented approach with deep convolutional neural network (COCNN) is presented. First, a multi-scale segmentation algorithm is used to segment images to generate image segmentation regions with high homogeneity. Second, a typical rule set of feature objects is constructed on the basis of the object-oriented segmentation results, and the segmentation objects are classified and extracted to form a training sample set. Third, a convolutional neural network (CNN) model structure is modified to improve classification performance, and the training algorithm is optimized to avoid the overfitting phenomenon that occurs during training using small datasets. Ten land-use types are classified by using the remote sensing images covering the area around Fuxian Lake as an example. By comparing the COCNN method with the method based solely on CNN, precision and kappa index were selected to evaluate the classification accuracy of the two methods. For the COCNN method, on the basis of the classification statistics, precision and kappa index coefficients are 96.2% and 0.96, respectively, which are 8.98% and 0.1 higher than those of the method based solely on CNN. Experimental results show that the COCNN method reasonably and efficiently combines object-oriented and deep learning approaches, thereby effectively solving the problem of the inaccurate classification of typical features with better classification accuracy than the simple use of CNN.