Semi-supervised DNN regression on airborne hyperspectral imagery for improved spatial soil properties prediction

• Published in: Geoderma Vol. 385; p. 114875
• Main Authors: Ou, Depin, Tan, Kun, Lai, Jian, Jia, Xiuping, Wang, Xue, Chen, Yu, Li, Jie
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2021
• Subjects: absorption; adsorption; algorithms; arsenic; China; chromium; data collection; digital elevation models; frozen soils; Heavy metals; Hyperspectral imagery; land management; prediction; rain; Semi-supervised deep neural network regression; snowmelt; Soil organic matter; Spatial transportation and aggregation; streams; VNIR-SWIR spectroscopy; China; Soil organic matter; Semi-supervised deep neural network regression; Hyperspectral imagery; Spatial transportation and aggregation; VNIR-SWIR spectroscopy; Heavy metals
• ISSN: 0016-7061; 1872-6259
• DOI: 10.1016/j.geoderma.2020.114875

•Effective strategies for band selection and feature extraction.•A novel semi-supervised deep neural network regression (Semi-DNNR) model.•The performance of semi-DNNR is better than PLSR and SVR.•Hydrological analysis for spatial adsorption and transportation of the soil components.•The correlation and mechanism analysis between soil organic matter and arsenic. A number of algorithms have been developed for soil organic matter (SOM) or soil heavy metal detection in airborne hyperspectral imagery with high spatial and spectral resolutions. However, to achieve improved land management, the problems of the inconsistent features and low accuracy still need to be solved. In this paper, we propose a novel regression model to estimate the concentrations of SOM, arsenic (As), and chromium (Cr) in soil. Firstly, a hyperspectral unmixing technique is utilized to extract the bare soil pixels. We then combine the absorption depth feature after continuum removal, the original absorption feature, the band ratio feature, and the first-order differential feature, to form a set of features for parameter inversion. To solve the over-fitting problem caused by the small number of samples and the weak expression problem, the semi-supervised deep neural network regression (Semi-DNNR) model is introduced. The experimental were conducted using several datasets collected by HyMap, which is an airborne hyperspectral imaging sensor in VNIR-SWIR spectral range in Yitong county, Jilin province, China. The proposed Semi-DNNR model shows a good performance in this study, with the prediction Rp2 values for SOM, As, and Cr being 0.71, 0.82, and 0.63, respectively. After the spatial distribution map of the soil components of the study area was overlaid with the stream network, which was obtained from the digital elevation model (DEM). It was found that snowmelt, the melting of frozen soil, and surface rainfall can transport SOM to low-lying areas. A similar phenomenon was also observed for As, due to SOM adsorption and dissolved organic matter (DOM) complexation. A comparison of the proposed method with both feature selection methods (competitive adaptive reweighted sampling (CARS), genetic algorithm (GA)) and regression methods (partial least squares regression (PLSR), support vector regression (SVR)) shows that the proposed feature selection method is more robust than the CARS and GA methods. The proposed Semi-DNNR model was found to be at least 18.80% higher in prediction accuracy for As than the SVR or PLSR methods, at least 25.71% higher for Cr, and at least 19.73% higher for SOM.