Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

• Published in: IEEE transactions on geoscience and remote sensing Vol. 55; no. 5; pp. 2941 - 2958
• Main Authors: Yuanxin Ye, Jie Shan, Bruzzone, Lorenzo, Li Shen
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.05.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Correlation coefficient; Correlation coefficients; Data analysis; Feature extraction; Image detection; Image registration; Imagery; Lidar; Mapping; multimodal image analysis; Nonlinear optics; phase congruency; Radiometers; Radiometry; Registration; Remote sensing; Robustness; SAR (radar); Similarity; Statistics; structural similarity; Synthetic aperture radar; Template matching
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2017.2656380

Automatic registration of multimodal remote sensing data [e.g., optical, light detection and ranging (LiDAR), and synthetic aperture radar (SAR)] is a challenging task due to the significant nonlinear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the histogram of orientated phase congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity metric named HOPCncc is defined, which uses the normalized correlation coefficient (NCC) of the HOPC descriptors for multimodal registration. In the definition of the proposed similarity metric, we first extend the phase congruency model to generate its orientation representation and use the extended model to build HOPCncc. Then, a fast template matching scheme for this metric is designed to detect the control points between images. The proposed HOPCncc aims to capture the structural similarity between images and has been tested with a variety of optical, LiDAR, SAR, and map data. The results show that HOPCncc is robust against complex nonlinear radiometric differences and outperforms the state-of-the-art similarities metrics (i.e., NCC and mutual information) in matching performance. Moreover, a robust registration method is also proposed in this paper based on HOPCncc, which is evaluated using six pairs of multimodal remote sensing images. The experimental results demonstrate the effectiveness of the proposed method for multimodal image registration.