Color and depth image registration algorithm based on multi-vector-fields constraints

• Published in: Multimedia tools and applications Vol. 78; no. 17; pp. 24301 - 24319
• Main Authors: Li, Xiaolin, Li, Daoqing, Peng, Li, Zhou, Huabing, Chen, Deng, Zhang, Yanduo, Xie, Liang
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.09.2019; Springer Nature B.V
• Subjects: Accuracy; Algorithms; Color; Computer Communication Networks; Computer Science; Constraints; Data Structures and Information Theory; Hilbert space; Image enhancement; Image processing; Image registration; Multimedia Information Systems; Noise; Parameters; Registration; Special Purpose and Application-Based Systems; Multi-vector-fields constraints; Image registration; Depth image; EM algorithm
• DOI: 10.1007/s11042-018-7048-4
• ISSN: 1380-7501

Image registration, which aim to establish a reliable feature relationship between images, is a critical problem in the field of image processing. In order to enhance the accuracy of color and depth image registration, this paper proposes an novel image registration algorithm based on multi-vector-fields constraints. We first initialize the edge information features of color and depth images, and establish putative correspondences based on edge information. Consider the correlation between the images, establish the functional relationships of the multi-vector-fields constraints based on the relationships. In the reproducing nuclear Hilbert space (RKHS), this constraint is added to the probability model, and the model parameters are optimized using the EM algorithm. Finally, the probability of corresponding edge points of the image is obtained. In order to further improve registration accuracy, this paper will change the input from one pair to two pairs and let the feature transformation relationship between images be iteratively evaluated using the parameter model. Taking publicly available RGB-D images as experimental subjects, results show that for single object image registration, the algorithm image registration accuracy in this paper is improved by about 5% compared with SC, ICP, and CPD algorithms. In addition, artificial noise was used to test the proposed algorithm’s anti-noise ability, results show that the proposed algorithm has superior anti-noise ability relative to SC, ICP and CPD algorithms.