AM³Net: Adaptive Mutual-Learning-Based Multimodal Data Fusion Network

• Published in: IEEE transactions on circuits and systems for video technology Vol. 32; no. 8; pp. 5411 - 5426
• Main Authors: Wang, Jinping, Li, Jun, Shi, Yanli, Lai, Jianhuang, Tan, Xiaojun
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.08.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: adaptive mutual-learning; Adaptive systems; and multimodal data classification; Channels; Classification; Convolution; Convolutional neural networks; data fusion; Data integration; Feature extraction; Hyperspectral imaging; Involution networks; Kernel; Laser radar; Learning; Lidar; Modules; Object recognition; Radar data; Spatial data; Synthetic aperture radar; Tensors

Multimodal data fusion, e.g., hyperspectral image (HSI) and light detection and ranging (LiDAR) data fusion, plays an important role in object recognition and classification tasks. However, existing methods pay little attention to the specificity of HSI spectral channels and the complementarity of H...