Cross-Modal Transformers for Infrared and Visible Image Fusion

• Published in: IEEE transactions on circuits and systems for video technology Vol. 34; no. 2; pp. 770 - 785
• Main Authors: Park, Seonghyun, Vien, An Gia, Lee, Chul
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Artificial neural networks; Computer vision; Data mining; Feature extraction; Feature maps; Image fusion; infrared image; Infrared imagery; Infrared imaging; Object recognition; Performance enhancement; self-attention; transformer; Transformers; visible image

Image fusion techniques aim to generate more informative images by merging multiple images of different modalities with complementary information. Despite significant fusion performance improvements of recent learning-based approaches, most fusion algorithms have been developed based on convolutiona...