Medical image fusion based on sparse representation and neighbor energy activity

• Published in: Biomedical signal processing and control Vol. 80; p. 104353
• Main Authors: Li, Xiaosong, Wan, Weijun, Zhou, Fuqiang, Cheng, Xiaoqi, Jie, Yuchan, Tan, Haishu
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.02.2023
• Subjects: Medical aid; Multimodal medical image fusion; Neighbor energy activity; Sparse representation; Neighbor energy activity; Sparse representation; Multimodal medical image fusion; Medical aid
• ISSN: 1746-8094; 1746-8108
• DOI: 10.1016/j.bspc.2022.104353

•A medical image fusion method is proposed based on a two-layer decomposition scheme.•A novel scheme is proposed to fuse the detail layers while retaining brightness feature.•The fusion results are found to be useful for medical assistance in real clinical practice. Medical image fusion has become popular in recent years. The fused image can provide a more objective and comprehensive description of lesions and has significant clinical medical aid potential. In this paper, we propose a novel medical image fusion method based on sparse representation and neighbor energy activity that improves the quality of fused images and preserves key information in the source images, such as details, brightness, and color. The proposed method divides the source image into base and detail layers and adopts sparse representation to fuse the base layers. Further, a neighbor energy activity operator that effectively captures the changing features in the detail layers is utilized. The fused result is obtained by combining the selective layers. The proposed method is applicable to both grayscale and color image fusion problems. In experiments, ten sets of medical images were used as test images. The images included seven different diseases and one normal cranial image and covered five different fusion types: CT/T2, Gad/T2, PET/T1, PET/T2, and SPECT/T2. Further, it was compared with 11 state-of-the-art fusion algorithms, with six highly recognized metrics used for quantitative evaluation. The experimental results indicated that the proposed method outperformed several of the state-of-the-art methods in visual and objective evaluations. Additionally, in experiments conductedto medically analyze the fused images with eight different lesion conditions in the fused images, the fusion results were found to be practicable for medical assistance in actual clinics.