A multimodal transformer to fuse images and metadata for skin disease classification A multimodal transformer to fuse images and metadata for skin disease classification

• Published in: The Visual computer Vol. 39; no. 7; pp. 2781 - 2793
• Main Authors: Cai, Gan, Zhu, Yu, Wu, Yue, Jiang, Xiaoben, Ye, Jiongyao, Yang, Dawei
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.07.2023; Springer Nature B.V
• Subjects: Artificial Intelligence; Classification; Coders; Computer Graphics; Computer Science; Datasets; Deep learning; Design; Diagnosis; Experiments; Image Processing and Computer Vision; Labels; Machine learning; Medical diagnosis; Medical imaging; Medical research; Metadata; Neural networks; Original; Original Article; Skin diseases; Deep learning; Skin disease; Transformer; Multimodal fusion; Attention

Skin disease cases are rising in prevalence, and the diagnosis of skin diseases is always a challenging task in the clinic. Utilizing deep learning to diagnose skin diseases could help to meet these challenges. In this study, a novel neural network is proposed for the classification of skin diseases...