Medical image and medical report pairing training model

• Main Authors: WANG ZUOCHENG, SONG GUOLEI, XIE HAOTIAN, WANG FEI, MA YUNJIE, XU XIAOLONG, WU YANPING
• Format: Patent
• Language: Chinese; English
• Published: 01.03.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

The invention discloses a medical image and medical report pairing training model, the model adopts a set # imgabs0 # of registration medical images and medical reports to realize training, and the training steps of the comprehensive training model are as follows: S1, image coding; s2, text coding; s3, attention weighted image representation is carried out; according to the method, useful feature representation can be automatically learned from the medical image and the medical report, the model can capture the complex relation between the medical image and the report data through joint learning of the medical image and the report data, the representation capability and the information extraction effect of the data are improved, the modern deep learning technology is introduced into the medical field, and the method is high in practicability. Therefore, integrated analysis of multi-modal medical data is realized, and more accurate and comprehensive support is provided for clinical diagnosis and disease monito