Medical image recognition method and device, electronic equipment and storage medium

• Main Authors: LEE TAEG-WON, WANG JIANZONG
• Format: Patent
• Language: Chinese; English
• Published: 28.05.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

The invention relates to a data processing technology, and discloses a medical image recognition method, which comprises the following steps that: a client acquires text features and image features, constructs an attention-based adapter corresponding to an image encoder in a multi-modal pre-training model, performs model training on the adapter by using local training data, and obtains an image feature; the server receives the model parameters of the trained adapter sent by the plurality of clients, performs weighted average operation on the model parameters of the trained adapter corresponding to each client to obtain updated model parameters, and distributes the updated model parameters to each client; and carrying out structure adjustment on the multi-modal pre-training model according to a standard adapter obtained through federal training to obtain an image recognition model, and inputting the text features and the image features into the image recognition model to obtain an image recognition result. The