Attention-based multi-instance learning for full slice images

• Main Author: HU FANGYAO
• Format: Patent
• Language: Chinese; English
• Published: 07.11.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

In one embodiment, the disclosure provides a method that includes receiving a full slice image and segmenting the full slice image into a plurality of image tiles. The method includes generating a feature vector corresponding to each tile of a plurality of tiles, wherein the feature vector for each of the tiles represents an embedding of the tile. The method includes calculating a weight value corresponding to each embedded feature vector using an attention network. The method includes calculating an image embedding based on the embedded feature vectors, wherein each embedded feature vector is weighted based on the weight value corresponding to the embedded feature vector. The method includes generating a classification for the full slice image based on the image embedding. 在一个实施方案中，本公开提供了一种方法，所述方法包括接收全切片图像以及将所述全切片图像分割成多个图像图块。所述方法包括生成与多个图块中的每个图块相对应的特征向量，其中针对所述图块中的每一个的所述特征向量表示所述图块的嵌入。所述方法包括使用注意力网络来计算与每个嵌入特征向量相对应的权重值。所述方法包括基于所述嵌入特征向量来计算图像嵌入，其中基于与所述嵌入特征向量相对应的所述权重值对每个嵌入特征向量进行加权。所述方法包括基于所述图像嵌入来生成针对所述全切片图像的分类。