Cross-social network virtual identity association method and device based on multi-modal fusion and expression alignment

• Main Authors: LI SHUDONG, TANG KEKE, WU XIAOBO, HUANG QIANLAN, LUO XIAOJING, LU DANNA, HAN WEIHONG
• Format: Patent
• Language: Chinese; English
• Published: 21.03.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR

The invention discloses a cross-social network virtual identity association method and device based on multi-modal fusion and expression alignment, and the method comprises the steps: carrying out the feature extraction of user names of social networks of different platforms, texts published by users, and user social relations, and obtaining the feature information of different modes of the users; according to the feature information, performing multi-modal fusion by using an attention mechanism to obtain a first user representation fused with multi-dimensional features; enhancing the user representation of the first user representation through representation alignment, and finally obtaining second user representations with the same distribution on different platforms; and calculating cosine similarity between the second user representations to obtain similarity scores between the users, and taking the user pair with the highest score as an identity association result. According to the method, the problems th