Method and equipment for automatically detecting sight communication

• Main Authors: CHEN YI, GAO JING, FENG XIAO, YAO HUAXIONG, ZHAO ERDUN, ZHANG WEI
• Format: Patent
• Language: Chinese; English
• Published: 09.05.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

The invention provides a method and equipment for automatically detecting sight communication. The method comprises the following steps: step 1, carrying out feature extraction on a node image to obtain a feature image; step 2, carrying out structure updating on the feature image; 3, network node updating is carried out on the feature image after structure updating; and step 4, classifying and outputting the sight behaviors. According to the method, by extracting the character gaze behavior context specific information, the network topology structure information and the synchronization time sequence information between gaze events, different attention coefficients are distributed to the graph network message propagation path, and the prediction accuracy of the sight social behavior is improved. 本发明提供了一种自动检测视线交流的方法及设备。所述方法包括：步骤1，对节点图像进行特征提取，得到特征图像；步骤2，对特征图像进行结构更新；步骤3，对结构更新后的特征图像进行网络节点更新；步骤4，对视线行为进行分类输出。本发明通过提取人物注视行为上下文特定信息、网络拓扑结构信息、注视事件之间同步时序信息，对图网络消息传播路径分配不同注意力系数，提高了视线社交行为的预测准确性。