Semantic communication method, device and system for image classification task

• Main Authors: SUN HAO, CHI YUHAO, CHEN HAO, GUO JIE, SONG BIN
• Format: Patent
• Language: Chinese; English
• Published: 07.03.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a semantic communication method, device and system oriented to an image classification task. The method comprises the steps that a transmitter obtains semantic features of a given image and encodes the semantic features into transmitted image semantic vectors based on an auto-encoder; the relay node extracts the text feature of the given image, performs multi-modal feature fusion on the text feature and the image feature recovered by the image channel decoder, and then obtains a multi-modal semantic vector through the multi-modal channel encoder and forwards the multi-modal semantic vector to a receiver; and the receiver receives the multi-mode semantic vector and executes an image classification task. According to the semantic communication method provided by the invention, on one hand, an auto-encoder structure is introduced into semantic communication, information redundancy is greatly reduced, occupied communication resources are reduced, on the other hand, a multi-mode semantic re