Multi-modal information transmission method and device, equipment and storage medium

The embodiment of the invention provides a multi-modal information transmission method and device, equipment and a storage medium. In the method, a to-be-transmitted target audio and multi-modal description information can be acquired, and the multi-modal description information is coded to obtain a...

Full description

Saved in:
Bibliographic Details
Main Author CHE YUNFEI
Format Patent
LanguageChinese
English
Published 12.05.2023
Subjects
ACOUSTICS
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
MUSICAL INSTRUMENTS
PHYSICS
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
Online AccessGet full text

Cover

More Information
Summary:The embodiment of the invention provides a multi-modal information transmission method and device, equipment and a storage medium. In the method, a to-be-transmitted target audio and multi-modal description information can be acquired, and the multi-modal description information is coded to obtain a multi-modal code according to audio starting and ending time corresponding to the multi-modal description information on the target audio; fusing the multi-modal code with the target audio to obtain fusion information; and sending the fusion information to a receiving device. Through the mode, the multi-mode codes and the target audio are fused, so that the multi-mode codes and the target audio can be synchronously transmitted, and the technical problem that different types of information wait for each other due to different time delays in the transmission process is solved. Meanwhile, the multi-modal code is obtained according to the audio starting and ending time corresponding to the multi-modal description info
Bibliography:Application Number: CN202211634179