METHOD, SYSTEM, AND COMPUTER READABLE STORAGE MEDIA FOR DISTILLING LONGITUDINAL SECTION TYPE SPOKEN LANGUAGE UNDERSTANDING KNOWLEDGE UTILIZING TEXT-BASED PRE-LEARNING MODEL

• Main Authors: CHO GENYOKU, KWAK DONGHYUN, KIM NAM-SOO
• Format: Patent
• Language: English; Japanese
• Published: 09.03.2022
• Subjects: ACOUSTICS; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

To provide a method, a system, and computer-readable recording media for distilling longitudinal section type spoken language understanding knowledge utilizing a text-based pre-learning model.SOLUTION: In learning a spoken language understanding model with a longitudinal section type structure in which a speech recognition model and a natural language understanding model are linked, the spoken language understanding model is learned by cross-modal knowledge distillation using a text-based pre-learned language model.SELECTED DRAWING: Figure 4 【課題】 テキスト基盤の事前学習モデルを活用した縦断型音声言語理解知識を蒸留するための方法、システム、およびコンピュータ読み取り可能な記録媒体を提供する。【解決手段】 音声認識モデルと自然言語理解モデルが連結された縦断型構造の音声言語理解（ｓｐｏｋｅｎ ｌａｎｇｕａｇｅ ｕｎｄｅｒｓｔａｎｄｉｎｇ）モデルを学習するにあたり、テキスト基盤の事前学習された言語モデルを利用したクロスモーダル知識蒸留（ｃｒｏｓｓ－ｍｏｄａｌ ｋｎｏｗｌｅｄｇｅ ｄｉｓｔｉｌｌａｔｉｏｎ）によって前記音声言語理解モデルを学習する。【選択図】図４