METHOD AND APPARATUS FOR ACQUIRING PRE-TRAINED MODEL, ELECTRONIC DEVICE AND STORAGE MEDIUM

The present disclosure provides a method and apparatus for acquiring a pre-trained model, an electronic device and a storage medium, and relates to the fields such as deep learning, natural language processing, knowledge graph and intelligent voice. The method may include: acquiring a pre-training t...

Full description

Saved in:
Bibliographic Details
Main Authors JIANG, Wenbin, FENG, Zhifan, ZHU, Yong, FENG, Xinwei, LYU, Yajuan
Format Patent
LanguageEnglish
Published 19.01.2023
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The present disclosure provides a method and apparatus for acquiring a pre-trained model, an electronic device and a storage medium, and relates to the fields such as deep learning, natural language processing, knowledge graph and intelligent voice. The method may include: acquiring a pre-training task set composed of M pre-training tasks, M being a positive integer greater than 1, the pre-training tasks including: N question-answering tasks corresponding to different question-answering forms, N being a positive integer greater than 1 and less than or equal to M; and jointly pre-training the pre-trained model according to the M pre-training tasks.
Bibliography:Application Number: US202217866104