Language processing method, training method, device, equipment, medium and program product

• Main Authors: YANG SAIYONG, CHEN MINPING, HUANG MENGYUAN
• Format: Patent
• Language: Chinese; English
• Published: 31.10.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a language processing method and device, a training method and device, equipment, a medium and a program product, and the method comprises the steps: receiving an input to-be-processed text, and enabling the to-be-processed text to comprise a text which needs to be subjected to language processing; obtaining a language processing model, wherein the language processing model comprises a semantic feature coding network and a language processing network; performing semantic coding on the to-be-processed text through the semantic feature coding network to obtain semantic coding features of the to-be-processed text; performing language processing on the semantic coding features through a language processing network to obtain a processing result text of the to-be-processed text; the semantic feature coding network is obtained by training a mask language model by adopting a mask prediction task and a comparative learning task, a positive example of the comparative learning task comprises sema