DEVICE AND TEXT REPRESENTATION METHOD APPLIED TO SENTENCE EMBEDDING

• Main Authors: Liu, Junxian, Shu, Zhen, Chen, Honghui, Luo, Xueshan, Chen, Tao, Luo, Aimin, Cai, Fei
• Format: Patent
• Language: English
• Published: 21.05.2020
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

The invention discloses a device and text representation method applied to sentence embedding, which has determining a parent word and a child words set corresponding to the parent word, obtaining an hidden interaction state of parent word based on the hidden interaction state of all child words; obtaining parent word sequence corresponding to the parent word and obtaining hidden state sequence corresponding to the hidden state of parent word; obtaining the interaction representation sequence of each parent word and other parent word based on the hidden state sequence, generating sentence embeddings. The invention proposes to realize sentence embeddings through a two-level interaction representation. The two-level interaction representation is local interaction representation and a global interaction representation respectively, and combines the two-level representation to generate a hybrid interaction representation, which can improve the accuracy and efficiency of sentence embeddings and be significantly better than the Tree-LSTM model in terms of accuracy.