Grammatically Derived Factual Relation Augmented Neural Machine Translation

Transformer-based neural machine translation (NMT) has achieved state-of-the-art performance in the NMT paradigm. This method assumes that the model can automatically learn linguistic knowledge (e.g., grammar and syntax) from the parallel corpus via an attention network. However, the attention netwo...

Full description

Saved in:
Bibliographic Details
Published inApplied sciences Vol. 12; no. 13; p. 6518
Main Authors Li, Fuxue, Zhu, Jingbo, Yan, Hong, Zhang, Zhen
Format Journal Article
LanguageEnglish
Published Basel MDPI AG 01.07.2022
Subjects
augmented
Decoding
factual relation
Linguistics
Machine translation
neural machine translation
Neural networks
prior knowledge
Representations
Translation
Online AccessGet full text

Cover

More Information
Summary:Transformer-based neural machine translation (NMT) has achieved state-of-the-art performance in the NMT paradigm. This method assumes that the model can automatically learn linguistic knowledge (e.g., grammar and syntax) from the parallel corpus via an attention network. However, the attention network cannot capture the deep internal structure of a sentence. Therefore, it is natural to introduce some prior knowledge to guide the model. In this paper, factual relation information is introduced into NMT as prior knowledge, and a novel approach named Factual Relation Augmented (FRA) is proposed to guide the decoder in Transformer-based NMT. In the encoding procedure, a factual relation mask matrix is constructed to generate the factual relation representation for the source sentence, while in the decoding procedure an effective method is proposed to incorporate the factual relation representation and the original representation of the source sentence into the decoder. Positive results obtained in several different translation tasks indicate the effectiveness of the proposed approach.
ISSN:2076-3417
2076-3417
DOI:10.3390/app12136518