SPECE: Subject Position Encoder in Complex Embedding for Relation Extraction

• Published in: Electronics (Basel) Vol. 13; no. 13; p. 2571
• Main Authors: Wu, Shangjia, Guo, Zhiqiang, Huang, Xiaofeng, Zhang, Jialiang, Ni, Yingfang
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.07.2024
• Subjects: Coders; Computational linguistics; Datasets; Embedding; Feature extraction; Knowledge representation; Language processing; Methods; Natural language interfaces; Natural language processing; Neural networks; Semantics; Structured data; Task complexity; Triplets; Unstructured data
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics13132571

As a crucial component of many natural language processing tasks, extracting entities and relations transforms unstructured text information into structured data, providing essential support for constructing knowledge graphs (KGs). However, current entity relation extraction models often prioritize the extraction of richer semantic features or the optimization of relation extraction methods, overlooking the significance of positional information and subject characteristics in this task. To solve this problem, we introduce the subject position-based complex exponential embedding for entity relation extraction model (SPECE). The encoder module of this model ingeniously combines a randomly initialized dilated convolutional network with a BERT encoder. Notably, it determines the initial position of the predicted subject based on semantic cues. Furthermore, it achieves a harmonious integration of positional encoding features and textual features through the adoption of the complex exponential embedding method. The experimental outcomes on both the NYT and WebNLG datasets reveal that, when compared to other baseline models, our proposed SPECE model demonstrates significant improvements in the F1 score on both datasets. This further validates its efficacy and superiority.