Context-Aware Dynamic Word Embeddings for Aspect Term Extraction

• Published in: IEEE transactions on affective computing Vol. 15; no. 1; pp. 144 - 156
• Main Authors: Xu, Jingyun, Xie, Jiayuan, Cai, Yi, Lin, Zehang, Leung, Ho-Fung, Li, Qing, Chua, Tat-Seng
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.01.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Ablation; Artificial neural networks; Aspect term extraction; attention mechanism; Context; Context modeling; Data mining; Embedding; Fans; Feature extraction; Portable computers; sentiment analysis; Task analysis; Touch sensitive screens; word embedding
• ISSN: 1949-3045; 1949-3045
• DOI: 10.1109/TAFFC.2023.3262941

The aspect term extraction (ATE) task aims to extract aspect terms describing a part or an attribute of a product from review sentences. Most existing works rely on either general or domain embedding to address this problem. Despite the promising results, the importance of general and domain embeddings is still ignored by most methods, resulting in degraded performances. Besides, word embedding is also related to downstream tasks, and how to regularize word embeddings to capture context-aware information is an unresolved problem. To solve these issues, we first propose context-aware dynamic word embedding (CDWE), which could simultaneously consider general meanings, domain-specific meanings, and the context information of words. Based on CDWE, we propose an attention-based convolution neural network, called ADWE-CNN for ATE, which could adaptively capture the previous meanings of words by utilizing an attention mechanism to assign different importance to the respective embeddings. The experimental results show that ADWE-CNN achieves a comparable performance with the state-of-the-art approaches. Various ablation studies have been conducted to explore the benefit of each component. Our code is publicly available at http://github.com/xiejiajia2018/ADWE-CNN .