Enhancing the Performance of WSD Task Using Regularized GNNs With Semantic Diffusion

• Published in: IEEE access Vol. 11; p. 1
• Main Authors: Sert, Bilge Sipal, Elma, Eren, Altinel, Ayse Berna
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.01.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Ambiguity; Artificial neural networks; Biology; Chemical reactions; Classifiers; Context; Convolutional neural networks; Datasets; Diffusion Algorithm; Diffusion effects; Diffusion processes; Domains; English language; Graph Convolutional Neural Networks; Graph neural networks; Graph Regularization; Machine learning algorithms; Neural networks; Performance enhancement; Polysemy; Regularization; Semantics; Syntactics; Tagging; Word Sense Disambiguation; Words (language)
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2023.3269574

The ambiguity of a polysemous word, regardless of its language, is referred to as the ability to have more than one meaning. Many techniques fromWord Sense Disambiguation (WSD) have been used to clarify the ambiguity. With these techniques, the correct sense of a word according to its particular context can be determined. In English, there exist many ambiguous words. For example, the word cell may have different meanings based on its context. For instance, it may mean the basic structural unit of all organisms in biology domains , or it may mean a device that delivers an electric current as the result of a chemical reaction in textual materials about technology or electricity , or it completely means another different thing: a room where a prisoner is kept in textual materials about prison . In this study, to enhance the performance of the WSD task, we develop a methodology with Graph Convolutional Neural Networks (GCN), including normalization, thresholding, and regularization modules. We attempt to improve the traditional Text GCN algorithm with a semantic diffusion process, which increases the classification performance of the WSD task. As far as we know, there is no work for such a comprehensive classifier for the WSD task in English. To show the effect of the suggested model, we performed experiments on the SensEval dataset, which is a very popular dataset and benchmark in the WSD domain. The experiment results show that the regularization effect and diffusion process in GCN and Text GCN architectures are powerful strategies for the WSD task.