Self-Adaptive Semantics Masking for Text Classification

• Published in: 2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) pp. 390 - 394
• Main Authors: Zhang, Jinfan, Wu, Jiawei, Zhang, Hao
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2021
• Subjects: Adaptation models; Artificial intelligence; Automation; masking; pretrained language model; Semantics; Text categorization; text classification; Training

Text classification is a typical problem in NLP, which is to classify a given text into a certain category. In this article, we propose a classification-based training method, which is mainly based on the input text adaptive masking, and then further pre-training and fine-tuning training. This train...