Academic News Text Classification Model Based on Attention Mechanism and RCNN

• Published in: Computer Supported Cooperative Work and Social Computing Vol. 917; pp. 507 - 516
• Main Authors: Lin, Ronghua, Fu, Chengzhou, Mao, Chengjie, Wei, Jingmin, Li, Jianguo
• Format: Book Chapter
• Language: English
• Published: Singapore Springer 2019; Springer Singapore
• Series: Communications in Computer and Information Science
• Subjects: Attention mechanism; Deep learning; Natural language processing; Text classification
• ISBN: 9789811330438; 9811330433
• ISSN: 1865-0929; 1865-0937
• DOI: 10.1007/978-981-13-3044-5_38

With the expeditious development of Internet technology and academic social media, massive academic news generated by academic social media have provided rich information for scholars to communicate and learn about the latest academic trends. How to effectively classify academic news data and obtain valuable information have become one of the important research directions of information science. Traditional classification methods have the problems of high dimensions, high sparseness and weak feature expression ability, etc. Deep neural network models such as CNN and RNN are also often affected by their own parameters. In this paper we present a deep neural network model based on attention mechanism and RCNN (ARCNN). We capture the context of each word and generate the word vectors with deep bidirectional LSTM layers after preprocessing. Then we use attention mechanism to calculate the attention probability distribution of news titles and contents, effectively highlighting key information. In our experiments, we use news data of academic social network SCHOLAT and Fudan University document classification set to evaluate our model and achieve better results than other widely used text classification algorithms.