Discovering novel memory cell designs for sentiment analysis on tweets

• Published in: Genetic programming and evolvable machines Vol. 22; no. 2; pp. 147 - 187
• Main Authors: Nistor, Sergiu Cosmin, Moca, Mircea, Nistor, Răzvan Liviu
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2021; Springer Nature B.V
• Subjects: Artificial Intelligence; Biomedical Engineering and Bioengineering; Compilers; Computer Science; Data mining; Design; Electrical Engineering; Evolutionary algorithms; Interpreters; Neural networks; Programming Languages; Programming Techniques; Recurrent neural networks; Sentiment analysis; Software Engineering/Programming and Operating Systems; Deep learning; Sentiment analysis; Memory cell; Recurrent neural network; Evolutionary algorithm; Tweet
• ISSN: 1389-2576; 1573-7632
• DOI: 10.1007/s10710-020-09395-0

Designing a Recurrent Neural Network to extract sentiment from tweets is a very hard task. When using memory cells in their design, the task becomes even harder due to the large number of design alternatives and the costly process of finding a performant design. In this paper we propose an original evolutionary algorithm to address the hard challenge of discovering novel Recurrent Neural Network memory cell designs for sentiment analysis on tweets. We used three different tasks to discover and evaluate the designs. We conducted experiments and the results show that the best obtained designs surpass the baselines—which are the most popular cells, LSTM and GRU. During the discovery process we evaluated roughly 17,000 cell designs. The selected winning candidate outperformed the others for the overall sentiment analysis problem, hence showing generality. We made the winner selection by using the cumulated accuracies on all three considered tasks.