From Tweets to Insights: BERT-Enhanced Models for Cyberbullying Detection

• Published in: 2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS) pp. 1289 - 1293
• Main Authors: Sen, Madhura, Masih, Jolly, Rajasekaran, Rajkumar
• Format: Conference Proceeding
• Language: English
• Published: IEEE 28.01.2024
• Subjects: Bidirectional control; Blogs; COVID-19; Cyberbullying; Deep Learning; Natural Language Processing; Sentiment analysis; Support vector machines; Transformers
• DOI: 10.1109/ICETSIS61505.2024.10459672

The rapid rise of social media usage, particularly during the COVID-19 pandemic, has amplified the prevalence of cyberbullying, necessitating effective detection and prevention measures. This research explores the application of sentiment analysis (SA) and deep learning models, specifically utilizing Bidirectional Encoder Representations from Transformers (BERT) in combination with Convolutional Neural Network (CNN) and Multi-Layer Perceptron (MLP), to automatically detect cyberbullying in Twitter posts. The study utilizes a Hate Speech and Offensive Language dataset, employing data preprocessing techniques and exploratory data analysis to address imbalances and understand the dataset's intricacies. The proposed architecture demonstrates superior performance, achieving an accuracy range of 87.2% to 92.3%, outperforming existing methods such as Naive Bayes, Support Vector Machine (SVM), Deep Neural Network (DNN), and CNN. The research contributes to the ongoing efforts to develop robust cyberbullying detection systems, emphasizing the need for proactive measures in the face of escalating online harassment incidents, especially in the COVID-19 era.