Comparison of SVM, Naïve Bayes, and Logistic Regression Algorithms for Sentiment Analysis of Fraud and Bots in Purcashing Concert Ticket

• Published in: INOVTEK Polbeng - Seri Informatika Vol. 10; no. 2; pp. 591 - 602
• Main Authors: Agresia, Vania, Suryono, Ryan Randy
• Format: Journal Article
• Language: English
• Published: 16.07.2025
• ISSN: 2527-9866; 2527-9866
• DOI: 10.35314/npyfdh47

Music concerts are highly anticipated entertainment events, but they are often subject to fraud and the use of bots in online ticket purchases, to the detriment of fans and organisers. Fans may lose confidence in the ticket system and reduce interest in the event. For organizers, it can reduce the event's reputation and finances. This research aims to analyse public sentiment regarding this issue by comparing three classification algorithms: Support Vector Machine (SVM), Naïve Bayes, and Logistic Regression. Data taken from Twitter which contains comments related to fraud and bots. The methods used include data crawling, preprocessing, sentiment labelling, and model evaluation. Preprocessing includes data cleaning, case folding, tokenising, stopwords, and stemming. Sentiment labelling is done manually or by human annotators. The results showed that SVM had the best accuracy of 91.27%, followed by Logistic Regression (90.03%) and Naïve Bayes (77.70%). Applying SMOTE to overcome class imbalance and improve the performance of negative sentiment models. This research emphasizes the importance of choosing the right algorithm and using SMOTE to improve the accuracy of sentiment analysis regarding fraud and bots in concert ticket purchases. The research results can be applied to improve bot usage detection systems and provide insight for organizers.