The Effect of Preprocessing on Arabic Document Categorization

• Published in: Algorithms Vol. 9; no. 2; p. 27
• Main Authors: Ayedh, Abdullah, TAN, Guanzheng, Alwesabi, Khaled, Rajeh, Hamdi
• Format: Journal Article
• Language: English
• Published: MDPI AG 18.04.2016
• Subjects: Arabic language processing; classification techniques; document categorization; stemming techniques; text preprocessing
• ISSN: 1999-4893; 1999-4893
• DOI: 10.3390/a9020027

Preprocessing is one of the main components in a conventional document categorization (DC) framework. This paper aims to highlight the effect of preprocessing tasks on the efficiency of the Arabic DC system. In this study, three classification techniques are used, namely, naive Bayes (NB), k-nearest neighbor (KNN), and support vector machine (SVM). Experimental analysis on Arabic datasets reveals that preprocessing techniques have a significant impact on the classification accuracy, especially with complicated morphological structure of the Arabic language. Choosing appropriate combinations of preprocessing tasks provides significant improvement on the accuracy of document categorization depending on the feature size and classification techniques. Findings of this study show that the SVM technique has outperformed the KNN and NB techniques. The SVM technique achieved 96.74% micro-F1 value by using the combination of normalization and stemming as preprocessing tasks.