Refinement Method of Post-processing and Training for Improvement of Automated Text Classification

• Published in: Computational Science and Its Applications - ICCSA 2006 pp. 298 - 308
• Main Authors: Choi, Yun Jeong, Park, Seung Soo
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2006; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Algorithmics. Computability. Computer arithmetics; Applied sciences; Artificial intelligence; Computer science; control theory; systems; Data processing. List processing. Character string processing; Exact sciences and technology; Memory organisation. Data processing; Software; Speech and sound recognition and synthesis. Linguistics; Theoretical computing; Data analysis; Automatic classification; Statistical analysis; Probabilistic approach; Refinement method; High precision; Information retrieval; Information extraction; Text; Data mining; Modeling; Linguistics; Natural language; Fault tolerant system; Content analysis
• ISBN: 3540340726; 9783540340720; 354034070X; 9783540340706
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11751588_32

The paper presents a method for improving text classification by using examples that are difficult to classify. Generally, researches to improve the text categorization performance are focused on enhancing existing classification models and algorithms itself, but the range of which has been limited by the feature-based statistical methodology. In this paper, we propose a new method to improve the accuracy and the performance using refinement training and post-processing. Especially, we focused on complex documents that are generally considered to be hard to classify. Our proposed method has a different style from traditional classification methods, and take a data mining strategy and fault tolerant system approaches. In experiments, we applied our system to documents which usually get low classification accuracy because they are laid on a decision boundary. The result shows that our system has high accuracy and stability in actual conditions.