LSI-based semantic characterisation for automated text categorisation

• Main Author: Tan, Ping Ping
• Format: Thesis
• Language: English
• Published: Faculty of Computer Science and Information Technology 2009
• Subjects: QA76 Computer software
• Online Access: http://ir.unimas.my/id/eprint/167/8/LSI-based%20semantic%20characterization%20for%20automated%20text%20categorization%20%28fulltext%29.pdf; http://ir.unimas.my/id/eprint/167/
• Institution: Universiti Malaysia Sarawak

As knowledge acquisition remains a bottleneck, incorporating human judgement within intelligent systems is still a challenge. Supervised learning methods have shown to be able to assist humans in automated text categorization (ATC). However, the performance of such systems is largely dependent on the characteristics of the datasets. Without the understanding of why a classifier works well for certain datasets, it is difficult to generalise its application across domains. Furthermore, most training sets used in supervised ATC have category labels provided by human experts. Expert knowledge used in the task of categorization is often not captured via the mere process of manipulating category labels. This has resulted in lose of intended meanings while performing supervised ATC. Besides that, large text datasets often contain a greater deal of noise.