LSI-based semantic characterisation for automated text categorisation

As knowledge acquisition remains a bottleneck, incorporating human judgement within intelligent systems is still a challenge. Supervised learning methods have shown to be able to assist humans in automated text categorization (ATC). However, the performance of such systems is largely dependent on th...

Full description

Saved in:
Bibliographic Details
Main Author: Tan, Ping Ping
Format: Thesis
Language:English
Published: Faculty of Computer Science and Information Technology 2009
Subjects:
Online Access:http://ir.unimas.my/id/eprint/167/8/LSI-based%20semantic%20characterization%20for%20automated%20text%20categorization%20%28fulltext%29.pdf
http://ir.unimas.my/id/eprint/167/
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Malaysia Sarawak
Language: English
Description
Summary:As knowledge acquisition remains a bottleneck, incorporating human judgement within intelligent systems is still a challenge. Supervised learning methods have shown to be able to assist humans in automated text categorization (ATC). However, the performance of such systems is largely dependent on the characteristics of the datasets. Without the understanding of why a classifier works well for certain datasets, it is difficult to generalise its application across domains. Furthermore, most training sets used in supervised ATC have category labels provided by human experts. Expert knowledge used in the task of categorization is often not captured via the mere process of manipulating category labels. This has resulted in lose of intended meanings while performing supervised ATC. Besides that, large text datasets often contain a greater deal of noise.