Language identifications of Arabic script web documents using independent component analysis

• Main Authors: Selamat, Ali, Lee, Zhi-Sam
• Format: Book Section
• Published: Institute of Electrical and Electronics Engineers 2008
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://eprints.utm.my/id/eprint/12612/; http://dx.doi.org/10.1109/AMS.2008.46
• Institution: Universiti Teknologi Malaysia

We analyze the language identification algorithms used to identify the Arabic script web documents such as Arabic, Jawi, Persian and Urdu using independent component analysis (ICA). We have used a combination of Entropy term weighting scheme and class based feature (CPBF) vectors as feature selectio...