Use of word and character N-grams for low-resourced local languages

• Main Authors: Regalado, Ralph Vincent, Agarap, Abien Fred, Baliber, Renz Iver, Yambao, Arian, Cheng, Charibeth
• Format: text
• Published: Animo Repository 2019
• Subjects: Natural language processing (Computer science); Machine learning; Computer Sciences
• Online Access: https://animorepository.dlsu.edu.ph/faculty_research/3924
• Institution: De La Salle University

Language identification is a text classification task for identifying the language of a given text. Several works use this as a preprocessing technique prior to sentiment analysis, mood analysis, and named entity recognition among others. Thus, building an accurate language identification engine is...