Development of multilingual social media data corpus: Development and evaluation

• Main Authors: Rumaisa, Fitrah, Saaya, Zurina, Khamis, Noorli, Basiron, Halizah
• Format: Article
• Language: English
• Published: Primrose Hall Publishing Group 2019
• Online Access: http://eprints.utem.edu.my/id/eprint/24401/2/6501_RUMAISA_2019_E_R%20%281%29.PDF; http://eprints.utem.edu.my/id/eprint/24401/; https://www.ijicc.net/images/Vol6Iss5/6501_Rumaisa_2019_E_R.pdf
• Institution: Universiti Teknikal Malaysia Melaka

The purpose of this study is manual annotating, a corpus for Bahasa Indonesia and Bahasa Melayu. Corpus for both languages has been made by many researchers before, but the focus of this research is only on words with the same vocabulary but which have very different meanings. The data were obtained from social media, so informal words were found. As many as 2100 words for each language were identified which were then randomly selected so that 300 words with the same vocabulary but with different meanings were used. The objective of this study was to confirm that this condition can influence the results of polarity sentiment. At the end of this paper, we will show the results of the influence of the conditions of the two languages on the polarity of sentiments. From the manual annotation, an annotation agreement test was made by three Bahasa Indonesia annotators and three Bahasa Melayu annotators. The results of the annotation found that there were 63 out of 300 words that experience different polarity. Results of score agreement among annotations for each language show that there is good agreement among the annotators during annotation process