On learning psycholinguistics tools for English-based Creole languages using social media data

• Main Authors: LO, Pei-Chi, LIM, Ee-peng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2018
• Subjects: Personality prediction; Language-specific psycholinguistics tool; Databases and Information Systems; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/5107; https://ink.library.smu.edu.sg/context/sis_research/article/6110/viewcontent/Creole_Language_2018_av.pdf
• Institution: Singapore Management University

The Linguistic Inquiry and Word Count (LIWC) tool is a psycholinguistics tool that has been widely used in both psychology and sociology research, and the LIWC scores derived from user-generated content are known to be good features for personality prediction [1], [2]. LIWC, however, is language specific as it relies on counting the percentage of predefined dictionary words occurring in the content. For content written in English Creoles which are languages based on English, the original English LIWC may not perform optimally due to its lack of words which are only used in the English Creoles. In this paper, we therefore study the learning of LIWC for an English Creole using word embeddings, a way to encode contextual meaning of words in a vector representation. We particularly focus on an English Creole known as Singlish (which is a popular English creole in Singapore and it contains words from non-English languages including Malay, Chinese, Chinese dialects, and Indian languages). Instead of a manual effort to construct LIWC for Singlish, we automate the construction of a Singlish-specific LIWC dictionary, called S-LIWC by learning a word embedding model using a large corpus of Singapore tweets, and extracting new words semantically similar to the LIWC dictionary words. We show that the S-LIWC can be used to predict LIWC summary variables. Moreover, we conduct a personality prediction experiment on Singapore university students using their Facebook status updates. Our results show that our personality prediction method using S-LIWC outperforms that using LIWC for most personality traits. We finally show some interesting case examples of explaining the weaknesses and strength of S-LIWC.