Comparing Twitter and Traditional Media using Topic Models

• Main Authors: ZHAO, Wayne Xin, JIANG, Jing, WENG, Jianshu, HE, Jing, LIM, Ee Peng, YAN, Hongfei, LI, Xiaoming
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2011
• Subjects: Twitter; microblogging; topic modeling; Databases and Information Systems; Numerical Analysis and Scientific Computing; Social Media
• Online Access: https://ink.library.smu.edu.sg/sis_research/1375; https://ink.library.smu.edu.sg/context/sis_research/article/2374/viewcontent/Jing2011ComparingTwitterTopic_Models.pdf
• Institution: Singapore Management University

Twitter as a new form of social media can potentially contain much useful information, but content analysis on Twitter has not been well studied. In particular, it is not clear whether as an information source Twitter can be simply regarded as a faster news feed that covers mostly the same information as traditional news media. In This paper we empirically compare the content of Twitter with a traditional news medium, New York Times, using unsupervised topic modeling. We use a Twitter-LDA model to discover topics from a representative sample of the entire Twitter. We then use text mining techniques to compare these Twitter topics with topics from New York Times, taking into consideration topic categories and types. We also study the relation between the proportions of opinionated tweets and retweets and topic categories and types. Our comparisons show interesting and useful findings for downstream IR or DM applications.