Real Time Event Detection in Twitter

• Main Authors: WANG, Xun, ZHU, Feida, JIANG, Jing, LI, Sujian
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2013
• Subjects: HDP; Gaussian mixture; Twitter; event detection; Databases and Information Systems; Numerical Analysis and Scientific Computing; Social Media
• Online Access: https://ink.library.smu.edu.sg/sis_research/1820; https://ink.library.smu.edu.sg/context/sis_research/article/2819/viewcontent/C51___Real_Time_Event_Detection_in_Twitter__WAIM2013_.pdf
• Institution: Singapore Management University

Event detection has been an important task for a long time. When it comes to Twitter, new problems are presented. Twitter data is a huge temporal data flow with much noise and various kinds of topics. Traditional sophisticated methods with a high computational complexity aren’t designed to handle such data flow efficiently. In this paper, we propose a mixture Gaussian model for bursty word extraction in Twitter and then employ a novel time-dependent HDP model for new topic detection. Our model can grasp new events, the location and the time an event becomes bursty promptly and accurately. Experiments show the effectiveness of our model in real time event detection in Twitter.