Real Time Event Detection in Twitter

Event detection has been an important task for a long time. When it comes to Twitter, new problems are presented. Twitter data is a huge temporal data flow with much noise and various kinds of topics. Traditional sophisticated methods with a high computational complexity aren’t designed to handle su...

Full description

Saved in:
Bibliographic Details
Main Authors: WANG, Xun, ZHU, Feida, JIANG, Jing, LI, Sujian
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2013
Subjects:
HDP
Online Access:https://ink.library.smu.edu.sg/sis_research/1820
https://ink.library.smu.edu.sg/context/sis_research/article/2819/viewcontent/C51___Real_Time_Event_Detection_in_Twitter__WAIM2013_.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
Description
Summary:Event detection has been an important task for a long time. When it comes to Twitter, new problems are presented. Twitter data is a huge temporal data flow with much noise and various kinds of topics. Traditional sophisticated methods with a high computational complexity aren’t designed to handle such data flow efficiently. In this paper, we propose a mixture Gaussian model for bursty word extraction in Twitter and then employ a novel time-dependent HDP model for new topic detection. Our model can grasp new events, the location and the time an event becomes bursty promptly and accurately. Experiments show the effectiveness of our model in real time event detection in Twitter.