Infrastructure for microblog analysis

• Main Author: Wong, Wai Jie.
• Other Authors: Chang Kuiyu
• Format: Final Year Project
• Language: English
• Published: 2013
• Subjects: DRNTU::Engineering::Computer science and engineering::Computer applications
• Online Access: http://hdl.handle.net/10356/52251
• Institution: Nanyang Technological University

This FYP report shows the process of designing a new Facebook crawler for the social monitoring Rosebud system and overall improvements made to current Rosebud system. The improvements made to the Rosebud system are addition of banned keywords functionality to the existing Rosebud system and improved sampling strategy of data from social media networks which is applicable to the existing Rosebud Twitter crawler and the newly built Facebook crawler. This report details the infrastructure of the Facebook crawler is built on, consuming it from an external API and processing the data for social analysis. This includes analysis of the API used, implementation message-passing of the data for processing and details of the storage solution.