Processing and mining large-scale bibliography data

• Main Author: Kerk, Wei Yang
• Other Authors: Ke Yiping, Kelly
• Format: Final Year Project
• Language: English
• Published: 2016
• Subjects: DRNTU::Engineering
• Online Access: http://hdl.handle.net/10356/66745
• Institution: Nanyang Technological University

Extracting information from large collections of semi-structured data can be a considerable challenge when much of the information are hidden and require understanding. There are 3 primary objective of this project. First is to parse a large XML file from Digital Bibliography & Library Project (DBLP) into a designed database system. Next, to classify each author ethnicity using an external name based classification system. Analysis on DBLP authors will be done to identify trends and pattern. Lastly, to conduct a Link Prediction experiment on collaboration between authors using well known predictors. By using ethnicity as a feature for collaboration, it is interesting to see any relationship exists between ethnicity and collaboration. This information can be added in the community for further research or future experiment. This report consists of a detailed explanation of various implementations to achieve the objectives, solutions to overcome them, results, analysis and a recommendation for future work. Finally, this report highlights that an author’s ethnicity is a relevant factor in collaboration for some ethnicity.