Towards distributed node similarity search on graphs

• Main Authors: ZHANG, Tianming, GAO, Yunjun, ZHENG, Baihua, CHEN, Lu, WEN, Shiting, GUO, Wei
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: Graph; Node similarity search; Distributed processing; Algorithm; Computer Engineering; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/5147; https://ink.library.smu.edu.sg/context/sis_research/article/6150/viewcontent/Zhang2020_Article_TowardsDistributedNodeSimilari__1_.pdf
• Institution: Singapore Management University

Node similarity search on graphs has wide applications in recommendation, link prediction, to name just a few. However, existing studies are insufficient due to two reasons: (i) the scale of the real-world graph is growing rapidly, and (ii) vertices are always associated with complex attributes. In this paper, we propose an efficiently distributed framework to support node similarity search on massive graphs, which considers both graph structure correlation and node attribute similarity in metric spaces. The framework consists of preprocessing stage and query stage. In the preprocessing stage, a parallel KD-tree construction (KDC) algorithm is developed to form a newly defined graph so-called hybrid graph, in order to integrate node attribute similarity into the original graph. To equally divide graph vertices into subsets, KDC adopts the KD-tree partitioning after the pivot mapping. In addition, two metric pruning rules and an optimized allocation strategy are presented to reduce communication and computation costs. In the query stage, based on the formed hybrid graph, we develop similarity search methods using random walk with restart (RWR) to measure node similarity. To boost efficiency, we derive tight bounds to rapidly shrink the search region. Extensive experiments with three real massive graphs are conducted to verify the effectiveness, efficiency, and scalability of our proposed techniques.