Distributed similarity queries in metric spaces

• Main Authors: YANG, Keyu, DING, Xin, ZHANG, Yuanliang, CHEN, Lu, ZHENG, Baihua, GAO, Yunjun
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Similarity query; Metric space; Range query; Algorithm; kNN query; Distributed processing; Databases and Information Systems; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/4438; https://ink.library.smu.edu.sg/context/sis_research/article/5441/viewcontent/Yang2019_Article_DistributedSimilarityQueriesIn.pdf
• Institution: Singapore Management University

Similarity queries, including range queries and k nearest neighbor (kNN) queries, in metric spaces have applications in many areas such as multimedia retrieval, computational biology and location-based services. With the growing volumes of data, a distributed method is required. In this paper, we propose an Asynchronous Metric Distributed System (AMDS), to support efficient metric similarity queries in the distributed environment. AMDS uniformly partitions the data with the pivot-mapping technique to ensure the load balancing, and employs publish/subscribe communication model to asynchronous process large scale of queries. The employment of asynchronous processing model also improves robustness and efficiency of AMDS. In addition, we develop efficient similarity search algorithms using AMDS. Extensive experiments using real and synthetic data demonstrate the performance of metric similarity queries using AMDS. Moreover, the AMDS scales sublinearly with the growing data size.