Natural document clustering by clique percolation in random graphs

• Main Authors: GAO, Wei, WONG, Kam-Fai
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2006
• Subjects: Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/4603; https://ink.library.smu.edu.sg/context/sis_research/article/5606/viewcontent/Gao_Wong2006_Chapter_NaturalDocumentClusteringByCli.pdf
• Institution: Singapore Management University

Document clustering techniques mostly depend on models that impose explicit and/or implicit priori assumptions as to the number, size, disjunction characteristics of clusters, and/or the probability distribution of clustered data. As a result, the clustering effects tend to be unnatural and stray away more or less from the intrinsic grouping nature among the documents in a corpus. We propose a novel graph-theoretic technique called Clique Percolation Clustering (CPC). It models clustering as a process of enumerating adjacent maximal cliques in a random graph that unveils inherent structure of the underlying data, in which we unleash the commonly practiced constraints in order to discover natural overlapping clusters. Experiments show that CPC can outperform some typical algorithms on benchmark data sets, and shed light on natural document clustering.