A study of dimensionality reduction as subspace data embedding linked by multidimensional scaling

• Main Author: Wang, Wan Qiu
• Other Authors: Chan Kap Luk
• Format: Theses and Dissertations
• Language: English
• Published: 2011
• Subjects: DRNTU::Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/42687
• Institution: Nanyang Technological University

Some state-of-the-art dimensionality reduction techniques are reviewed and investigated in this thesis. Dimensionality reduction techniques can be categorized inti two serving different purposes. The first category is to mitigate the computational load and to address the Curse-of-Dimensionality, and the second category is to model the data spread or manifold. ISOMAP and LLE techniques are developed for the second purpose, and both of them are embedding techniques. By means of embedding, some data points in a higher dimensional space can be mapped into a lower dimensional space, provided that the pairwise distances are kept unchanged or within a small tolerant range. Some conven- tional category one techniques, such as Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA), are developed from variance analysis, but they also can be interpreted as embedding techniques through links to the metric Multidimensional Scaling (MDS).