Hybrid euclidean-and-riemannian metric learning for image set classification

• Main Authors: HUANG, Zhiwu, WANG, R., SHAN, S., CHEN, X.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2014
• Subjects: Gaussian Mixture Model; Reproduce Kernel Hilbert Space; Symmetric Positive Definite Matrice; Symmetric Positive Definite; Heterogeneous Space; Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/6395; https://ink.library.smu.edu.sg/context/sis_research/article/7398/viewcontent/Hybrid_Euclidean_and_Riemannian_Metric.pdf
• Institution: Singapore Management University

We propose a novel hybrid metric learning approach to combine multiple heterogenous statistics for robust image set classification. Specifically, we represent each set with multiple statistics – mean, covariance matrix and Gaussian distribution, which generally complement each other for set modeling. However, it is not trivial to fuse them since the mean vector with dd-dimension often lies in Euclidean space RdRd, whereas the covariance matrix typically resides on Riemannian manifold Sym+dSymd+. Besides, according to information geometry, the space of Gaussian distribution can be embedded into another Riemannian manifold Sym+d+1Symd+1+. To fuse these statistics from heterogeneous spaces, we propose a Hybrid Euclidean-and-Riemannian Metric Learning (HERML) method to exploit both Euclidean and Riemannian metrics for embedding their original spaces into high dimensional Hilbert spaces and then jointly learn hybrid metrics with discriminant constraint. The proposed method is evaluated on two tasks: set-based object categorization and video-based face recognition. Extensive experimental results demonstrate that our method has a clear superiority over the state-of-the-art methods.