Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning
Face recognition on large-scale video in the wild is becoming increasingly important due to the ubiquity of video data captured by surveillance cameras, handheld devices, Internet uploads, and other sources. By treating each video as one image set, set-based methods recently have made great success...
Saved in:
Main Authors: | , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2015
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6403 https://ink.library.smu.edu.sg/context/sis_research/article/7406/viewcontent/Face_recognition_on_large_scale_video_in_the_wild_with_hybrid_Euclidean_and_Riemannian_metric_learning.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-7406 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-74062021-11-23T02:09:34Z Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning HUANG, Zhiwu WANG, R. SHAN, S. CHEN, X Face recognition on large-scale video in the wild is becoming increasingly important due to the ubiquity of video data captured by surveillance cameras, handheld devices, Internet uploads, and other sources. By treating each video as one image set, set-based methods recently have made great success in the field of video-based face recognition. In the wild world, videos often contain extremely complex data variations and thus pose a big challenge of set modeling for set-based methods. In this paper, we propose a novel Hybrid Euclidean-and-Riemannian Metric Learning (HERML) method to fuse multiple statistics of image set. Specifically, we represent each image set simultaneously by mean, covariance matrix and Gaussian distribution, which generally complement each other in the aspect of set modeling. However, it is not trivial to fuse them since mean, covariance matrix and Gaussian model typically lie in multiple heterogeneous spaces equipped with Euclidean or Riemannian metric. Therefore, we first implicitly map the original statistics into high dimensional Hilbert spaces by exploiting Euclidean and Riemannian kernels. With a LogDet divergence based objective function, the hybrid kernels are then fused by our hybrid metric learning framework, which can efficiently perform the fusing procedure on large-scale videos. The proposed method is evaluated on four public and challenging large-scale video face datasets. Extensive experimental results demonstrate that our method has a clear superiority over the state-of-the-art set-based methods for large-scale video-based face recognition. (C) 2015 Elsevier Ltd. All rights reserved. 2015-10-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/6403 info:doi/10.1016/j.patcog.2015.03.011 https://ink.library.smu.edu.sg/context/sis_research/article/7406/viewcontent/Face_recognition_on_large_scale_video_in_the_wild_with_hybrid_Euclidean_and_Riemannian_metric_learning.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Face recognition large-scale video multiple heterogeneous statistics hybrid Euclidean-and-Riemannian metric learning Databases and Information Systems Graphics and Human Computer Interfaces |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Face recognition large-scale video multiple heterogeneous statistics hybrid Euclidean-and-Riemannian metric learning Databases and Information Systems Graphics and Human Computer Interfaces |
spellingShingle |
Face recognition large-scale video multiple heterogeneous statistics hybrid Euclidean-and-Riemannian metric learning Databases and Information Systems Graphics and Human Computer Interfaces HUANG, Zhiwu WANG, R. SHAN, S. CHEN, X Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
description |
Face recognition on large-scale video in the wild is becoming increasingly important due to the ubiquity of video data captured by surveillance cameras, handheld devices, Internet uploads, and other sources. By treating each video as one image set, set-based methods recently have made great success in the field of video-based face recognition. In the wild world, videos often contain extremely complex data variations and thus pose a big challenge of set modeling for set-based methods. In this paper, we propose a novel Hybrid Euclidean-and-Riemannian Metric Learning (HERML) method to fuse multiple statistics of image set. Specifically, we represent each image set simultaneously by mean, covariance matrix and Gaussian distribution, which generally complement each other in the aspect of set modeling. However, it is not trivial to fuse them since mean, covariance matrix and Gaussian model typically lie in multiple heterogeneous spaces equipped with Euclidean or Riemannian metric. Therefore, we first implicitly map the original statistics into high dimensional Hilbert spaces by exploiting Euclidean and Riemannian kernels. With a LogDet divergence based objective function, the hybrid kernels are then fused by our hybrid metric learning framework, which can efficiently perform the fusing procedure on large-scale videos. The proposed method is evaluated on four public and challenging large-scale video face datasets. Extensive experimental results demonstrate that our method has a clear superiority over the state-of-the-art set-based methods for large-scale video-based face recognition. (C) 2015 Elsevier Ltd. All rights reserved. |
format |
text |
author |
HUANG, Zhiwu WANG, R. SHAN, S. CHEN, X |
author_facet |
HUANG, Zhiwu WANG, R. SHAN, S. CHEN, X |
author_sort |
HUANG, Zhiwu |
title |
Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
title_short |
Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
title_full |
Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
title_fullStr |
Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
title_full_unstemmed |
Face recognition on large-scale video in the wild with hybrid Euclidean-and-Riemannian metric learning |
title_sort |
face recognition on large-scale video in the wild with hybrid euclidean-and-riemannian metric learning |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2015 |
url |
https://ink.library.smu.edu.sg/sis_research/6403 https://ink.library.smu.edu.sg/context/sis_research/article/7406/viewcontent/Face_recognition_on_large_scale_video_in_the_wild_with_hybrid_Euclidean_and_Riemannian_metric_learning.pdf |
_version_ |
1770575953669390336 |