Learning meta pattern for face anti-spoofing

Face Anti-Spoofing (FAS) is essential to secure face recognition systems and has been extensively studied in recent years. Although deep neural networks (DNNs) for the FAS task have achieved promising results in intra-dataset experiments with similar distributions of training and testing data, the D...

Full description

Saved in:
Bibliographic Details
Main Authors: Cai, Rizhao, Li, Zhi, Wan, Renjie, Li, Haoliang, Hu, Yongjian, Kot, Alex Chichung
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/162989
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-162989
record_format dspace
spelling sg-ntu-dr.10356-1629892022-11-15T00:43:57Z Learning meta pattern for face anti-spoofing Cai, Rizhao Li, Zhi Wan, Renjie Li, Haoliang Hu, Yongjian Kot, Alex Chichung School of Computer Science and Engineering School of Electrical and Electronic Engineering Rapid-Rich Object Search (ROSE) Laboratory, NTU Engineering::Computer science and engineering Engineering::Electrical and electronic engineering Face Anti-Spoofing Face Presentation Attack Detection Face Anti-Spoofing (FAS) is essential to secure face recognition systems and has been extensively studied in recent years. Although deep neural networks (DNNs) for the FAS task have achieved promising results in intra-dataset experiments with similar distributions of training and testing data, the DNNs' generalization ability is limited under the cross-domain scenarios with different distributions of training and testing data. To improve the generalization ability, recent hybrid methods have been explored to extract task-aware handcrafted features (e.g., Local Binary Pattern) as discriminative information for the input of DNNs. However, the handcrafted feature extraction relies on experts' domain knowledge, and how to choose appropriate handcrafted features is underexplored. To this end, we propose a learnable network to extract Meta Pattern (MP) in our learning-to-learn framework. By replacing handcrafted features with the MP, the discriminative information from MP is capable of learning a more generalized model. Moreover, we devise a two-stream network to hierarchically fuse the input RGB image and the extracted MP by using our proposed Hierarchical Fusion Module (HFM). We conduct comprehensive experiments and show that our MP outperforms the compared handcrafted features. Also, our proposed method with HFM and the MP can achieve state-of-the-art performance on two different domain generalization evaluation benchmarks. Nanyang Technological University This work was supported in part by the Rapid-Rich Object Search (ROSE) Laboratory, Nanyang Technological University, in part by Nanyang Technological University (NTU)– Peking University (PKU) Joint Research Institute (a collaboration between the NTU and PKU that is sponsored by a donation from the Ng Teng Fong Charitable Foundation), in part by the Science and Technology Foundation of Guangzhou Huangpu Development District under Grant 2019GH16, and in part by the China-Singapore International Joint Research Institute under Grant 206-A018001. The work of Haoliang Li was supported by the CityU New Research Initiatives/Infrastructure Support from Central under Grant APRC 9610528. 2022-11-15T00:43:57Z 2022-11-15T00:43:57Z 2022 Journal Article Cai, R., Li, Z., Wan, R., Li, H., Hu, Y. & Kot, A. C. (2022). Learning meta pattern for face anti-spoofing. IEEE Transactions On Information Forensics and Security, 17, 1201-1213. https://dx.doi.org/10.1109/TIFS.2022.3158551 1556-6013 https://hdl.handle.net/10356/162989 10.1109/TIFS.2022.3158551 2-s2.0-85126304493 17 1201 1213 en IEEE Transactions on Information Forensics and Security © 2022 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Engineering::Electrical and electronic engineering
Face Anti-Spoofing
Face Presentation Attack Detection
spellingShingle Engineering::Computer science and engineering
Engineering::Electrical and electronic engineering
Face Anti-Spoofing
Face Presentation Attack Detection
Cai, Rizhao
Li, Zhi
Wan, Renjie
Li, Haoliang
Hu, Yongjian
Kot, Alex Chichung
Learning meta pattern for face anti-spoofing
description Face Anti-Spoofing (FAS) is essential to secure face recognition systems and has been extensively studied in recent years. Although deep neural networks (DNNs) for the FAS task have achieved promising results in intra-dataset experiments with similar distributions of training and testing data, the DNNs' generalization ability is limited under the cross-domain scenarios with different distributions of training and testing data. To improve the generalization ability, recent hybrid methods have been explored to extract task-aware handcrafted features (e.g., Local Binary Pattern) as discriminative information for the input of DNNs. However, the handcrafted feature extraction relies on experts' domain knowledge, and how to choose appropriate handcrafted features is underexplored. To this end, we propose a learnable network to extract Meta Pattern (MP) in our learning-to-learn framework. By replacing handcrafted features with the MP, the discriminative information from MP is capable of learning a more generalized model. Moreover, we devise a two-stream network to hierarchically fuse the input RGB image and the extracted MP by using our proposed Hierarchical Fusion Module (HFM). We conduct comprehensive experiments and show that our MP outperforms the compared handcrafted features. Also, our proposed method with HFM and the MP can achieve state-of-the-art performance on two different domain generalization evaluation benchmarks.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Cai, Rizhao
Li, Zhi
Wan, Renjie
Li, Haoliang
Hu, Yongjian
Kot, Alex Chichung
format Article
author Cai, Rizhao
Li, Zhi
Wan, Renjie
Li, Haoliang
Hu, Yongjian
Kot, Alex Chichung
author_sort Cai, Rizhao
title Learning meta pattern for face anti-spoofing
title_short Learning meta pattern for face anti-spoofing
title_full Learning meta pattern for face anti-spoofing
title_fullStr Learning meta pattern for face anti-spoofing
title_full_unstemmed Learning meta pattern for face anti-spoofing
title_sort learning meta pattern for face anti-spoofing
publishDate 2022
url https://hdl.handle.net/10356/162989
_version_ 1751548511410716672