Seeing your Face is not Enough: An Inertial Sensor-based Liveness Detection for Face Authentication

• Main Authors: Li, Yan, Yingjiu LI, YAN, Qiang, KONG, Hancong, DENG, Robert H.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2015
• Subjects: media-based facial forgery; face authentication; liveness detection; Computer Sciences; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/2884; https://ink.library.smu.edu.sg/context/sis_research/article/3884/viewcontent/FaceLive_CCS_2015.pdf
• Institution: Singapore Management University

Leveraging built-in cameras on smartphones and tablets, face authentication provides an attractive alternative of legacy passwords due to its memory-less authentication process. However, it has an intrinsic vulnerability against the media-based facial forgery (MFF) where adversaries use photos/videos containing victims' faces to circumvent face authentication systems. In this paper, we propose FaceLive, a practical and robust liveness detection mechanism to strengthen the face authentication on mobile devices in fighting the MFF-based attacks. FaceLive detects the MFF-based attacks by measuring the consistency between device movement data from the inertial sensors and the head pose changes from the facial video captured by built-in camera. FaceLive is practical in the sense that it does not require any additional hardware but a generic front-facing camera, an accelerometer, and a gyroscope, which are pervasively available on today's mobile devices. FaceLive is robust to complex lighting conditions, which may introduce illuminations and lead to low accuracy in detecting important facial landmarks; it is also robust to a range of cumulative errors in detecting head pose changes during face authentication.