Benchmarking still-to-video face recognition via partial and local linear discriminant analysis on COX-S2V dataset

• Main Authors: HUANG, Zhiwu, SHAN, S., ZHANG, H., LAO, S., KUERBAN, A., CHEN, X.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2012
• Subjects: Face Recognition; Video Sequence; Linear Discriminant Analysis; Face Image; Video Frame; Artificial Intelligence and Robotics; OS and Networks
• Online Access: https://ink.library.smu.edu.sg/sis_research/6543; https://ink.library.smu.edu.sg/context/sis_research/article/7546/viewcontent/Benchmarking_still_to_video_face_recognition.pdf
• Institution: Singapore Management University

In this paper, we explore the real-world Still-to-Video (S2V) face recognition scenario, where only very few (single, in many cases) still images per person are enrolled into the gallery while it is usually possible to capture one or multiple video clips as probe. Typical application of S2V is mug-shot based watch list screening. Generally, in this scenario, the still image(s) were collected under controlled environment, thus of high quality and resolution, in frontal view, with normal lighting and neutral expression. On the contrary, the testing video frames are of low resolution and low quality, possibly with blur, and captured under poor lighting, in non-frontal view. We reveal that the S2V face recognition has been heavily overlooked in the past. Therefore, we provide a benchmarking in terms of both a large scale dataset and a new solution to the problem. Specifically, we collect (and release) a new dataset named COX-S2V, which contains 1,000 subjects, with each subject a high quality photo and four video clips captured simulating video surveillance scenario. Together with the database, a clear evaluation protocol is designed for benchmarking. In addition, in addressing this problem, we further propose a novel method named Partial and Local Linear Discriminant Analysis (PaLo-LDA). We then evaluated the method on COX-S2V and compared with several classic methods including LDA, LPP, ScSR. Evaluation results not only show the grand challenges of the COX-S2V, but also validate the effectiveness of the proposed PaLo-LDA method over the competitive methods.