Joint face hallucination and deblurring via structure generation and detail enhancement
We address the problem of restoring a high-resolution face image from a blurry low-resolution input. This problem is difficult as super-resolution and deblurring need to be tackled simultaneously. Moreover, existing algorithms cannot handle face images well as low-resolution face images do not have...
Saved in:
Main Authors: | , , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2019
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/7867 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-8870 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-88702023-06-15T09:00:05Z Joint face hallucination and deblurring via structure generation and detail enhancement SONG, Yibing ZHANG, Jiawei GONG, Lijun HE, Shengfeng BAO, Linchao PAN, Jinshan YANG, Qingxiong YANG, Ming-Hsuan We address the problem of restoring a high-resolution face image from a blurry low-resolution input. This problem is difficult as super-resolution and deblurring need to be tackled simultaneously. Moreover, existing algorithms cannot handle face images well as low-resolution face images do not have much texture which is especially critical for deblurring. In this paper, we propose an effective algorithm by utilizing the domain-specific knowledge of human faces to recover high-quality faces. We first propose a facial component guided deep Convolutional Neural Network (CNN) to restore a coarse face image, which is denoted as the base image where the facial component is automatically generated from the input face image. However, the CNN based method cannot handle image details well. We further develop a novel exemplar-based detail enhancement algorithm via facial component matching. Extensive experiments show that the proposed method outperforms the state-of-the-art algorithms both quantitatively and qualitatively. 2019-06-01T07:00:00Z text https://ink.library.smu.edu.sg/sis_research/7867 info:doi/10.1007/s11263-019-01148-6 Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Face hallucination Face deblurring Convolutional Neural Network Information Security |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Face hallucination Face deblurring Convolutional Neural Network Information Security |
spellingShingle |
Face hallucination Face deblurring Convolutional Neural Network Information Security SONG, Yibing ZHANG, Jiawei GONG, Lijun HE, Shengfeng BAO, Linchao PAN, Jinshan YANG, Qingxiong YANG, Ming-Hsuan Joint face hallucination and deblurring via structure generation and detail enhancement |
description |
We address the problem of restoring a high-resolution face image from a blurry low-resolution input. This problem is difficult as super-resolution and deblurring need to be tackled simultaneously. Moreover, existing algorithms cannot handle face images well as low-resolution face images do not have much texture which is especially critical for deblurring. In this paper, we propose an effective algorithm by utilizing the domain-specific knowledge of human faces to recover high-quality faces. We first propose a facial component guided deep Convolutional Neural Network (CNN) to restore a coarse face image, which is denoted as the base image where the facial component is automatically generated from the input face image. However, the CNN based method cannot handle image details well. We further develop a novel exemplar-based detail enhancement algorithm via facial component matching. Extensive experiments show that the proposed method outperforms the state-of-the-art algorithms both quantitatively and qualitatively. |
format |
text |
author |
SONG, Yibing ZHANG, Jiawei GONG, Lijun HE, Shengfeng BAO, Linchao PAN, Jinshan YANG, Qingxiong YANG, Ming-Hsuan |
author_facet |
SONG, Yibing ZHANG, Jiawei GONG, Lijun HE, Shengfeng BAO, Linchao PAN, Jinshan YANG, Qingxiong YANG, Ming-Hsuan |
author_sort |
SONG, Yibing |
title |
Joint face hallucination and deblurring via structure generation and detail enhancement |
title_short |
Joint face hallucination and deblurring via structure generation and detail enhancement |
title_full |
Joint face hallucination and deblurring via structure generation and detail enhancement |
title_fullStr |
Joint face hallucination and deblurring via structure generation and detail enhancement |
title_full_unstemmed |
Joint face hallucination and deblurring via structure generation and detail enhancement |
title_sort |
joint face hallucination and deblurring via structure generation and detail enhancement |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2019 |
url |
https://ink.library.smu.edu.sg/sis_research/7867 |
_version_ |
1770576572355444736 |