Image restoration via simultaneous nonlocal self-similarity priors

Through exploiting the image nonlocal self-similarity (NSS) prior by clustering similar patches to construct patch groups, recent studies have revealed that structural sparse representation (SSR) models can achieve promising performance in various image restoration tasks. However, most existing SSR...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلفون الرئيسيون: Zha, Zhiyuan, Yuan, Xin, Zhou, Jiantao, Zhu, Ce, Wen, Bihan
مؤلفون آخرون: School of Electrical and Electronic Engineering
التنسيق: مقال
اللغة:English
منشور في: 2022
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/10356/161035
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
المؤسسة: Nanyang Technological University
اللغة: English
id sg-ntu-dr.10356-161035
record_format dspace
spelling sg-ntu-dr.10356-1610352022-08-12T04:59:15Z Image restoration via simultaneous nonlocal self-similarity priors Zha, Zhiyuan Yuan, Xin Zhou, Jiantao Zhu, Ce Wen, Bihan School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Image Restoration Structural Sparse Representation Through exploiting the image nonlocal self-similarity (NSS) prior by clustering similar patches to construct patch groups, recent studies have revealed that structural sparse representation (SSR) models can achieve promising performance in various image restoration tasks. However, most existing SSR methods only exploit the NSS prior from the input degraded (internal) image, and few methods utilize the NSS prior from external clean image corpus; how to jointly exploit the NSS priors of internal image and external clean image corpus is still an open problem. In this article, we propose a novel approach for image restoration by simultaneously considering internal and external nonlocal self-similarity (SNSS) priors that offer mutually complementary information. Specifically, we first group nonlocal similar patches from images of a training corpus. Then a group-based Gaussian mixture model (GMM) learning algorithm is applied to learn an external NSS prior. We exploit the SSR model by integrating the NSS priors of both internal and external image data. An alternating minimization with an adaptive parameter adjusting strategy is developed to solve the proposed SNSS-based image restoration problems, which makes the entire algorithm more stable and practical. Experimental results on three image restoration applications, namely image denoising, deblocking and deblurring, demonstrate that the proposed SNSS produces superior results compared to many popular or state-of-the-art methods in both objective and perceptual quality measurements. Ministry of Education (MOE) Nanyang Technological University This work was supported in part by the Ministry of Education, Republic of Singapore, under Start-Up Grant; in part by the Joint Funds of National Natural Science Foundation of China under Grant U19A2052; in part by the Key Project of Sichuan Provincial Department of Science and Technology, under the Start-Up Grant, under Grant 2018JY0035; in part by the Macau Science and Technology Development Fund, Macau, under Grant SKL-IOTSC-2018-2020, Grant 077/2018/A2, and Grant 0060/2019/A1; and in part by the Rapid-Rich Object Search (ROSE) Lab, Nanyang Technological University. 2022-08-12T04:59:15Z 2022-08-12T04:59:15Z 2020 Journal Article Zha, Z., Yuan, X., Zhou, J., Zhu, C. & Wen, B. (2020). Image restoration via simultaneous nonlocal self-similarity priors. IEEE Transactions On Image Processing, 29, 8561-8576. https://dx.doi.org/10.1109/TIP.2020.3015545 1057-7149 https://hdl.handle.net/10356/161035 10.1109/TIP.2020.3015545 2-s2.0-85090841169 29 8561 8576 en IEEE Transactions on Image Processing © 2020 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
Image Restoration
Structural Sparse Representation
spellingShingle Engineering::Electrical and electronic engineering
Image Restoration
Structural Sparse Representation
Zha, Zhiyuan
Yuan, Xin
Zhou, Jiantao
Zhu, Ce
Wen, Bihan
Image restoration via simultaneous nonlocal self-similarity priors
description Through exploiting the image nonlocal self-similarity (NSS) prior by clustering similar patches to construct patch groups, recent studies have revealed that structural sparse representation (SSR) models can achieve promising performance in various image restoration tasks. However, most existing SSR methods only exploit the NSS prior from the input degraded (internal) image, and few methods utilize the NSS prior from external clean image corpus; how to jointly exploit the NSS priors of internal image and external clean image corpus is still an open problem. In this article, we propose a novel approach for image restoration by simultaneously considering internal and external nonlocal self-similarity (SNSS) priors that offer mutually complementary information. Specifically, we first group nonlocal similar patches from images of a training corpus. Then a group-based Gaussian mixture model (GMM) learning algorithm is applied to learn an external NSS prior. We exploit the SSR model by integrating the NSS priors of both internal and external image data. An alternating minimization with an adaptive parameter adjusting strategy is developed to solve the proposed SNSS-based image restoration problems, which makes the entire algorithm more stable and practical. Experimental results on three image restoration applications, namely image denoising, deblocking and deblurring, demonstrate that the proposed SNSS produces superior results compared to many popular or state-of-the-art methods in both objective and perceptual quality measurements.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Zha, Zhiyuan
Yuan, Xin
Zhou, Jiantao
Zhu, Ce
Wen, Bihan
format Article
author Zha, Zhiyuan
Yuan, Xin
Zhou, Jiantao
Zhu, Ce
Wen, Bihan
author_sort Zha, Zhiyuan
title Image restoration via simultaneous nonlocal self-similarity priors
title_short Image restoration via simultaneous nonlocal self-similarity priors
title_full Image restoration via simultaneous nonlocal self-similarity priors
title_fullStr Image restoration via simultaneous nonlocal self-similarity priors
title_full_unstemmed Image restoration via simultaneous nonlocal self-similarity priors
title_sort image restoration via simultaneous nonlocal self-similarity priors
publishDate 2022
url https://hdl.handle.net/10356/161035
_version_ 1743119618854092800