Progressive self-guided loss for salient object detection

We present a simple yet effective progressive self-guided loss function to facilitate deep learning-based salient object detection (SOD) in images. The saliency maps produced by the most relevant works still suffer from incomplete predictions due to the internal complexity of salient objects. Our pr...

Full description

Saved in:
Bibliographic Details
Main Authors: Yang, Sheng, Lin, Weisi, Lin, Guosheng, Jiang, Qiuping, Liu, Zichuan
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/155736
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-155736
record_format dspace
spelling sg-ntu-dr.10356-1557362022-07-21T06:54:30Z Progressive self-guided loss for salient object detection Yang, Sheng Lin, Weisi Lin, Guosheng Jiang, Qiuping Liu, Zichuan School of Computer Science and Engineering School of Electrical and Electronic Engineering Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Salient Object Detection Deep Learning We present a simple yet effective progressive self-guided loss function to facilitate deep learning-based salient object detection (SOD) in images. The saliency maps produced by the most relevant works still suffer from incomplete predictions due to the internal complexity of salient objects. Our proposed progressive self-guided loss simulates a morphological closing operation on the model predictions for progressively creating auxiliary training supervisions to step-wisely guide the training process. We demonstrate that this new loss function can guide the SOD model to highlight more complete salient objects step-by-step and meanwhile help to uncover the spatial dependencies of the salient object pixels in a region growing manner. Moreover, a new feature aggregation module is proposed to capture multi-scale features and aggregate them adaptively by a branch-wise attention mechanism. Benefiting from this module, our SOD framework takes advantage of adaptively aggregated multi-scale features to locate and detect salient objects effectively. Experimental results on several benchmark datasets show that our loss function not only advances the performance of existing SOD models without architecture modification but also helps our proposed framework to achieve state-of-the-art performance. Ministry of Education (MOE) Submitted/Accepted version This work was supported by the Singapore Ministry of Education Tier-2 Fund under Grant MOE2016-T2-2-057(S). 2022-03-21T02:51:26Z 2022-03-21T02:51:26Z 2021 Journal Article Yang, S., Lin, W., Lin, G., Jiang, Q. & Liu, Z. (2021). Progressive self-guided loss for salient object detection. IEEE Transactions On Image Processing, 30, 8426-8438. https://dx.doi.org/10.1109/TIP.2021.3113794 1057-7149 https://hdl.handle.net/10356/155736 10.1109/TIP.2021.3113794 30 8426 8438 en MOE2016-T2-2-057(S) IEEE Transactions on Image Processing © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TIP.2021.3113794. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Salient Object Detection
Deep Learning
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Salient Object Detection
Deep Learning
Yang, Sheng
Lin, Weisi
Lin, Guosheng
Jiang, Qiuping
Liu, Zichuan
Progressive self-guided loss for salient object detection
description We present a simple yet effective progressive self-guided loss function to facilitate deep learning-based salient object detection (SOD) in images. The saliency maps produced by the most relevant works still suffer from incomplete predictions due to the internal complexity of salient objects. Our proposed progressive self-guided loss simulates a morphological closing operation on the model predictions for progressively creating auxiliary training supervisions to step-wisely guide the training process. We demonstrate that this new loss function can guide the SOD model to highlight more complete salient objects step-by-step and meanwhile help to uncover the spatial dependencies of the salient object pixels in a region growing manner. Moreover, a new feature aggregation module is proposed to capture multi-scale features and aggregate them adaptively by a branch-wise attention mechanism. Benefiting from this module, our SOD framework takes advantage of adaptively aggregated multi-scale features to locate and detect salient objects effectively. Experimental results on several benchmark datasets show that our loss function not only advances the performance of existing SOD models without architecture modification but also helps our proposed framework to achieve state-of-the-art performance.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Yang, Sheng
Lin, Weisi
Lin, Guosheng
Jiang, Qiuping
Liu, Zichuan
format Article
author Yang, Sheng
Lin, Weisi
Lin, Guosheng
Jiang, Qiuping
Liu, Zichuan
author_sort Yang, Sheng
title Progressive self-guided loss for salient object detection
title_short Progressive self-guided loss for salient object detection
title_full Progressive self-guided loss for salient object detection
title_fullStr Progressive self-guided loss for salient object detection
title_full_unstemmed Progressive self-guided loss for salient object detection
title_sort progressive self-guided loss for salient object detection
publishDate 2022
url https://hdl.handle.net/10356/155736
_version_ 1739837409657356288