Towards robust curve text detection with conditional spatial expansion

It is challenging to detect curve texts due to their irregular shapes and varying sizes. In this paper, we first investigate the deficiency of the existing curve detection methods and then propose a novel Conditional Spatial Expansion (CSE) mechanism to improve the performance of curve text detectio...

Full description

Saved in:
Bibliographic Details
Main Authors: Liu, Zichuan, Lin, Guosheng, Yang, Sheng, Liu, Fayao, Lin, Weisi, Goh, Wang Ling
Other Authors: School of Computer Science and Engineering
Format: Conference or Workshop Item
Language:English
Published: 2020
Subjects:
Online Access:https://hdl.handle.net/10356/144281
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-144281
record_format dspace
spelling sg-ntu-dr.10356-1442812020-10-26T09:13:45Z Towards robust curve text detection with conditional spatial expansion Liu, Zichuan Lin, Guosheng Yang, Sheng Liu, Fayao Lin, Weisi Goh, Wang Ling School of Computer Science and Engineering IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019 Engineering::Computer science and engineering Recognition Detection It is challenging to detect curve texts due to their irregular shapes and varying sizes. In this paper, we first investigate the deficiency of the existing curve detection methods and then propose a novel Conditional Spatial Expansion (CSE) mechanism to improve the performance of curve text detection. Instead of regarding the curve text detection as a polygon regression or a segmentation problem, we treat it as a region expansion process. Our CSE starts with a seed arbitrarily initialized within a text region and progressively merges neighborhood regions based on the extracted local features by a CNN and contextual information of merged regions. The CSE is highly parameterized and can be seamlessly integrated into existing object detection frameworks. Enhanced by the data-dependent CSE mechanism, our curve text detection system provides robust instance-level text region extraction with minimal post-processing. The analysis experiment shows that our CSE can handle texts with various shapes, sizes, and orientations, and can effectively suppress the false-positives coming from text-like textures or unexpected texts included in the same RoI. Compared with the existing curve text detection algorithms, our method is more robust and enjoys a simpler processing flow. It also creates a new state-of-art performance on curve text benchmarks with Fscore of up to 78.4%. AI Singapore Ministry of Education (MOE) National Research Foundation (NRF) Accepted version G. Lin’s participation was partly supported by the National Research Foundation Singapore under its AI Singapore Programme [AISG-RP-2018-003] and a MOE Tier-1 research grant [RG126/17 (S)]. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Singapore. 2020-10-26T09:11:07Z 2020-10-26T09:11:07Z 2019 Conference Paper Liu, Z., Lin, G., Yang, S., Liu, F., Lin, W., & Goh, W. L. (2019). Towards robust curve text detection with conditional spatial expansion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/CVPR.2019.00744 https://hdl.handle.net/10356/144281 10.1109/CVPR.2019.00744 en AISG-RP-2018-003 [RG126/17 (S) © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/CVPR.2019.00744 application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Recognition
Detection
spellingShingle Engineering::Computer science and engineering
Recognition
Detection
Liu, Zichuan
Lin, Guosheng
Yang, Sheng
Liu, Fayao
Lin, Weisi
Goh, Wang Ling
Towards robust curve text detection with conditional spatial expansion
description It is challenging to detect curve texts due to their irregular shapes and varying sizes. In this paper, we first investigate the deficiency of the existing curve detection methods and then propose a novel Conditional Spatial Expansion (CSE) mechanism to improve the performance of curve text detection. Instead of regarding the curve text detection as a polygon regression or a segmentation problem, we treat it as a region expansion process. Our CSE starts with a seed arbitrarily initialized within a text region and progressively merges neighborhood regions based on the extracted local features by a CNN and contextual information of merged regions. The CSE is highly parameterized and can be seamlessly integrated into existing object detection frameworks. Enhanced by the data-dependent CSE mechanism, our curve text detection system provides robust instance-level text region extraction with minimal post-processing. The analysis experiment shows that our CSE can handle texts with various shapes, sizes, and orientations, and can effectively suppress the false-positives coming from text-like textures or unexpected texts included in the same RoI. Compared with the existing curve text detection algorithms, our method is more robust and enjoys a simpler processing flow. It also creates a new state-of-art performance on curve text benchmarks with Fscore of up to 78.4%.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Liu, Zichuan
Lin, Guosheng
Yang, Sheng
Liu, Fayao
Lin, Weisi
Goh, Wang Ling
format Conference or Workshop Item
author Liu, Zichuan
Lin, Guosheng
Yang, Sheng
Liu, Fayao
Lin, Weisi
Goh, Wang Ling
author_sort Liu, Zichuan
title Towards robust curve text detection with conditional spatial expansion
title_short Towards robust curve text detection with conditional spatial expansion
title_full Towards robust curve text detection with conditional spatial expansion
title_fullStr Towards robust curve text detection with conditional spatial expansion
title_full_unstemmed Towards robust curve text detection with conditional spatial expansion
title_sort towards robust curve text detection with conditional spatial expansion
publishDate 2020
url https://hdl.handle.net/10356/144281
_version_ 1683493111893852160