2D and 3D video scene text classification

• Main Authors: Xu, J., Shivakumara, P., Lu, T., Tan, C.L.
• Format: Conference or Workshop Item
• Language: English
• Published: 2014
• Subjects: T Technology (General)
• Online Access: http://eprints.um.edu.my/13101/1/2d_and_3d_video_scene_text.pdf; http://eprints.um.edu.my/13101/
• Institution: Universiti Malaya

Text detection and recognition is a challenging problem in document analysis due 10 the presence of the unpredictable nature of video texts, such as the variations of orientation, font and size, illumination effects, and even different 20/30 text shadows. In this paper, we propose a novel horizontal and vertical symmetry feature by calculating the gradient direction and the gradient magnitude of each text candidate, which results in Potential Text Candidates (PTCs) after applying the k-means clustering algorithm on the gradient image of each input frame to verify PTC , we explore temporal information of video by proposing an iterative process that continuously verifies the PTCs of the first frame and the successive frames, until the process meets the converging criterion. This outputs Stable Potential Text Candidates (SPTCs). For each , PTC, the method obtains text representatives with the help of the edge image of the input frame. Then for each text representative, we divide it into four quadrants and check a new Mutual Nearest Neighbor Symmetry (MNNS) based on the dominant stroke width distances of the four quadrants. A voting method is finally proposed to clasify each text block as either 2D or 3D by counting the text representatives that satisfy MNNS. Experimental results on clasifying 2D and 3D text images are promising, and the result re further validated by text detection and recognition before clasification and after clasification with the exiting methods, respectively.