Vision enhancement using artificial intelligence techniques

• Main Author: Yu, Xiaohan
• Other Authors: Chau Lap Pui
• Format: Theses and Dissertations
• Language: English
• Published: 2019
• Subjects: Engineering::Electrical and electronic engineering
• Online Access: http://hdl.handle.net/10356/78838
• Institution: Nanyang Technological University

This dissertation uses the concept of artificial intelligence and deep learning, with a focus on removing rainwater from heavy rain videos based on a former research published on CVPR in 2018 carried out by my supervisor. Clear vision is important for vision based system. To provide clear vision, it is important to ensure there is no rain occlusion in rainy weather. Proposed papers show limitations dealing with both fast moving cameras and pretty heavy rain. In the former paper, their main idea was to create a method to achieve perfect frame alignment. So they proposed an algorithm using super pixel segmentation to increase the robust of towards rain occlusion and fast camera motion. This dissertation is to improve the rain mask generated by the Optimal Temporal Match Tensor T0 through the former method. It made good use of both former generated rain mask and T0 using 3D convolution along with 2D convolution to form a more accurate rain mask, which will be used to get the better performance of final derain sequences together with Sorted Spatial-Temporal Match Tensor T1 in the future work. Instead of using simple decision rule to decide the location of the raindrops, this dissertation came up with a method making use of the time coherence between adjacent frames of each sequence.