Modulo video recovery with deep learning

• Main Author: Li,Zike
• Other Authors: Tay Wee Peng
• Format: Thesis-Master by Coursework
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science
• Online Access: https://hdl.handle.net/10356/173523
• Institution: Nanyang Technological University

Modulo images are a particular class of images captured by modulo cameras that enable the recovery of theoretically infinite dynamic range images. The basic principle of this image is to perform a modulo operation on values that exceed the maximum dynamic range of the image. Thus, within the overexposure region of a conventional image, the modulo image can still retain some of the information of the image. Traditional modulo image restoration methods based on Markov random fields have problems such as poor restoration results and high operating costs. The method based on deep learning neural networks can achieve better recovery results. Still, the technique has some redundancy in the processing of modulo video, making it challenging to recover many modulo video frames efficiently. In this dissertation, we combine deep learning and optical flow methods to propose an architecture capable of reconstructing HDR videos from modulo videos. It has been proved experimentally that the architecture has a robust unwrapping effect and running speed.