Modulo video recovery with deep learning

Modulo images are a particular class of images captured by modulo cameras that enable the recovery of theoretically infinite dynamic range images. The basic principle of this image is to perform a modulo operation on values that exceed the maximum dynamic range of the image. Thus, within the overexp...

Full description

Saved in:
Bibliographic Details
Main Author: Li,Zike
Other Authors: Tay Wee Peng
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/173523
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Modulo images are a particular class of images captured by modulo cameras that enable the recovery of theoretically infinite dynamic range images. The basic principle of this image is to perform a modulo operation on values that exceed the maximum dynamic range of the image. Thus, within the overexposure region of a conventional image, the modulo image can still retain some of the information of the image. Traditional modulo image restoration methods based on Markov random fields have problems such as poor restoration results and high operating costs. The method based on deep learning neural networks can achieve better recovery results. Still, the technique has some redundancy in the processing of modulo video, making it challenging to recover many modulo video frames efficiently. In this dissertation, we combine deep learning and optical flow methods to propose an architecture capable of reconstructing HDR videos from modulo videos. It has been proved experimentally that the architecture has a robust unwrapping effect and running speed.