Deep binocular tone mapping

• Main Authors: ZHANG, Zhuming, HAN, Chu, HE, Shengfeng, LIU, Xueting, ZHU, Haichao, HU, Xinghong, WONG, Tien-Tsin
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Tone mapping; Binocular tone mapping; Binocular perception; Convolutional neural network; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/7850
• Institution: Singapore Management University

Binocular tone mapping is studied in the previous works to generate a fusible pair of LDR images in order to convey more visual content than one single LDR image. However, the existing methods are all based on monocular tone mapping operators. It greatly restricts the preservation of local details and global contrast in a binocular LDR pair. In this paper, we proposed the first binocular tone mapping operator to more effectively distribute visual content to an LDR pair, leveraging the great representability and interpretability of deep convolutional neural network. Based on the existing binocular perception models, novel loss functions are also proposed to optimize the output pairs in terms of local details, global contrast, content distribution, and binocular fusibility. Our method is validated with a qualitative and quantitative evaluation, as well as a user study. Statistics show that our method outperforms the state-of-the-art binocular tone mapping frameworks in terms of both visual quality and time performance.