Efficient unsupervised video hashing with contextual modeling and structural controlling

• Main Authors: DUAN, Jingru, HAO, Yanbin, ZHU, Bin, CHENG, Lechao, ZHOU, Pengyuan, WANG, Xiang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Codes; Computational modeling; Context modeling; Data Structure; Data structures; Deep Neural Network; Feature extraction; Hash functions; Large-scale retrieval; Transformers; Video hashing; Graphics and Human Computer Interfaces; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/8723; https://ink.library.smu.edu.sg/context/sis_research/article/9726/viewcontent/TMM_zhu24_av.pdf
• Institution: Singapore Management University

The most important effect of the video hashing technique is to support fast retrieval, which is benefiting from the high efficiency of binary calculation. Current video hash approaches are thus mainly targeted at learning compact binary codes to represent video content accurately. However, they may overlook the generation efficiency for hash codes, i.e., designing lightweight neural networks. This paper proposes an method, which is not only for computing compact hash codes but also for designing a lightweight deep model. Specifically, we present an MLP-based model, where the video tensor is split into several groups and multiple axial contexts are explored to separately refine them in parallel. The axial contexts are referred to as the dynamics aggregated from different axial scales, including long/middle/short-range dependencies. The group operation significantly reduces the computational cost of the MLP backbone. Moreover, to achieve compact video hash codes, three structural losses are utilized. As demonstrated by the experiment, the three structures are highly complementary for approximating the real data structure. We conduct extensive experiments on three benchmark datasets for the unsupervised video hashing task and show the superior trade-off between performance and computational cost of our EUVH to the state of the arts.