Clip-based similarity measure for hierarchical video retrieval

• Main Authors: PENG, Yuxin, NGO, Chong-wah
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2004
• Subjects: Clip-based similarity; Hierarchical video retrieval; Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/6507; https://ink.library.smu.edu.sg/context/sis_research/article/7510/viewcontent/1026711.1026721.pdf
• Institution: Singapore Management University

This paper proposes a new approach and algorithm for the similarity measure of video clips. The similarity is mainly based on two bipartite graph matching algorithms: maximum matching (MM) and optimal matching (OM). MM is able to rapidly filter irrelevant video clips, while OM is capable of ranking the similarity of clips according to the visual and granularity factors. Based on MM and OM, a hierarchical video retrieval framework is constructed for the approximate matching of video clips. To allow the matching between a query and a long video, an online clip segmentation algorithm is also proposed to rapidly locate candidate clips for similarity measure. The validity of the retrieval framework is theoretically proved and empirically verified on a video database of 21 hours.