Improving interpretable embeddings for ad-hoc video search with generative captions and multi-word concept bank

• المؤلفون الرئيسيون: WU, Jiaxin, NGO, Chong-wah, CHAN, Wing-Kwong
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2024
• الموضوعات: Ad-hoc video search; Interpretable embedding; Large-scale videotext dataset; Concept bank construction; Out of vocabulary; Databases and Information Systems; Graphics and Human Computer Interfaces
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/9288; https://ink.library.smu.edu.sg/context/sis_research/article/10288/viewcontent/2404.06173v1.pdf

Aligning a user query and video clips in cross-modal latent space and that with semantic concepts are two mainstream approaches for ad-hoc video search (AVS). However, the effectiveness of existing approaches is bottlenecked by the small sizes of available video-text datasets and the low quality of...