VIREO @ Video Browser Showdown 2020

• Main Authors: NGUYEN, Phuong Anh, WU, Jiaxin, NGO, Chong-wah, FRANCIS, Danny, HUET, Benoit
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: Query-by-object-sketch; Sketch-based retrieval; Video Browser Showdown; Video retrieval; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/6613; https://ink.library.smu.edu.sg/context/sis_research/article/7616/viewcontent/Nguyen_VIREOVideoBrowserShowdown2020_av.pdf
• Institution: Singapore Management University

In this paper, we present the features implemented in the 4th version of the VIREO Video Search System (VIREO-VSS). In this version, we propose a sketch-based retrieval model, which allows the user to specify a video scene with objects and their basic properties, including color, size, and location. We further utilize the temporal relation between video frames to strengthen this retrieval model. For text-based retrieval module, we supply speech and on-screen text for free-text search and upgrade the concept bank for concept search. The search interface is also re-designed targeting the novice user. With the introduced system, we expect that the VIREO-VSS can be a competitive participant in the Video Browser Showdown (VBS) 2020.