Compositional prompt tuning with motion cues for open-vocabulary video relation detection

• Main Authors: GAO, Kaifeng, CHEN, Long, ZHANG, Hanwang, XIAO, Jun, SUN, Qianru
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/8102; https://ink.library.smu.edu.sg/context/sis_research/article/9105/viewcontent/4266_compositional_prompt_tuning_wi.pdf
• Institution: Singapore Management University

Prompt tuning with large-scale pretrained vision-language models empowers open-vocabulary prediction trained on limited base categories, e.g., object classification and detection. In this paper, we propose compositional prompt tuning with motion cues: an extended prompt tuning paradigm for compositi...