Position-guided text prompt for vision-language pre-training

• Main Authors: WANG, Alex Jinpeng, ZHOU, Pan, SHOU, Mike Zheng, YAN Shuicheng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Graphics and Human Computer Interfaces; Programming Languages and Compilers
• Online Access: https://ink.library.smu.edu.sg/sis_research/9021; https://ink.library.smu.edu.sg/context/sis_research/article/10024/viewcontent/2023_CVPR_PTP.pdf
• Institution: Singapore Management University

Vision-Language Pre-Training (VLP) has shown promising capabilities to align image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we observe that VLP models often lack the visual grounding/localization capability which is critical for many downstream tasks such...