Enhancing visual grounding in vision-language pre-training with position-guided text prompts

• Main Authors: WANG, Alex Jinpeng, ZHOU, Pan, SHOU, Mike Zheng, YAN, Shuicheng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Fill-in-the-blank; position-guided text prompt; vision-language pre-training; visual grounding; Artificial Intelligence and Robotics; Numerical Analysis and Scientific Computing; Programming Languages and Compilers
• Online Access: https://ink.library.smu.edu.sg/sis_research/8742; https://ink.library.smu.edu.sg/context/sis_research/article/9745/viewcontent/VisualGroundingVL_av.pdf
• Institution: Singapore Management University

Vision-Language Pre-Training (VLP) has demonstrated remarkable potential in aligning image and text pairs, paving the way for a wide range of cross-modal learning tasks. Nevertheless, we have observed that VLP models often fall short in terms of visual grounding and localization capabilities, which...