Enhancing performance in video grounding tasks through the use of captions

• Main Author: Liu, Xinran
• Other Authors: Sun Aixin
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Temporal sentence grounding; Machine learning
• Online Access: https://hdl.handle.net/10356/175356
• Institution: Nanyang Technological University

This report explores enhancing video grounding tasks by utilizing generated captions, addressing the challenge posed by sparse annotations in video datasets. We took inspiration from the PCNet model which uses caption-guided attention to fuse the captions generated by Parallel Dynamic Video Captioni...