Semantic-filtered Soft-Split-Aware video captioning with audio-augmented feature

• Main Authors: Xu, Yuecong, Yang, Jianfei, Mao, Kezhi
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2021
• Subjects: Engineering::Electrical and electronic engineering; Video Captioning; Long Short-term Memory
• Online Access: https://hdl.handle.net/10356/151341
• Institution: Nanyang Technological University

Automatic video description, or video captioning, is a challenging yet much attractive task. It aims to combine video with text. Multiple methods have been proposed based on neural networks, utilizing Convolutional Neural Networks (CNN) to extract features, and Recurrent Neural Networks (RNN) to enc...