Multimodal transformer networks for end-to-end video-grounded dialogue systems
Developing Video-Grounded Dialogue Systems (VGDS), where a dialogue is conducted based on visual and audio aspects of a given video, is significantly more challenging than traditional image or text-grounded dialogue systems because (1) feature space of videos span across multiple picture frames, mak...
Saved in:
Main Authors: | LE, Hung, SAHOO, Doyen, CHEN, Nancy F., HOI, Steven C. H. |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2019
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/4428 https://ink.library.smu.edu.sg/context/sis_research/article/5431/viewcontent/P19_1564.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
Hierarchical multimodal attention for end-to-end audio-visual scene-aware dialogue response generation
by: LE, Hung, et al.
Published: (2020) -
Personalized fashion recommendation with visual explanations based on multimodal attention network: Towards visually explainable recommendation
by: CHEN, Xu, et al.
Published: (2019) -
Deep learning for video-grounded dialogue systems
by: LE, Hung
Published: (2022) -
TENet: Triple Excitation Network for video salient object detection
by: REN, Sucheng, et al.
Published: (2020) -
Task relation networks
by: LI, Jianshu, et al.
Published: (2019)