(Un)likelihood training for interpretable embedding

• Main Authors: WU, Jiaxin, NGO, Chong-wah, CHAN, Wing-Kwong, HOU, Zhijian
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Cross-modal representation learning; Explainable embedding; Neural networks; Video search; Artificial Intelligence and Robotics
• Online Access: https://ink.library.smu.edu.sg/sis_research/9819; https://ink.library.smu.edu.sg/context/sis_research/article/10819/viewcontent/2207.00282v3.pdf
• Institution: Singapore Management University

Cross-modal representation learning has become a new normal for bridging the semantic gap between text and visual data. Learning modality agnostic representations in a continuous latent space, however, is often treated as a black-box data-driven training process. It is well known that the effectiven...