Cross-modal food retrieval: Learning a joint embedding of food images and recipes with semantic consistency and attention mechanism;

• Main Authors: WANG, Hao, SAHOO, Doyen, LIU, Chenghao, SHU, Ke, Palakorn, Achananuparp, LIM, Ee peng, HOI, Steven
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: Correlation; Cross-Modal Retrieval; Data models; Deep Learning; Semantics; Sugar; Task analysis; Training; Visionand-Language; Visualization; Graphics and Human Computer Interfaces; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/6249; https://ink.library.smu.edu.sg/context/sis_research/article/7252/viewcontent/cross_modal_food_retrieval.pdf
• Institution: Singapore Management University

Food retrieval is an important task to perform analysis of food-related information, where we are interested in retrieving relevant information about the queried food item such as ingredients, cooking instructions, etc. In this paper, we investigate cross-modal retrieval between food images and cook...