Multi-modal cooking workflow construction for food recipes

• Main Authors: PAN, Liangming, CHEN, Jingjing, WU, Jianlong, LIU, Shaoteng, NGO, Chong-wah, KAN, Min-Yen, JIANG, Yugang, CHUA, Tat-Seng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: cause-and-effect reasoning; cooking workflow; deep learning; food recipes; mm-res dataset; multi-modal fusion; Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/6464; https://ink.library.smu.edu.sg/context/sis_research/article/7467/viewcontent/3394171.3413765.pdf
• Institution: Singapore Management University

Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe. This is a non-trivial task that involves common-sense reasoning. However, existing efforts rely on hand-c...