A study of multi-task and region-wise deep learning for food ingredient recognition
Food recognition has captured numerous research attention for its importance for health-related applications. The existing approaches mostly focus on the categorization of food according to dish names, while ignoring the underlying ingredient composition. In reality, two dishes with the same name do...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6301 https://ink.library.smu.edu.sg/context/sis_research/article/7304/viewcontent/Jing_tran_2021.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-7304 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-73042023-07-13T15:53:49Z A study of multi-task and region-wise deep learning for food ingredient recognition CHEN, Jingjing ZHU, Bin NGO, Chong-wah CHUA, Tat-Seng JIANG, Yu-Gang Food recognition has captured numerous research attention for its importance for health-related applications. The existing approaches mostly focus on the categorization of food according to dish names, while ignoring the underlying ingredient composition. In reality, two dishes with the same name do not necessarily share the exact list of ingredients. Therefore, the dishes under the same food category are not mandatorily equal in nutrition content. Nevertheless, due to limited datasets available with ingredient labels, the problem of ingredient recognition is often overlooked. Furthermore, as the number of ingredients is expected to be much less than the number of food categories, ingredient recognition is more tractable in the real-world scenario. This paper provides an insightful analysis of three compelling issues in ingredient recognition. These issues involve recognition in either image-level or region level, pooling in either single or multiple image scales, learning in either single or multi-task manner. The analysis is conducted on a large food dataset, Vireo Food-251, contributed by this paper. The dataset is composed of 169,673 images with 251 popular Chinese food and 406 ingredients. The dataset includes adequate challenges in scale and complexity to reveal the limit of the current approaches in ingredient recognition. 2020-12-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/6301 info:doi/10.1109/TIP.2020.3045639 https://ink.library.smu.edu.sg/context/sis_research/article/7304/viewcontent/Jing_tran_2021.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Image recognition Visualization Phase frequency detectors Image segmentation Fish Deep learning Shape Food images Chinese food ingredient recognition deep learning Artificial Intelligence and Robotics Graphics and Human Computer Interfaces |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Image recognition Visualization Phase frequency detectors Image segmentation Fish Deep learning Shape Food images Chinese food ingredient recognition deep learning Artificial Intelligence and Robotics Graphics and Human Computer Interfaces |
spellingShingle |
Image recognition Visualization Phase frequency detectors Image segmentation Fish Deep learning Shape Food images Chinese food ingredient recognition deep learning Artificial Intelligence and Robotics Graphics and Human Computer Interfaces CHEN, Jingjing ZHU, Bin NGO, Chong-wah CHUA, Tat-Seng JIANG, Yu-Gang A study of multi-task and region-wise deep learning for food ingredient recognition |
description |
Food recognition has captured numerous research attention for its importance for health-related applications. The existing approaches mostly focus on the categorization of food according to dish names, while ignoring the underlying ingredient composition. In reality, two dishes with the same name do not necessarily share the exact list of ingredients. Therefore, the dishes under the same food category are not mandatorily equal in nutrition content. Nevertheless, due to limited datasets available with ingredient labels, the problem of ingredient recognition is often overlooked. Furthermore, as the number of ingredients is expected to be much less than the number of food categories, ingredient recognition is more tractable in the real-world scenario. This paper provides an insightful analysis of three compelling issues in ingredient recognition. These issues involve recognition in either image-level or region level, pooling in either single or multiple image scales, learning in either single or multi-task manner. The analysis is conducted on a large food dataset, Vireo Food-251, contributed by this paper. The dataset is composed of 169,673 images with 251 popular Chinese food and 406 ingredients. The dataset includes adequate challenges in scale and complexity to reveal the limit of the current approaches in ingredient recognition. |
format |
text |
author |
CHEN, Jingjing ZHU, Bin NGO, Chong-wah CHUA, Tat-Seng JIANG, Yu-Gang |
author_facet |
CHEN, Jingjing ZHU, Bin NGO, Chong-wah CHUA, Tat-Seng JIANG, Yu-Gang |
author_sort |
CHEN, Jingjing |
title |
A study of multi-task and region-wise deep learning for food ingredient recognition |
title_short |
A study of multi-task and region-wise deep learning for food ingredient recognition |
title_full |
A study of multi-task and region-wise deep learning for food ingredient recognition |
title_fullStr |
A study of multi-task and region-wise deep learning for food ingredient recognition |
title_full_unstemmed |
A study of multi-task and region-wise deep learning for food ingredient recognition |
title_sort |
study of multi-task and region-wise deep learning for food ingredient recognition |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2020 |
url |
https://ink.library.smu.edu.sg/sis_research/6301 https://ink.library.smu.edu.sg/context/sis_research/article/7304/viewcontent/Jing_tran_2021.pdf |
_version_ |
1772829215012421632 |