Search by image : clothing segmentation and retrieval

Our study aims to develop a product retrieval system for clothing items. More specifically, we formulate our task as a cross-domain content based image retrieval problem. Product search using traditional keyword matching can be inefficient and time- consuming due to the large semantic gap between l...

Full description

Saved in:
Bibliographic Details
Main Author: Shi, Ganyu
Other Authors: Lin Guosheng
Format: Final Year Project
Language:English
Published: 2019
Subjects:
Online Access:http://hdl.handle.net/10356/76912
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Our study aims to develop a product retrieval system for clothing items. More specifically, we formulate our task as a cross-domain content based image retrieval problem. Product search using traditional keyword matching can be inefficient and time- consuming due to the large semantic gap between low-level visual features such as shape and colors, and high-level intents of customers. Our system aims to bridge the gap between shoppers and retailers by offering a street-to-shop image retrieval system that supports searching by images. We divide our system into two main stages: 1) Segmentation: We segment the query image into individual clothing classes, and use them as regions of interest for subsequent retrieval. 2) Retrieval: For each of the clothing item, we use image retrieval techniques to fetch visually similar products. We show that, by training effective CNN models, our system achieves fast and accurate clothing retrieval result, and is able to handle challenging scenarios such as diverse viewpoints, occlusion, and complex background.