Visual product search in mobile commerce

• Main Author: Lok, Seng Siong
• Other Authors: Yap Kim Hui
• Format: Final Year Project
• Language: English
• Published: 2017
• Subjects: DRNTU::Engineering::Electrical and electronic engineering
• Online Access: http://hdl.handle.net/10356/72279
• Institution: Nanyang Technological University

Mobile Visual Search (MVS) is an emerging technology which makes use of the images captured by a mobile device’s built-in camera and perform image search to return users with additional and meaningful information. This includes web pages, similar images or documents, 3D view of the objects and etc. On top of that, with the integration of Augmented Reality (AR), visual searching and matching can now be done within seconds from the live camera view of the visual search application rather than taking photos and save as images before any matching to be done at the server end. However, existing technologies are still having limitations which stop MVS from performing as perfect as it aims to be. The physical appearance of an object, lighting conditions, angles of scanning are examples of the objective factors which has limit the performance of MVS. Hence, this led to the necessary of having an alternative way for users to perform a non-text searching when it is required. Subsequently, Quick Response (QR) code and 1D Barcode are chosen to fulfill the objective. In other words, the goal of this project is to integrate both QR code and 1D barcode scanning function into the existing application as well as update the search engine with new data in order for it to recognise barcode or QR code printed on a console game cover and redirect users to the Uniform Resource Locator (URL) of the game trailer. This will certainly allow users to have a better idea of the gameplay before any purchase and the application will also be able to switch to different scanning mode automatically upon user’s selection if the scanning inputs are detected to be invalid. At the end of this project, the search engine was updated with new data and the series of testing were conducted to ensure the integration of 1D barcode and QR code with the visual search are working seamlessly under one application. As a result, the application is now able to provide extra details of the console game after perform scanning on its cover photo using different types of scanning mode.