DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION

The high number of visual impairment or difabel netra (DN) in Indonesia triggers public attention to provide maximum service for their rights as fellow human beings. Physical limitations make it difficult for DNs to carry out activities inside and outside the room, and often experience disorienta...

Full description

Saved in:
Bibliographic Details
Main Author: Azam Wiranata, Fandi
Format: Final Project
Language:Indonesia
Online Access:https://digilib.itb.ac.id/gdl/view/68748
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Institut Teknologi Bandung
Language: Indonesia
id id-itb.:68748
spelling id-itb.:687482022-09-19T09:36:00ZDEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION Azam Wiranata, Fandi Indonesia Final Project deep learning, low vision, image classification. INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/68748 The high number of visual impairment or difabel netra (DN) in Indonesia triggers public attention to provide maximum service for their rights as fellow human beings. Physical limitations make it difficult for DNs to carry out activities inside and outside the room, and often experience disorientation which can endanger DNs. In this modern era, the use of deep learning technology, especially in terms of image classification, will help DN overcome these problems. Therefore, we developed the LoVi application that can help DNs, especially low vision (LoVi) in their daily activities. The LoVi application has three modes, which are outdoor mode, indoor mode, and currency mode with core systems in the form of Sherpa models (TrotoarNet, IndoorNet, and CurrencyNet). Based on the test, from the final architecture of the Sherpa model, the test accuracy reached 95.5% on IndoorNet, 96.79% on TrotoarNet, and 93.35% on CurrencyNet, with FPS reaching 13 img/s, 40 img/s, and 26 img/s, respectively. Also, the final model size is much smaller than the Sherpa baseline model, which is 81MB. Thus, the built Sherpa model already meets the specified system specifications. text
institution Institut Teknologi Bandung
building Institut Teknologi Bandung Library
continent Asia
country Indonesia
Indonesia
content_provider Institut Teknologi Bandung
collection Digital ITB
language Indonesia
description The high number of visual impairment or difabel netra (DN) in Indonesia triggers public attention to provide maximum service for their rights as fellow human beings. Physical limitations make it difficult for DNs to carry out activities inside and outside the room, and often experience disorientation which can endanger DNs. In this modern era, the use of deep learning technology, especially in terms of image classification, will help DN overcome these problems. Therefore, we developed the LoVi application that can help DNs, especially low vision (LoVi) in their daily activities. The LoVi application has three modes, which are outdoor mode, indoor mode, and currency mode with core systems in the form of Sherpa models (TrotoarNet, IndoorNet, and CurrencyNet). Based on the test, from the final architecture of the Sherpa model, the test accuracy reached 95.5% on IndoorNet, 96.79% on TrotoarNet, and 93.35% on CurrencyNet, with FPS reaching 13 img/s, 40 img/s, and 26 img/s, respectively. Also, the final model size is much smaller than the Sherpa baseline model, which is 81MB. Thus, the built Sherpa model already meets the specified system specifications.
format Final Project
author Azam Wiranata, Fandi
spellingShingle Azam Wiranata, Fandi
DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
author_facet Azam Wiranata, Fandi
author_sort Azam Wiranata, Fandi
title DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
title_short DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
title_full DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
title_fullStr DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
title_full_unstemmed DEVELOPMENT OF SHERPA MODEL BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK (CNN) AS THE CORE SYSTEMS OF LOVI APPLICATION
title_sort development of sherpa model based on deep convolutional neural network (cnn) as the core systems of lovi application
url https://digilib.itb.ac.id/gdl/view/68748
_version_ 1822933740070895616