DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT

Data management is a significant challenge in handling IoT data. Data must be stored efficiently and queried quickly. While some research has addressed this issue, most of the results are lossy, which can lead to important data being lost if not handled carefully. Therefore, a lossless data storage...

Full description

Saved in:
Bibliographic Details
Main Author: Bernigen, Bryan
Format: Final Project
Language:Indonesia
Online Access:https://digilib.itb.ac.id/gdl/view/85478
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Institut Teknologi Bandung
Language: Indonesia
id id-itb.:85478
spelling id-itb.:854782024-08-20T21:47:51ZDEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT Bernigen, Bryan Indonesia Final Project data storage, IoT, efficient, lossless, size, query speed INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/85478 Data management is a significant challenge in handling IoT data. Data must be stored efficiently and queried quickly. While some research has addressed this issue, most of the results are lossy, which can lead to important data being lost if not handled carefully. Therefore, a lossless data storage method is needed. Existing lossless methods include horizontal partitioning, data compression, and the Sawalha method. However, none of these methods have successfully addressed all the problems associated with IoT data storage. To address this issue, a new data storage method has been developed that aims to store data in a smaller size, speed up queries, and ensure losslessness. The proposed method relies on merging several pieces of data into a single record to reduce size and improve data retrieval speed. To test the proposed method, experiments were conducted on MySQL, PostgreSQL, and MongoDB databases. The results show that the proposed method successfully reduced the data size by up to 95% for integer data. It also improved query speed by up to 99% for most tested queries. However, there is one type of query—aggregation queries without object identity and range—that caused a significant slowdown in query speed with the proposed method. text
institution Institut Teknologi Bandung
building Institut Teknologi Bandung Library
continent Asia
country Indonesia
Indonesia
content_provider Institut Teknologi Bandung
collection Digital ITB
language Indonesia
description Data management is a significant challenge in handling IoT data. Data must be stored efficiently and queried quickly. While some research has addressed this issue, most of the results are lossy, which can lead to important data being lost if not handled carefully. Therefore, a lossless data storage method is needed. Existing lossless methods include horizontal partitioning, data compression, and the Sawalha method. However, none of these methods have successfully addressed all the problems associated with IoT data storage. To address this issue, a new data storage method has been developed that aims to store data in a smaller size, speed up queries, and ensure losslessness. The proposed method relies on merging several pieces of data into a single record to reduce size and improve data retrieval speed. To test the proposed method, experiments were conducted on MySQL, PostgreSQL, and MongoDB databases. The results show that the proposed method successfully reduced the data size by up to 95% for integer data. It also improved query speed by up to 99% for most tested queries. However, there is one type of query—aggregation queries without object identity and range—that caused a significant slowdown in query speed with the proposed method.
format Final Project
author Bernigen, Bryan
spellingShingle Bernigen, Bryan
DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
author_facet Bernigen, Bryan
author_sort Bernigen, Bryan
title DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
title_short DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
title_full DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
title_fullStr DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
title_full_unstemmed DEVELOPMENT OF LESSLESS AND EFFICIENT DATA STORAGE METHODS FOR IOT
title_sort development of lessless and efficient data storage methods for iot
url https://digilib.itb.ac.id/gdl/view/85478
_version_ 1822999185355440128