Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architec...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Theses and Dissertations |
Language: | English |
Published: |
2018
|
Subjects: | |
Online Access: | http://hdl.handle.net/10356/74822 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-74822 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-748222023-03-04T00:47:50Z Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks Chih, Wei Ling Anwitaman Datta School of Computer Science and Engineering Western Digital Jun Xu DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architecture, using edge nodes to augment a centralized backbone, facilitated by network coding and emerging fog computing solutions. For that reason, we design a linear optimization cost model (LO) to capture the network usage (e.g., network bandwidth and storage) with the aid of storage helpers for the network stakeholders. By assuming that the network is static over a window of time, we design an algorithm to construct a deterministic network code that sets up the multicast connections from the source processes to destinations (either storage helpers or data centers) for every feasible solution satisfying the set of graph-theoretic-constraints in the LO model to deal with the networks at small to medium scales. The LO model and the network coding algorithm will be implemented by leveraging OpenFlow, which is a realization of SDN controller. An SDN controller has the global view of the network and operates as a network operating system (e.g., NOX), and thus it is suitable to become the entity to overhaul and make the global decision for ITS. We also emphasize on a hybrid approach of both random and deterministic network coding paradigms to deal with the networks at medium to large scales. We have run several simulations to compare the performance of the ingredients of the hybrid approach by using ns-3 to reconfirm that from the aspects of network throughput and network usage, deterministic network coding performs better than random network coding. We have also compared the performance of the hybrid approach against both network coding paradigms. Under certain network conditions, our simulation results show that the proposed hybrid approach performs better than other approaches. Master of Engineering (SCE) 2018-05-24T04:42:51Z 2018-05-24T04:42:51Z 2018 Thesis Chih, W. L. (2018). Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks. Master's thesis, Nanyang Technological University, Singapore. http://hdl.handle.net/10356/74822 10.32657/10356/74822 en 126 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems |
spellingShingle |
DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems Chih, Wei Ling Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
description |
Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architecture, using edge nodes to augment a centralized backbone, facilitated by network coding and emerging fog computing solutions. For that reason, we design a linear optimization cost model (LO) to capture the network usage (e.g., network bandwidth and storage) with the aid of storage helpers for the network stakeholders. By assuming that the network is static over a window of time, we design an algorithm to construct a deterministic network code that sets up the multicast connections from the source processes to destinations (either storage helpers or data centers) for every feasible solution satisfying the set of graph-theoretic-constraints in the LO model to deal with the networks at small to medium scales. The LO model and the network coding algorithm will be implemented by leveraging OpenFlow, which is a realization of SDN controller. An SDN controller has the global view of the network and operates as a network operating system (e.g., NOX), and thus it is suitable to become the entity to overhaul and make the global decision for ITS. We also emphasize on a hybrid approach of both random and deterministic network coding paradigms to deal with the networks at medium to large scales. We have run several simulations to compare the performance of the ingredients of the hybrid approach by using ns-3 to reconfirm that from the aspects of network throughput and network usage, deterministic network coding performs better than random network coding. We have also compared the performance of the hybrid approach against both network coding paradigms. Under certain network conditions, our simulation results show that the proposed hybrid approach performs better than other approaches. |
author2 |
Anwitaman Datta |
author_facet |
Anwitaman Datta Chih, Wei Ling |
format |
Theses and Dissertations |
author |
Chih, Wei Ling |
author_sort |
Chih, Wei Ling |
title |
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
title_short |
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
title_full |
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
title_fullStr |
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
title_full_unstemmed |
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
title_sort |
distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks |
publishDate |
2018 |
url |
http://hdl.handle.net/10356/74822 |
_version_ |
1759858007829643264 |