Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks

Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architec...

Full description

Saved in:
Bibliographic Details
Main Author: Chih, Wei Ling
Other Authors: Anwitaman Datta
Format: Theses and Dissertations
Language:English
Published: 2018
Subjects:
Online Access:http://hdl.handle.net/10356/74822
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-74822
record_format dspace
spelling sg-ntu-dr.10356-748222023-03-04T00:47:50Z Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks Chih, Wei Ling Anwitaman Datta School of Computer Science and Engineering Western Digital Jun Xu DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architecture, using edge nodes to augment a centralized backbone, facilitated by network coding and emerging fog computing solutions. For that reason, we design a linear optimization cost model (LO) to capture the network usage (e.g., network bandwidth and storage) with the aid of storage helpers for the network stakeholders. By assuming that the network is static over a window of time, we design an algorithm to construct a deterministic network code that sets up the multicast connections from the source processes to destinations (either storage helpers or data centers) for every feasible solution satisfying the set of graph-theoretic-constraints in the LO model to deal with the networks at small to medium scales. The LO model and the network coding algorithm will be implemented by leveraging OpenFlow, which is a realization of SDN controller. An SDN controller has the global view of the network and operates as a network operating system (e.g., NOX), and thus it is suitable to become the entity to overhaul and make the global decision for ITS. We also emphasize on a hybrid approach of both random and deterministic network coding paradigms to deal with the networks at medium to large scales. We have run several simulations to compare the performance of the ingredients of the hybrid approach by using ns-3 to reconfirm that from the aspects of network throughput and network usage, deterministic network coding performs better than random network coding. We have also compared the performance of the hybrid approach against both network coding paradigms. Under certain network conditions, our simulation results show that the proposed hybrid approach performs better than other approaches. Master of Engineering (SCE) 2018-05-24T04:42:51Z 2018-05-24T04:42:51Z 2018 Thesis Chih, W. L. (2018). Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks. Master's thesis, Nanyang Technological University, Singapore. http://hdl.handle.net/10356/74822 10.32657/10356/74822 en 126 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems
spellingShingle DRNTU::Engineering::Computer science and engineering::Computer systems organization::Performance of systems
Chih, Wei Ling
Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
description Large volume of data is generated by traffic surveillance devices such as cameras and sensors integrated into an intelligent transportation system (ITS). To deal with the extreme volume and the massively geographically distributed sources of data, we advocate a tiered storage and processing architecture, using edge nodes to augment a centralized backbone, facilitated by network coding and emerging fog computing solutions. For that reason, we design a linear optimization cost model (LO) to capture the network usage (e.g., network bandwidth and storage) with the aid of storage helpers for the network stakeholders. By assuming that the network is static over a window of time, we design an algorithm to construct a deterministic network code that sets up the multicast connections from the source processes to destinations (either storage helpers or data centers) for every feasible solution satisfying the set of graph-theoretic-constraints in the LO model to deal with the networks at small to medium scales. The LO model and the network coding algorithm will be implemented by leveraging OpenFlow, which is a realization of SDN controller. An SDN controller has the global view of the network and operates as a network operating system (e.g., NOX), and thus it is suitable to become the entity to overhaul and make the global decision for ITS. We also emphasize on a hybrid approach of both random and deterministic network coding paradigms to deal with the networks at medium to large scales. We have run several simulations to compare the performance of the ingredients of the hybrid approach by using ns-3 to reconfirm that from the aspects of network throughput and network usage, deterministic network coding performs better than random network coding. We have also compared the performance of the hybrid approach against both network coding paradigms. Under certain network conditions, our simulation results show that the proposed hybrid approach performs better than other approaches.
author2 Anwitaman Datta
author_facet Anwitaman Datta
Chih, Wei Ling
format Theses and Dissertations
author Chih, Wei Ling
author_sort Chih, Wei Ling
title Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
title_short Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
title_full Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
title_fullStr Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
title_full_unstemmed Distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
title_sort distributed multilevel storage infrastructure for visual surveillance in intelligent transportation networks
publishDate 2018
url http://hdl.handle.net/10356/74822
_version_ 1759858007829643264