Storage codes : managing big data with small overheads

Erasure coding provides a mechanism to store data redundantly for fault-tolerance in a cost-effective manner. Recently, there has been a renewed interest in designing new erasure coding techniques with different desirable properties, including good repairability and degraded read performance, or...

Full description

Saved in:
Bibliographic Details
Main Authors: Datta, Anwitaman, Oggier, Frederique
Other Authors: School of Physical and Mathematical Sciences
Format: Conference or Workshop Item
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/96936
http://hdl.handle.net/10220/9978
http://sands.sce.ntu.edu.sg/CodingForNetworkedStorage/
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-96936
record_format dspace
spelling sg-ntu-dr.10356-969362023-02-28T19:17:21Z Storage codes : managing big data with small overheads Datta, Anwitaman Oggier, Frederique School of Physical and Mathematical Sciences IEEE International Symposium on Network Coding (2013 : Calgary, Canada) DRNTU::Engineering::Computer science and engineering::Data::Coding and information theory Erasure coding provides a mechanism to store data redundantly for fault-tolerance in a cost-effective manner. Recently, there has been a renewed interest in designing new erasure coding techniques with different desirable properties, including good repairability and degraded read performance, or efficient redundancy generation processes. Very often, these novel techniques exploit the computational resources available ‘in the network’, i.e., leverage on storage units which are not passive entities supporting only read/write of data, but also can carry out some computations. This article accompanies an identically titled tutorial at the IEEE International Symposium on Network Coding (NetCod 2013), and portrays a big picture of some of the important processes within distributed storage systems, where erasure codes designed by explicitly taking into account the nuances of distributed storage systems can provide significant performance boosts. Accepted version 2013-05-23T06:48:22Z 2019-12-06T19:36:51Z 2013-05-23T06:48:22Z 2019-12-06T19:36:51Z 2013 2013 Conference Paper Datta, A., & Oggier, F. (2013). Storage Codes: Managing Big Data with Small Overheads. IEEE International Symposium on Network Coding (NetCod 2013). https://hdl.handle.net/10356/96936 http://hdl.handle.net/10220/9978 http://sands.sce.ntu.edu.sg/CodingForNetworkedStorage/ 172456 en © 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: [http://sands.sce.ntu.edu.sg/CodingForNetworkedStorage/]. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Data::Coding and information theory
spellingShingle DRNTU::Engineering::Computer science and engineering::Data::Coding and information theory
Datta, Anwitaman
Oggier, Frederique
Storage codes : managing big data with small overheads
description Erasure coding provides a mechanism to store data redundantly for fault-tolerance in a cost-effective manner. Recently, there has been a renewed interest in designing new erasure coding techniques with different desirable properties, including good repairability and degraded read performance, or efficient redundancy generation processes. Very often, these novel techniques exploit the computational resources available ‘in the network’, i.e., leverage on storage units which are not passive entities supporting only read/write of data, but also can carry out some computations. This article accompanies an identically titled tutorial at the IEEE International Symposium on Network Coding (NetCod 2013), and portrays a big picture of some of the important processes within distributed storage systems, where erasure codes designed by explicitly taking into account the nuances of distributed storage systems can provide significant performance boosts.
author2 School of Physical and Mathematical Sciences
author_facet School of Physical and Mathematical Sciences
Datta, Anwitaman
Oggier, Frederique
format Conference or Workshop Item
author Datta, Anwitaman
Oggier, Frederique
author_sort Datta, Anwitaman
title Storage codes : managing big data with small overheads
title_short Storage codes : managing big data with small overheads
title_full Storage codes : managing big data with small overheads
title_fullStr Storage codes : managing big data with small overheads
title_full_unstemmed Storage codes : managing big data with small overheads
title_sort storage codes : managing big data with small overheads
publishDate 2013
url https://hdl.handle.net/10356/96936
http://hdl.handle.net/10220/9978
http://sands.sce.ntu.edu.sg/CodingForNetworkedStorage/
_version_ 1759854288831512576