Quorums over codes

We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of a...

Full description

Saved in:
Bibliographic Details
Main Authors: Datta, Anwitaman, Oggier, Frédérique
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/153125
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-153125
record_format dspace
spelling sg-ntu-dr.10356-1531252023-02-28T19:58:48Z Quorums over codes Datta, Anwitaman Oggier, Frédérique School of Computer Science and Engineering School of Physical and Mathematical Sciences Engineering::Computer science and engineering Erasure Codes Quorums Read-Modify-Write Sequential Consistency We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of asymmetric quorum systems that suit the framework of coded data by explicitly exploiting the structural properties of code and instantiate it over distinct families of coding strategies: maximum distance separable (MDS) codes and codes with locality, and we indicate a mechanism for synchronizing stale nodes using differential updates, which again exploits the code structures. The proposed quorum system’s behavior is analyzed theoretically, exploring several aspects: viability of quorums under node unavailability; contention of resources between read and write operations; and quorum load. We complement these theoretical exploration with simulation based experiments to quantify the behavior of the proposed mechanism. The overall study demonstrates the feasibility and practicality of quorums over codes under practicable assumptions for achieving a stringent form of consistency, specifically, sequential consistency, while the stored data is being mutated by potentially multiple processes that might read and then modify the existing data. We achieve this in-place, without having to resort to store multiple versions of the data. Ministry of Education (MOE) Accepted version Anwitaman Datta’s research is supported by the Ministry of Education (MoE), Singapore, under its Academic Research Fund Tier 1 (Project ID: 2018- T1-002-076) for the project titled ‘StorEdge: Data store along a cloud-to-thing continuum with integrity and availability’. 2021-12-13T13:41:31Z 2021-12-13T13:41:31Z 2022 Journal Article Datta, A. & Oggier, F. (2022). Quorums over codes. Journal of Parallel and Distributed Computing, 161, 1-19. https://dx.doi.org/10.1016/j.jpdc.2021.11.002 0743-7315 https://hdl.handle.net/10356/153125 10.1016/j.jpdc.2021.11.002 161 1 19 en 2018- T1-002-076 RG134/18 Journal of Parallel and Distributed Computing © 2021 Elsevier Inc. All rights reserved. This paper was published in Journal of Parallel and Distributed Computing and is made available with permission of Elsevier Inc. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Erasure Codes
Quorums
Read-Modify-Write
Sequential Consistency
spellingShingle Engineering::Computer science and engineering
Erasure Codes
Quorums
Read-Modify-Write
Sequential Consistency
Datta, Anwitaman
Oggier, Frédérique
Quorums over codes
description We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of asymmetric quorum systems that suit the framework of coded data by explicitly exploiting the structural properties of code and instantiate it over distinct families of coding strategies: maximum distance separable (MDS) codes and codes with locality, and we indicate a mechanism for synchronizing stale nodes using differential updates, which again exploits the code structures. The proposed quorum system’s behavior is analyzed theoretically, exploring several aspects: viability of quorums under node unavailability; contention of resources between read and write operations; and quorum load. We complement these theoretical exploration with simulation based experiments to quantify the behavior of the proposed mechanism. The overall study demonstrates the feasibility and practicality of quorums over codes under practicable assumptions for achieving a stringent form of consistency, specifically, sequential consistency, while the stored data is being mutated by potentially multiple processes that might read and then modify the existing data. We achieve this in-place, without having to resort to store multiple versions of the data.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Datta, Anwitaman
Oggier, Frédérique
format Article
author Datta, Anwitaman
Oggier, Frédérique
author_sort Datta, Anwitaman
title Quorums over codes
title_short Quorums over codes
title_full Quorums over codes
title_fullStr Quorums over codes
title_full_unstemmed Quorums over codes
title_sort quorums over codes
publishDate 2021
url https://hdl.handle.net/10356/153125
_version_ 1759858316343771136