Quorums over codes
We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of a...
Saved in:
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2021
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/153125 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-153125 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1531252023-02-28T19:58:48Z Quorums over codes Datta, Anwitaman Oggier, Frédérique School of Computer Science and Engineering School of Physical and Mathematical Sciences Engineering::Computer science and engineering Erasure Codes Quorums Read-Modify-Write Sequential Consistency We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of asymmetric quorum systems that suit the framework of coded data by explicitly exploiting the structural properties of code and instantiate it over distinct families of coding strategies: maximum distance separable (MDS) codes and codes with locality, and we indicate a mechanism for synchronizing stale nodes using differential updates, which again exploits the code structures. The proposed quorum system’s behavior is analyzed theoretically, exploring several aspects: viability of quorums under node unavailability; contention of resources between read and write operations; and quorum load. We complement these theoretical exploration with simulation based experiments to quantify the behavior of the proposed mechanism. The overall study demonstrates the feasibility and practicality of quorums over codes under practicable assumptions for achieving a stringent form of consistency, specifically, sequential consistency, while the stored data is being mutated by potentially multiple processes that might read and then modify the existing data. We achieve this in-place, without having to resort to store multiple versions of the data. Ministry of Education (MOE) Accepted version Anwitaman Datta’s research is supported by the Ministry of Education (MoE), Singapore, under its Academic Research Fund Tier 1 (Project ID: 2018- T1-002-076) for the project titled ‘StorEdge: Data store along a cloud-to-thing continuum with integrity and availability’. 2021-12-13T13:41:31Z 2021-12-13T13:41:31Z 2022 Journal Article Datta, A. & Oggier, F. (2022). Quorums over codes. Journal of Parallel and Distributed Computing, 161, 1-19. https://dx.doi.org/10.1016/j.jpdc.2021.11.002 0743-7315 https://hdl.handle.net/10356/153125 10.1016/j.jpdc.2021.11.002 161 1 19 en 2018- T1-002-076 RG134/18 Journal of Parallel and Distributed Computing © 2021 Elsevier Inc. All rights reserved. This paper was published in Journal of Parallel and Distributed Computing and is made available with permission of Elsevier Inc. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering Erasure Codes Quorums Read-Modify-Write Sequential Consistency |
spellingShingle |
Engineering::Computer science and engineering Erasure Codes Quorums Read-Modify-Write Sequential Consistency Datta, Anwitaman Oggier, Frédérique Quorums over codes |
description |
We consider the design and analysis of quorum systems over erasure coded warm data (with low frequency of writes and accesses in general) to guarantee sequential consistency under a fail-stop model while supporting atomic read-modify-write operations by multiple clients. We propose a definition of asymmetric quorum systems that suit the framework of coded data by explicitly exploiting the structural properties of code and instantiate it over distinct families of coding strategies: maximum distance separable (MDS) codes and codes with locality, and we indicate a mechanism for synchronizing stale nodes using differential updates, which again exploits the code structures. The proposed
quorum system’s behavior is analyzed theoretically, exploring several aspects:
viability of quorums under node unavailability; contention of resources between read and write operations; and quorum load. We complement these theoretical exploration with simulation based experiments to quantify the behavior of the proposed mechanism. The overall study demonstrates the feasibility and practicality of quorums over codes under practicable assumptions for achieving a stringent form of consistency, specifically, sequential consistency, while the stored data is being mutated by potentially multiple processes that might read and then modify the existing data. We achieve this in-place, without having to resort to store multiple versions of the data. |
author2 |
School of Computer Science and Engineering |
author_facet |
School of Computer Science and Engineering Datta, Anwitaman Oggier, Frédérique |
format |
Article |
author |
Datta, Anwitaman Oggier, Frédérique |
author_sort |
Datta, Anwitaman |
title |
Quorums over codes |
title_short |
Quorums over codes |
title_full |
Quorums over codes |
title_fullStr |
Quorums over codes |
title_full_unstemmed |
Quorums over codes |
title_sort |
quorums over codes |
publishDate |
2021 |
url |
https://hdl.handle.net/10356/153125 |
_version_ |
1759858316343771136 |