CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing

Distributed hash table (DHT) overlay networks offer an efficient and robust technique for wire-area data storage and queries. Workload from real applications that use DHT networks will likely exhibit significant skews that can result in bottlenecks and failures that limit the overall scalability of...

Full description

Saved in:
Bibliographic Details
Main Authors: MISRA, Archan, CASTRO, Paul, LEE, Jinwon
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2004
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/699
https://ink.library.smu.edu.sg/context/sis_research/article/1698/viewcontent/Clash_2004.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-1698
record_format dspace
spelling sg-smu-ink.sis_research-16982019-02-11T03:53:03Z CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing MISRA, Archan CASTRO, Paul LEE, Jinwon Distributed hash table (DHT) overlay networks offer an efficient and robust technique for wire-area data storage and queries. Workload from real applications that use DHT networks will likely exhibit significant skews that can result in bottlenecks and failures that limit the overall scalability of the DHT approach. We present the content and load-aware scalable hashing (CLASH) protocol that can enhance the load distribution behavior of a DHT. CLASH relies on a variable-length identifier key scheme, where the length of any individual key is a function of load. CLASH uses variable-length keys to cluster content-related objects on single nodes to achieve processing efficiencies, and minimally disperse objects across multiple servers when hotspots occur. We demonstrate the performance benefits of CLASH through analysis and simulation. 2004-03-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/699 info:doi/10.1109/ICDCS.2004.1281592 https://ink.library.smu.edu.sg/context/sis_research/article/1698/viewcontent/Clash_2004.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Software Engineering
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Software Engineering
spellingShingle Software Engineering
MISRA, Archan
CASTRO, Paul
LEE, Jinwon
CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
description Distributed hash table (DHT) overlay networks offer an efficient and robust technique for wire-area data storage and queries. Workload from real applications that use DHT networks will likely exhibit significant skews that can result in bottlenecks and failures that limit the overall scalability of the DHT approach. We present the content and load-aware scalable hashing (CLASH) protocol that can enhance the load distribution behavior of a DHT. CLASH relies on a variable-length identifier key scheme, where the length of any individual key is a function of load. CLASH uses variable-length keys to cluster content-related objects on single nodes to achieve processing efficiencies, and minimally disperse objects across multiple servers when hotspots occur. We demonstrate the performance benefits of CLASH through analysis and simulation.
format text
author MISRA, Archan
CASTRO, Paul
LEE, Jinwon
author_facet MISRA, Archan
CASTRO, Paul
LEE, Jinwon
author_sort MISRA, Archan
title CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
title_short CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
title_full CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
title_fullStr CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
title_full_unstemmed CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing
title_sort clash: a protocol for internet-scale utility-oriented distributed computing
publisher Institutional Knowledge at Singapore Management University
publishDate 2004
url https://ink.library.smu.edu.sg/sis_research/699
https://ink.library.smu.edu.sg/context/sis_research/article/1698/viewcontent/Clash_2004.pdf
_version_ 1770570666544726016