Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection

Effective traffic management has always been one of the key considerations in datacenter design. It plays an even more important role today in the face of increasingly widespread deployment of communication intensive applications and cloud- based services, as well as the adoption of multipath datace...

Full description

Saved in:
Bibliographic Details
Main Authors: Pham, Manh Tung, Seow, Kiam Tian, Foh, Chuan Heng
Other Authors: School of Computer Engineering
Format: Article
Language:English
Published: 2015
Subjects:
Online Access:https://hdl.handle.net/10356/107281
http://hdl.handle.net/10220/25533
http://www.ijicic.org/contents.htm
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-107281
record_format dspace
spelling sg-ntu-dr.10356-1072812020-05-28T07:41:33Z Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection Pham, Manh Tung Seow, Kiam Tian Foh, Chuan Heng School of Computer Engineering DRNTU::Engineering::Computer science and engineering::Information systems Effective traffic management has always been one of the key considerations in datacenter design. It plays an even more important role today in the face of increasingly widespread deployment of communication intensive applications and cloud- based services, as well as the adoption of multipath datacenter topologies to cope with the enormous bandwidth requirements arising from those applications and services. Of central importance in traffic management for multipath datacenters is the problem of timely detection of elephant flows flows that carry huge amount of data so that the best paths can be selected for these flows, which otherwise might cause serious network congestion. In this paper, we propose FuzzyDetec, a novel control architecture for the adaptive detection of elephant flows in multipath datacenters based on fuzzy logic. We develop, perhaps for the first time, a close loop elephant flow detection framework with an automated fuzzy inference module that can continually compute an appropriate threshold for elephant flow detection based on current information feedback from the network. The novelty and practical significance of the idea lie in allowing multiple imprecise and possibly conflicting criteria to be incorporated into the elephant flow detection process, through simple fuzzy rules emulating human expertise in elephant flow threshold classification. The proposed approach is simple, intuitive and easily extensible, providing a promising direction towards intelligent datacenter traffic management for autonomous high performance datacenter networks. Simulation results show that, in comparison with an existing state-of-the-art elephant flow detection framework, our proposed approach can provide considerable throughput improvements in datacenter network routing. Published version 2015-05-14T03:38:08Z 2019-12-06T22:27:58Z 2015-05-14T03:38:08Z 2019-12-06T22:27:58Z 2014 2014 Journal Article Pham, M. T., Seow, K. T., & Foh, C. H. (2014). Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection. International journal of innovative computing, information and control, 10(5 ), 1669-1685. https://hdl.handle.net/10356/107281 http://hdl.handle.net/10220/25533 http://www.ijicic.org/contents.htm en International journal of innovative computing, information and control © 2014 ICIC International. This paper was published in International Journal of Innovative Computing, Information and Control and is made available as an electronic reprint (preprint) with permission of ICIC International. The paper can be found at the following official URL: [http://www.ijicic.org/contents.htm]. One print or electronic copy may be made for personal use only. Systematic or multiple reproduction, distribution to multiple locations via electronic or other means, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper is prohibited and is subject to penalties under law. 17 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Information systems
spellingShingle DRNTU::Engineering::Computer science and engineering::Information systems
Pham, Manh Tung
Seow, Kiam Tian
Foh, Chuan Heng
Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
description Effective traffic management has always been one of the key considerations in datacenter design. It plays an even more important role today in the face of increasingly widespread deployment of communication intensive applications and cloud- based services, as well as the adoption of multipath datacenter topologies to cope with the enormous bandwidth requirements arising from those applications and services. Of central importance in traffic management for multipath datacenters is the problem of timely detection of elephant flows flows that carry huge amount of data so that the best paths can be selected for these flows, which otherwise might cause serious network congestion. In this paper, we propose FuzzyDetec, a novel control architecture for the adaptive detection of elephant flows in multipath datacenters based on fuzzy logic. We develop, perhaps for the first time, a close loop elephant flow detection framework with an automated fuzzy inference module that can continually compute an appropriate threshold for elephant flow detection based on current information feedback from the network. The novelty and practical significance of the idea lie in allowing multiple imprecise and possibly conflicting criteria to be incorporated into the elephant flow detection process, through simple fuzzy rules emulating human expertise in elephant flow threshold classification. The proposed approach is simple, intuitive and easily extensible, providing a promising direction towards intelligent datacenter traffic management for autonomous high performance datacenter networks. Simulation results show that, in comparison with an existing state-of-the-art elephant flow detection framework, our proposed approach can provide considerable throughput improvements in datacenter network routing.
author2 School of Computer Engineering
author_facet School of Computer Engineering
Pham, Manh Tung
Seow, Kiam Tian
Foh, Chuan Heng
format Article
author Pham, Manh Tung
Seow, Kiam Tian
Foh, Chuan Heng
author_sort Pham, Manh Tung
title Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
title_short Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
title_full Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
title_fullStr Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
title_full_unstemmed Towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
title_sort towards intelligent datacenter traffic management : using automated fuzzy inferencing for elephant flow detection
publishDate 2015
url https://hdl.handle.net/10356/107281
http://hdl.handle.net/10220/25533
http://www.ijicic.org/contents.htm
_version_ 1681059212373786624