An overview of CMPI : network performance aware MPI in the cloud

Cloud computing enables users to perform distributed computing tasks on many virtual machines, without owning a physical cluster. Recently, various distributed computing tasks such as scientific applications are being moved from supercomputers and private clusters to public clouds. Message passing i...

Full description

Saved in:
Bibliographic Details
Main Authors: Gong, Yifan, He, Bingsheng, Zhong, Jianlong
Other Authors: School of Computer Engineering
Format: Conference or Workshop Item
Language:English
Published: 2013
Online Access:https://hdl.handle.net/10356/98907
http://hdl.handle.net/10220/12572
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-98907
record_format dspace
spelling sg-ntu-dr.10356-989072020-05-28T07:18:27Z An overview of CMPI : network performance aware MPI in the cloud Gong, Yifan He, Bingsheng Zhong, Jianlong School of Computer Engineering Symposium on Principles and Practice of Parallel Programming (17th : 2012) Cloud computing enables users to perform distributed computing tasks on many virtual machines, without owning a physical cluster. Recently, various distributed computing tasks such as scientific applications are being moved from supercomputers and private clusters to public clouds. Message passing interface (MPI) is a key and common component in distributed computing tasks. The virtualized computing environment of the public cloud hides the network topology information from the users, and existing topologyaware optimizations for MPI are no longer feasible in the cloud environment. We propose a network performance aware MPI library named CMPI. CMPI embraces a new model for capturing the network performance among different virtual machines in the cloud. Based on the network performance model, we develop novel network performance aware algorithms for communication operations. This poster gives an overview of CMPI design, and presents some preliminary results on collective operations such as broadcast. We demonstrate the effectiveness of our network performance aware optimizations on Amazon EC2. 2013-07-31T03:41:17Z 2019-12-06T20:01:01Z 2013-07-31T03:41:17Z 2019-12-06T20:01:01Z 2012 2012 Conference Paper Gong, Y., He, B., & Zhong, J. (2012). An overview of CMPI. Proceedings of the 17th ACM SIGPLAN symposium on Principles and Practice of Parallel Programming - PPoPP '12, 297-298. https://hdl.handle.net/10356/98907 http://hdl.handle.net/10220/12572 10.1145/2145816.2145862 en
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
description Cloud computing enables users to perform distributed computing tasks on many virtual machines, without owning a physical cluster. Recently, various distributed computing tasks such as scientific applications are being moved from supercomputers and private clusters to public clouds. Message passing interface (MPI) is a key and common component in distributed computing tasks. The virtualized computing environment of the public cloud hides the network topology information from the users, and existing topologyaware optimizations for MPI are no longer feasible in the cloud environment. We propose a network performance aware MPI library named CMPI. CMPI embraces a new model for capturing the network performance among different virtual machines in the cloud. Based on the network performance model, we develop novel network performance aware algorithms for communication operations. This poster gives an overview of CMPI design, and presents some preliminary results on collective operations such as broadcast. We demonstrate the effectiveness of our network performance aware optimizations on Amazon EC2.
author2 School of Computer Engineering
author_facet School of Computer Engineering
Gong, Yifan
He, Bingsheng
Zhong, Jianlong
format Conference or Workshop Item
author Gong, Yifan
He, Bingsheng
Zhong, Jianlong
spellingShingle Gong, Yifan
He, Bingsheng
Zhong, Jianlong
An overview of CMPI : network performance aware MPI in the cloud
author_sort Gong, Yifan
title An overview of CMPI : network performance aware MPI in the cloud
title_short An overview of CMPI : network performance aware MPI in the cloud
title_full An overview of CMPI : network performance aware MPI in the cloud
title_fullStr An overview of CMPI : network performance aware MPI in the cloud
title_full_unstemmed An overview of CMPI : network performance aware MPI in the cloud
title_sort overview of cmpi : network performance aware mpi in the cloud
publishDate 2013
url https://hdl.handle.net/10356/98907
http://hdl.handle.net/10220/12572
_version_ 1681057705045786624