Timed dataflow: Reducing communication overhead for distributed machine learning systems

• Main Authors: SUN, Peng, WEN, Yonggang, TA, Nguyen Binh Duong, YAN, Shengen
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2016
• Subjects: Computer and Systems Architecture; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/4834
• Institution: Singapore Management University

Many distributed machine learning (ML) systems exhibit high communication overhead when dealing with big data sets. Our investigations showed that popular distributed ML systems could spend about an order of magnitude more time on network communication than computation to train ML models containing...