LAMP: load-balanced multipath parallel transmission in point-to-point NoCs

Network-on-Chip (NoC) is an emerging paradigm that is able to connect a significant amount of processing elements (PEs). However, as a distributed sub-system, NoC resources have not been exploited to the fullest. Multipath parallel transmission, which splits one message into multiple parts and sends...

Full description

Saved in:
Bibliographic Details
Main Authors: Chen, Hui, Chen, Peng, Luo, Xiangzhong, Huai, Shuo, Liu, Weichen
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/159209
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-159209
record_format dspace
spelling sg-ntu-dr.10356-1592092022-06-03T00:28:10Z LAMP: load-balanced multipath parallel transmission in point-to-point NoCs Chen, Hui Chen, Peng Luo, Xiangzhong Huai, Shuo Liu, Weichen School of Computer Science and Engineering Engineering::Computer science and engineering::Computer systems organization Network-on-Chip Load-Balancing Network-on-Chip (NoC) is an emerging paradigm that is able to connect a significant amount of processing elements (PEs). However, as a distributed sub-system, NoC resources have not been exploited to the fullest. Multipath parallel transmission, which splits one message into multiple parts and sends them simultaneously, shows its efficiency in utilizing NoC resources and further reducing the transmission latency. However, this method is not fully optimized in previous works, especially for emerging point-to-point NoCs due to the following reasons: (1) only limited shortest paths are chosen; (2) static message splitting strategy without considering NoC utilization state increases contentions; (3) the optimization of hardware that supports multipath parallel transmission is missing, resulting in additional overheads. Thus, we propose LAMP, a software and hardware collaborated design to efficiently utilize resources and reduce latency in point-to-point NoCs through the load-balanced multipath parallel transmission. Specifically, we propose a reinforcement learning-based algorithm to decide when and how to split messages, and which path should be used according to traffic loads. Also, the temporal and spatial load-balancing algorithms are proposed so that the message size is adjusted properly to utilize NoC resources. Moreover, we revise the hardware design to support multipath parallel transmission efficiently. Extensive experiments show that our algorithm achieves a remarkable performance improvement (+18.0% ∼ +29.9%) when compared with the state-of-the-art dual-path algorithm. Our hardware design decreases power and area consumption by 23.2% and 10.3% over the dual-path hardware. Ministry of Education (MOE) Nanyang Technological University Submitted/Accepted version This work is partially supported by the Ministry of Education, Singapore, under its Academic Research Fund Tier 2 (MoE2019-T2-1-071) and Tier 1 (MoE2019-T1-001-072), and Nanyang Technological University, Singapore, under its NAP (M4082282) and SUG (M4082087). 2022-06-03T00:28:10Z 2022-06-03T00:28:10Z 2022 Journal Article Chen, H., Chen, P., Luo, X., Huai, S. & Liu, W. (2022). LAMP: load-balanced multipath parallel transmission in point-to-point NoCs. IEEE Transactions On Computer-Aided Design of Integrated Circuits and Systems. https://dx.doi.org/10.1109/TCAD.2022.3151021 0278-0070 https://hdl.handle.net/10356/159209 10.1109/TCAD.2022.3151021 2-s2.0-85124747637 en MoE2019-T2-1-071 MoE2019-T1-001-072 M4082282 M4082087 IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TCAD.2022.3151021. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computer systems organization
Network-on-Chip
Load-Balancing
spellingShingle Engineering::Computer science and engineering::Computer systems organization
Network-on-Chip
Load-Balancing
Chen, Hui
Chen, Peng
Luo, Xiangzhong
Huai, Shuo
Liu, Weichen
LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
description Network-on-Chip (NoC) is an emerging paradigm that is able to connect a significant amount of processing elements (PEs). However, as a distributed sub-system, NoC resources have not been exploited to the fullest. Multipath parallel transmission, which splits one message into multiple parts and sends them simultaneously, shows its efficiency in utilizing NoC resources and further reducing the transmission latency. However, this method is not fully optimized in previous works, especially for emerging point-to-point NoCs due to the following reasons: (1) only limited shortest paths are chosen; (2) static message splitting strategy without considering NoC utilization state increases contentions; (3) the optimization of hardware that supports multipath parallel transmission is missing, resulting in additional overheads. Thus, we propose LAMP, a software and hardware collaborated design to efficiently utilize resources and reduce latency in point-to-point NoCs through the load-balanced multipath parallel transmission. Specifically, we propose a reinforcement learning-based algorithm to decide when and how to split messages, and which path should be used according to traffic loads. Also, the temporal and spatial load-balancing algorithms are proposed so that the message size is adjusted properly to utilize NoC resources. Moreover, we revise the hardware design to support multipath parallel transmission efficiently. Extensive experiments show that our algorithm achieves a remarkable performance improvement (+18.0% ∼ +29.9%) when compared with the state-of-the-art dual-path algorithm. Our hardware design decreases power and area consumption by 23.2% and 10.3% over the dual-path hardware.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Chen, Hui
Chen, Peng
Luo, Xiangzhong
Huai, Shuo
Liu, Weichen
format Article
author Chen, Hui
Chen, Peng
Luo, Xiangzhong
Huai, Shuo
Liu, Weichen
author_sort Chen, Hui
title LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
title_short LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
title_full LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
title_fullStr LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
title_full_unstemmed LAMP: load-balanced multipath parallel transmission in point-to-point NoCs
title_sort lamp: load-balanced multipath parallel transmission in point-to-point nocs
publishDate 2022
url https://hdl.handle.net/10356/159209
_version_ 1735491195085258752