The Bitlet model: a parameterized analytical model to compare PIM and CPU systems

• Main Authors: Ronen, Ronny, Eliahu, Adi, Leitersdorf, Orian, Peled, Natan, Korgaonkar, Kunal, Chattopadhyay, Anupam, Perach, Ben, Kvatinsky, Shahar
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2022
• Subjects: Engineering::Computer science and engineering; CPU Systems; Data-Intensive Application
• Online Access: https://hdl.handle.net/10356/162977
• Institution: Nanyang Technological University

Currently, data-intensive applications are gaining popularity. Together with this trend, processing-in-memory (PIM)-based systems are being given more attention and have become more relevant. This article describes an analytical modeling tool called Bitlet that can be used in a parameterized fashion to estimate the performance and power/energy of a PIM-based system and, thereby, assess the affinity of workloads for PIM as opposed to traditional computing. The tool uncovers interesting trade-offs between, mainly, the PIM computation complexity (cycles required to perform a computation through PIM), the amount of memory used for PIM, the system memory bandwidth, and the data transfer size. Despite its simplicity, the model reveals new insights when applied to real-life examples. The model is demonstrated for several synthetic examples and then applied to explore the influence of different parameters on two systems - IMAGING and FloatPIM. Based on the demonstrations, insights about PIM and its combination with a CPU are provided.