Active-Routing: Compute on the Way for Near-Data Processing
Conference Paper
-
- Overview
-
- Research
-
- Identity
-
- Additional Document Info
-
- Other
-
- View All
-
Overview
abstract
-
© 2019 IEEE. The explosion of data availability and the demand for faster data analysis have led to the emergence of applications exhibiting large memory footprint and low data reuse rate. These workloads, ranging from neural networks to graph processing, expose compute kernels that operate over myriads of data. Significant data movement requirements of these kernels impose heavy stress on modern memory subsystems and communication fabrics. To mitigate the worsening gap between high CPU computation density and deficient memory bandwidth, solutions like memory networks and near-data processing designs are being architected to improve system performance substantially. In this work, we examine the idea of mapping compute kernels to the memory network so as to leverage in-network computing in data-flow style, by means of near-data processing. We propose Active-Routing, an in-network compute architecture that enables computation on the way for near-data processing by exploiting patterns of aggregation over intermediate results of arithmetic operators. The proposed architecture leverages the massive memory-level parallelism and network concurrency to optimize the aggregation operations along a dynamically built Active-Routing Tree. Our evaluations show that Active-Routing can achieve upto 7× speedup with an average of 60% performance improvement, and reduce the energy-delay product by 80% across various benchmarks compared to the state-of-the-art processing-in-memory architecture.
name of conference
-
2019 IEEE International Symposium on High Performance Computer Architecture (HPCA)
published proceedings
-
2019 IEEE International Symposium on High Performance Computer Architecture (HPCA)
author list (cited authors)
-
Huang, J., Reddy Puli, R., Majumder, P., Kim, S., Boyapati, R., Yum, K. H., & Kim, E. J.
citation count
complete list of authors
-
Huang, Jiayi||Reddy Puli, Ramprakash||Majumder, Pritam||Kim, Sungkeun||Boyapati, Rahul||Yum, Ki Hwan||Kim, Eun Jung
publication date
publisher
published in
Research
keywords
-
Data-flow
-
In-network Computing
-
Memory Network
-
Near-data Processing
-
Processing-in-memory
Identity
Digital Object Identifier (DOI)
International Standard Book Number (ISBN) 13
Additional Document Info
start page
end page
volume
Other
user-defined tag
-
7 Affordable and Clean Energy