Open this publication in new window or tab >>Show others...
2020 (English)In: IEEE Computer Architecture Letters, ISSN 1556-6056, Vol. 19, no 1, p. 80-83, article id 9078774Article in journal (Refereed) Published
Abstract [en]
Data copy is a widely-used memory operation in many programs and operating system services. In conventional computers, data copy is often carried out by two separate read and write transactions that pass data back and forth between the memory hierarchy and processor registers. Some prior mechanisms propose to avoid this unnecessary data movement by using the shared internal bus in DRAM chip to directly copy data between two DRAM banks. While these methods exhibit superior performance, compared to conventional techniques, this technique does not allow data copy over different DRAM channels. Hence, this technique has limited benefit for the emerging 3D stacked memories (such as HMC and HBM) that contains tens of banks across multiple memory controllers. In this paper, we present Network-on-Memory (NoM), a lightweight inter-bank communication scheme that enables direct data copy within memory. NoM adopts a TDM-based circuit-switching design, where circuit setup is done by the memory controller. Compared to previous state-of-the-art approaches, NoM enables both data copy over multiple DRAM channels and concurrent copy operation. Our evaluation shows that NoM improves the performance of data-intensive workloads by 3.8X on average compare to the state-of-the-art techniques, respectively. IEEE
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2020
Keywords
3D-Stacked Memory, Circuit Switching, Data Copy, Memory Network, Memory Systems, Data transfer, Dynamic random access storage, Three dimensional integrated circuits, Communication schemes, Conventional computers, Conventional techniques, Data-intensive workloads, Memory controller, Memory operations, State-of-the-art approach, State-of-the-art techniques, Data communication systems
National Category
Embedded Systems
Identifiers
urn:nbn:se:kth:diva-274214 (URN)10.1109/LCA.2020.2990599 (DOI)000543277600002 ()2-s2.0-85084060594 (Scopus ID)
Note
QC 20200716
2020-07-062020-07-062022-06-26Bibliographically approved