A Middleware Supporting Data Movement in Complex and Software-Defined Storage and Memory ArchitecturesShow others and affiliations
2021 (English)In: High Performance Computing - ISC High Performance Digital 2021 International Workshops / [ed] Jagode, H Anzt, H Ltaief, H Luszczek, P, Springer Nature , 2021, Vol. 12761, p. 346-357Conference paper, Published paper (Refereed)
Abstract [en]
Among the broad variety of challenges that arise from workloads in a converged HPC and Cloud infrastructure, data movement is of paramount importance, especially oncoming exascale systems featuring multiple tiers of memory and storage. While the focus has, for years, been primarily on optimizing computations, the importance of improving data handling on such architectures is now well understood. As optimization techniques can be applied at different stages (operating system, run-time system, programming environment, and so on), a middleware providing a uniform and consistent data awareness becomes necessary. In this paper, we introduce a novel memory- and data-aware middleware called Maestro, designed for data orchestration.
Place, publisher, year, edition, pages
Springer Nature , 2021. Vol. 12761, p. 346-357
Series
Lecture Notes in Computer Science, ISSN 0302-9743
Keywords [en]
HPC and cloud infrastructures, Software-defined infrastructures, Workflows
National Category
Computer Sciences Computer Systems
Identifiers
URN: urn:nbn:se:kth:diva-310656DOI: 10.1007/978-3-030-90539-2_23ISI: 000763168300024Scopus ID: 2-s2.0-85119852965OAI: oai:DiVA.org:kth-310656DiVA, id: diva2:1650170
Conference
35th International ISC High Performance Conference, JUN 24-JUL 02, 2021, ELECTR NETWORK
Note
QC 20220406
2022-04-062022-04-062022-06-25Bibliographically approved