SAGE: Percipient Storage for Exascale Data Centric ComputingVisa övriga samt affilieringar
2019 (Engelska)Ingår i: Parallel Computing, ISSN 0167-8191, E-ISSN 1872-7336, Vol. 83, s. 22-33Artikel i tidskrift (Refereegranskat) Published
Abstract [en]
We aim to implement a Big Data/Extreme Computing (BDEC) capable system infrastructure as we head towards the era of Exascale computing - termed SAGE (Percipient StorAGe for Exascale Data Centric Computing). The SAGE system will be capable of storing and processing immense volumes of data at the Exascale regime, and provide the capability for Exascale class applications to use such a storage infrastructure. SAGE addresses the increasing overlaps between Big Data Analysis and HPC in an era of next-generation data centric computing that has developed due to the proliferation of massive data sources, such as large, dispersed scientific instruments and sensors, whose data needs to be processed, analysed and integrated into simulations to derive scientific and innovative insights. Indeed, Exascale I/O, as a problem that has not been sufficiently dealt with for simulation codes, is appropriately addressed by the SAGE platform. The objective of this paper is to discuss the software architecture of the SAGE system and look at early results we have obtained employing some of its key methodologies, as the system continues to evolve.
Ort, förlag, år, upplaga, sidor
Elsevier, 2019. Vol. 83, s. 22-33
Nyckelord [en]
SAGE architecture, Object storage, Mero, Clovis, PGAS I/O, MPI I/O, MPI streams
Nationell ämneskategori
Data- och informationsvetenskap
Identifikatorer
URN: urn:nbn:se:kth:diva-254119DOI: 10.1016/j.parco.2018.03.002ISI: 000469898400003Scopus ID: 2-s2.0-85044917976OAI: oai:DiVA.org:kth-254119DiVA, id: diva2:1328962
Anmärkning
QC 20190624
2019-06-242019-06-242024-03-15Bibliografiskt granskad