kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
In-Situ Techniques on GPU-Accelerated Data-Intensive Applications
Max Planck Computing and Data Facility, Max Planck Computing and Data Facility.
Technical University of Munich, Technical University of Munich.
KTH, School of Engineering Sciences (SCI), Engineering Mechanics, Fluid Mechanics and Engineering Acoustics.ORCID iD: 0000-0001-5204-8549
CINECA, Cineca.
Show others and affiliations
2023 (English)In: Proceedings 2023 IEEE 19th International Conference on e-Science, e-Science 2023, Institute of Electrical and Electronics Engineers (IEEE) , 2023Conference paper, Published paper (Refereed)
Abstract [en]

The computational power of High-Performance Computing (HPC) systems is constantly increasing, however, their input/output (IO) performance grows relatively slowly, and their storage capacity is also limited. This unbalance presents significant challenges for applications such as Molecular Dynamics (MD) and Computational Fluid Dynamics (CFD), which generate massive amounts of data for further visualization or analysis. At the same time, checkpointing is crucial for long runs on HPC clusters, due to limited walltimes and/or failures of system components, and typically requires the storage of large amount of data. Thus, restricted IO performance and storage capacity can lead to bottlenecks for the performance of full application workflows (as compared to computational kernels without IO). In-situ techniques, where data is further processed while still in memory rather to write it out over the I/O subsystem, can help to tackle these problems. In contrast to traditional post-processing methods, in-situ techniques can reduce or avoid the need to write or read data via the IO subsystem. They offer a promising approach for applications aiming to leverage the full power of large scale HPC systems. In-situ techniques can also be applied to hybrid computational nodes on HPC systems consisting of graphics processing units (GPUs) and central processing units (CPUs). On one node, the GPUs would have significant performance advantages over the CPUs. Therefore, current approaches for GPU-accelerated applications often focus on maximizing GPU usage, leaving CPUs underutilized. In-situ tasks using CPUs to perform data analysis or preprocess data concurrently to the running simulation, offer a possibility to improve this underutilization.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023.
Keywords [en]
CPU, GPU, HPC, in-situ
National Category
Computer Sciences Computer Systems
Identifiers
URN: urn:nbn:se:kth:diva-338984DOI: 10.1109/e-Science58273.2023.10254865Scopus ID: 2-s2.0-85174292669OAI: oai:DiVA.org:kth-338984DiVA, id: diva2:1808750
Conference
19th IEEE International Conference on e-Science, e-Science 2023, Limassol, Cyprus, Oct 9 2023 - Oct 14 2023
Note

Part of ISBN 9798350322231

QC 20231101

Available from: 2023-11-01 Created: 2023-11-01 Last updated: 2023-12-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Perez, AdalbertoJansson, NiclasMarkidis, StefanoSchlatter, Philipp

Search in DiVA

By author/editor
Perez, AdalbertoJansson, NiclasMarkidis, StefanoSchlatter, Philipp
By organisation
Fluid Mechanics and Engineering AcousticsCentre for High Performance Computing, PDCComputational Science and Technology (CST)
Computer SciencesComputer Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 125 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf