Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Online MPI trace compression using event flow graphs and wavelets
KTH, Centres, SeRC - Swedish e-Science Research Centre.ORCID iD: 0000-0001-9693-6265
KTH, Centres, SeRC - Swedish e-Science Research Centre. KTH, School of Computer Science and Communication (CSC), Computational Science and Technology (CST).ORCID iD: 0000-0002-9901-9857
2016 (English)In: Procedia Computer Science, Elsevier, 2016, p. 1497-1506Conference paper, Published paper (Refereed)
Abstract [en]

Performance analysis of scientific parallel applications is essential to use High Performance Computing (HPC) infrastructures efficiently. Nevertheless, collecting detailed data of large-scale parallel programs and long-running applications is infeasible due to the huge amount of performance information generated. Even though there are no technological constraints in storing Terabytes of performance data, the constant flushing of such data to disk introduces a massive overhead into the application that makes the performance measurements worthless. This paper explores the use of Event flow graphs together with wavelet analysis and EZW-encoding to provide MPI event traces that are orders of magnitude smaller while preserving accurate information on timestamped events. Our mechanism compresses the performance data online while the application runs, thus, reducing the pressure put on the I/O system due to buffer flushing. As a result, we achieve lower application perturbation, reduced performance data output, and the possibility to monitor longer application runs. © The Authors. Published by Elsevier B.V.

Place, publisher, year, edition, pages
Elsevier, 2016. p. 1497-1506
Keywords [en]
Event flow graphs, EZW coding, MPI performance monitoring, Trace compression, Wavelets, Application programs, Graphic methods, Wavelet analysis, Event-flow graph, Performance monitoring, Flow graphs
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:kth:diva-194600DOI: 10.1016/j.procs.2016.05.471Scopus ID: 2-s2.0-84978517854OAI: oai:DiVA.org:kth-194600DiVA, id: diva2:1044118
Conference
International Conference on Computational Science, ICCS 2016, 6 June 2016 through 8 June 2016
Note

Conference Paper. QC 20161102

Available from: 2016-11-02 Created: 2016-10-31 Last updated: 2016-11-02Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records BETA

Aguilar, XavierLaure, Erwin

Search in DiVA

By author/editor
Aguilar, XavierLaure, Erwin
By organisation
SeRC - Swedish e-Science Research CentreComputational Science and Technology (CST)
Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 104 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf