Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
PerfMiner: Cluster-wide collection, storage and presentation of application level hardware performance data
KTH, School of Computer Science and Communication (CSC), Centres, Centre for High Performance Computing, PDC.
KTH, School of Computer Science and Communication (CSC), Centres, Centre for High Performance Computing, PDC.
KTH, School of Computer Science and Communication (CSC), Centres, Centre for High Performance Computing, PDC.
KTH, School of Computer Science and Communication (CSC), Centres, Centre for High Performance Computing, PDC.
Show others and affiliations
2005 (English)In: EURO-PAR 2005 PARALLEL PROCESSING, PROCEEDINGS / [ed] Cunha, JC; Medeiros, PD, 2005, Vol. 3648, 124-133 p.Conference paper, Published paper (Refereed)
Abstract [en]

We present PerfMiner, a system for the transparent collection, storage and presentation of thread-level hardware performance data across an entire cluster. Every sub-process/thread spawned by the user through the batch system is measured with near zero overhead and no dilation of run-time. Performance metrics are collected at the thread level using tool built on top of the Performance Application Programming Interface (PAPI). As the hardware counters are virtualized by the OS, the resulting counts are largely unaffected by other kernel or user processes. PerfMiner correlates this performance data with metadata from the batch system and places it in a database. Through a command line and web interface, the user can make queries to the database to report information on everything from overall workload characterization and system utilization to the performance of a single thread in a specific application. This is in contrast to other monitoring systems that report aggregate system-wide metrics sampled over a period of time. In this paper, we describe our implementation of PerfMiner as well as present some results from the test deployment of PerfMiner across three different clusters at the Center for Parallel Computers at The Royal Institute of Technology in Stockholm, Sweden.

Place, publisher, year, edition, pages
2005. Vol. 3648, 124-133 p.
Series
LECTURE NOTES IN COMPUTER SCIENCE, ISSN 0302-9743 ; 3648
National Category
Computer and Information Science
Identifiers
URN: urn:nbn:se:kth:diva-42722ISI: 000232259500017Scopus ID: 2-s2.0-27144432473ISBN: 3-540-28700-0 (print)OAI: oai:DiVA.org:kth-42722DiVA: diva2:448095
Conference
11th International Euro-Par Conference Location: Lisbon, PORTUGAL Date: AUG 30-SEP 02, 2005
Note

QC 20111014

Available from: 2011-10-14 Created: 2011-10-12 Last updated: 2016-12-21Bibliographically approved

Open Access in DiVA

No full text

Scopus

Search in DiVA

By author/editor
Mucci, Philip J.Ahlin, DanielDanielsson, JohanEkman, PerMalinowski, Lars
By organisation
Centre for High Performance Computing, PDC
Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 45 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf