Locality-aware Task Scheduling and Data Distribution on NUMA Systems
2013 (English)In: OpenMP in the Era of Low Power Devices and Accelerators: 9th International Workshop on OpenMP, IWOMP 2013, Canberra, Australia, September 16-18, 2013 / [ed] Alistair P Rendell, Barbara M. Chapman, Matthias S.Müller, Springer Science+Business Media B.V., 2013Conference paper (Refereed)
Modern parallel computer systems exhibit Non-Uniform Memory Access (NUMA) behavior. For best performance, any parallel program therefore has to match data allocation and scheduling of computations to the memory architecture of the machine. When done manually, this becomes a tedious process and since each individual system has its own peculiarities this also leads to programs that are not performance-portable.
We propose the use of a data distribution scheme in which NUMA hardware peculiarities are abstracted away from the programmer and data distribution is delegated to a runtime system which is generated once for each machine. In addition we propose using task data dependence information now possible with the OpenMP 4.0RC2 proposal to guide the scheduling of OpenMP tasks to further reduce data stall times.
We demonstrate the viability and performance of our proposals on a four socket AMD Opteron machine with eight NUMA nodes. We identify that both data distribution and locality-aware task scheduling improves performance compared to default policies while still providing an architecture-oblivious approach for the programmer.
Place, publisher, year, edition, pages
Springer Science+Business Media B.V., 2013.
, Lecture Notes in Computer Science, 8122
IdentifiersURN: urn:nbn:se:kth:diva-124881DOI: 10.1007/978-3-642-40698-0_12ScopusID: 2-s2.0-84883296523ISBN: 978-3-642-40697-3OAI: oai:DiVA.org:kth-124881DiVA: diva2:638662
International Workshop on OpenMP (IWOMP),September 16-18 2013, Canberra, Australia
QC 201309242013-08-012013-08-012014-02-12Bibliographically approved