Change search
ReferencesLink to record
Permanent link

Direct link
Software news and update: Speeding up parallel GROMACS on high-latency networks
Max-Planck Institut Göttingen.
Uppsala University.
Max-Planck Institut Göttingen.
Stockholm University.ORCID iD: 0000-0002-2734-2794
Show others and affiliations
2007 (English)In: Journal of Computational Chemistry, ISSN 0192-8651, E-ISSN 1096-987X, Vol. 28, no 12, 2075-84 p.Article in journal (Refereed) Published
Abstract [en]

We investigate the parallel scaling of the GROMACS molecular dynamics code on Ethernet Beowulf clusters and what prerequisites are necessary for decent scaling even on such clusters with only limited bandwidth and high latency. GROMACS 3.3 scales well on supercomputers like the IBM p690 (Regatta) and on Linux clusters with a special interconnect like Myrinet or Infiniband. Because of the high single-node performance of GROMACS, however, on the widely used Ethernet switched clusters, the scaling typically breaks down when more than two computer nodes are involved, limiting the absolute speedup that can be gained to about 3 relative to a single-CPU run. With the LAM MPI implementation, the main scaling bottleneck is here identified to be the all-to-all communication which is required every time step. During such an all-to-all communication step, a huge amount of messages floods the network, and as a result many TCP packets are lost. We show that Ethernet flow control prevents network congestion and leads to substantial scaling improvements. For 16 CPUs, e.g., a speedup of 11 has been achieved. However, for more nodes this mechanism also fails. Having optimized an all-to-all routine, which sends the data in an ordered fashion, we show that it is possible to completely prevent packet loss for any number of multi-CPU nodes. Thus, the GROMACS scaling dramatically improves, even for switches that lack flow control. In addition, for the common HP ProCurve 2848 switch we find that for optimum all-to-all performance it is essential how the nodes are connected to the switch's ports. This is also demonstrated for the example of the Car-Parinello MD code.

Place, publisher, year, edition, pages
2007. Vol. 28, no 12, 2075-84 p.
National Category
Theoretical Chemistry Software Engineering
URN: urn:nbn:se:kth:diva-82625DOI: 10.1002/jcc.20703ISI: 000248108900018PubMedID: 17405124OAI: diva2:498446
QC 20120302Available from: 2012-02-12 Created: 2012-02-12 Last updated: 2012-03-02Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textPubMed

Search in DiVA

By author/editor
Lindahl, Erik
In the same journal
Journal of Computational Chemistry
Theoretical ChemistrySoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 43 hits
ReferencesLink to record
Permanent link

Direct link