Benchmarking Ethernet Interconnect for HPC/AI workloadsShow others and affiliations
2024 (English)In: Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, Institute of Electrical and Electronics Engineers (IEEE) , 2024, p. 869-875Conference paper, Published paper (Refereed)
Abstract [en]
Interconnects have always played a cornerstone role In HPC. Since the Inception of the Top500 ranking, Interconnect statistics have been predominantly dominated by two competing technologies: InfiniBand and Ethernet. However, even if Ethernet is very popular due to versatility and cost-effectiveness, InfiniBand used to provide higher bandwidth and continues to feature lower latency. Industry seeks for a further evolution of the Ethernet standards to enable fast and low-latency interconnect for emerging AI workloads by offering competitive, open-standard solutions. This paper analyzes the early results obtained from two systems relying on an HPC Ethernet interconnect, one relying on 100G and the other on 200G Ethernet. Preliminary findings indicate that the Ethernet-based networks exhibit competitive performance, closely aligning with InfiniBand, especially for large message exchanges.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. p. 869-875
Keywords [en]
ethernet, gigabit ethernet, hpc/ai workloads, infiniband, interconnect
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:kth:diva-360171DOI: 10.1109/SCW63240.2024.00124Scopus ID: 2-s2.0-85217184791OAI: oai:DiVA.org:kth-360171DiVA, id: diva2:1938788
Conference
2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024, Atlanta, United States of America, Nov 17 2024 - Nov 22 2024
Note
Part of ISBN 979-8-3503-5554-3
QC 20250224
2025-02-192025-02-192025-03-24Bibliographically approved