CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A High-Speed Load-Balancer Design with Guaranteed Per-Connection-Consistency
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Communication Systems, CoS, Network Systems Laboratory (NS Lab).ORCID iD: 0000-0003-1269-2190
KTH, School of Electrical Engineering and Computer Science (EECS).
KTH, School of Electrical Engineering and Computer Science (EECS).
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Communication Systems, CoS, Network Systems Laboratory (NS Lab).ORCID iD: 0000-0002-1256-1070
Show others and affiliations
2020 (English)In: 17th USENIX Symposium on Networked Systems Design and Implementation / [ed] USENIX Association, Santa Clara, CA, USA, 2020, p. 667-683Conference paper, Published paper (Refereed)
Abstract [en]

Large service providers use load balancers to dispatch millions of incoming connections per second towards thousands of servers. There are two basic yet critical requirements for a load balancer: uniform load distribution of the incoming connections across the servers and per-connection-consistency (PCC), i.e., the ability to map packets belonging to the same connection to the same server even in the presence of changes in the number of active servers and load balancers. Yet, meeting both these requirements at the same time has been an elusive goal. Today's load balancers minimize PCC violations at the price of non-uniform load distribution.

This paper presents Cheetah, a load balancer that supports uniform load distribution and PCC while being scalable, memory efficient, resilient to clogging attacks, and fast at processing packets. The Cheetah LB design guarantees PCC for any realizable server selection load balancing mechanism and can be deployed in both a stateless and stateful manner, depending on the operational needs. We implemented Cheetah on both a software and a Tofino-based hardware switch. Our evaluation shows that a stateless version of Cheetah guarantees PCC, has negligible packet processing overheads, and can support load balancing mechanisms that reduce the flow completion time by a factor of 2–3×.

Place, publisher, year, edition, pages
Santa Clara, CA, USA, 2020. p. 667-683
Keywords [en]
load-balancer, cheetah, high-speed, connection consistency, pcc, p4, fastclick
National Category
Communication Systems Computer Systems Computer Sciences
Research subject
Computer Science; Telecommunication
Identifiers
URN: urn:nbn:se:kth:diva-268968ISBN: 978-1-939133-13-7 (electronic)OAI: oai:DiVA.org:kth-268968DiVA, id: diva2:1410769
Conference
NSDI'20
Funder
Swedish Foundation for Strategic Research , TCCEU, European Research Council, 770889
Note

QC 20200302

Available from: 2020-03-01 Created: 2020-03-01 Last updated: 2020-03-02Bibliographically approved

Open Access in DiVA

cheetah.pdf(1563 kB)49 downloads
File information
File name FULLTEXT01.pdfFile size 1563 kBChecksum SHA-512
e031350aea8a210fcb37b285bf43c86ecb424dab4501cb0eed3e087a76c3ee11ccf5011d41e997330a091a30be6de82043c2ca5b91735cee36b40c0f700e1350
Type fulltextMimetype application/pdf

Other links

https://www.usenix.org/conference/nsdi20

Authority records BETA

Barbette, TomTang, ChenYao, HaoranKostic, DejanMaguire Jr., Gerald Q.Papadimitratos, PanagiotisChiesa, Marco

Search in DiVA

By author/editor
Barbette, TomTang, ChenYao, HaoranKostic, DejanMaguire Jr., Gerald Q.Papadimitratos, PanagiotisChiesa, Marco
By organisation
Network Systems Laboratory (NS Lab)School of Electrical Engineering and Computer Science (EECS)Communication Systems, CoS
Communication SystemsComputer SystemsComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 49 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 148 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf