kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Deploying Stateful Network Functions Efficiently using Large Language Models
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.ORCID iD: 0000-0002-0034-5098
NVIDIA Stockholm, Sweden.
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.ORCID iD: 0000-0002-9780-873X
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.ORCID iD: 0000-0002-9675-9729
Show others and affiliations
2024 (English)In: EuroMLSys 2024 - Proceedings of the 2024 4th Workshop on Machine Learning and Systems, Association for Computing Machinery (ACM) , 2024, p. 28-38Conference paper, Published paper (Refereed)
Abstract [en]

Stateful network functions are increasingly used in data centers. However, their scalability remains a significant challenge since parallelizing packet processing across multiple cores requires careful configuration t o avoid compromising the application’s semantics or performance. This challenge is particularly important when deploying multiple stateful functions on multi-core servers. This paper proposes FlowMage, a system that leverages Large Language Models (LLMs) to perform code analysis and extract essential information from stateful network functions (NFs) prior to their deployment on a server. FlowMage uses this data to find an efficient configuration of an NF chain that maximizes performance while preserving the semantics of the NF chain. Our evaluation shows that, utilizing GPT-4, FlowMage is able to find and apply optimized configuration when deploying stateful NFs chain on a server, resulting in significant p erformance i mprovement (up t o 1 1×) in comparison to the default configuration of the system.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2024. p. 28-38
Keywords [en]
Intra-Server Load Balancing, LLMs, RSS Configuration, Stateful Network Functions, Static Code Analysis
National Category
Computer Systems Communication Systems
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-346539DOI: 10.1145/3642970.3655836ISI: 001221134800004Scopus ID: 2-s2.0-85192276579OAI: oai:DiVA.org:kth-346539DiVA, id: diva2:1858455
Conference
4th Workshop on Machine Learning and Systems, EuroMLSys 2024, held in conjunction with ACM EuroSys 2024, Athens, Greece, Apr 22 2024
Projects
ULTRA
Funder
EU, Horizon 2020, 770889
Note

Part of ISBN 979-840070541-0

QC 20240520

Available from: 2024-05-16 Created: 2024-05-16 Last updated: 2024-12-06Bibliographically approved

Open Access in DiVA

FlowMage(1135 kB)38 downloads
File information
File name FULLTEXT01.pdfFile size 1135 kBChecksum SHA-512
f24e248c7f46282f3a86507dde59e93268f932f28ceb4e9f6a728503163f3c1d859a78fe7d3bafcce862ce49519627add7d46054b85ea6bc24d09ec55cdccb9c
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Scazzariello, MarianoChiesa, MarcoKostic, Dejan

Search in DiVA

By author/editor
Ghasemirahni, HamidScazzariello, MarianoChiesa, MarcoKostic, Dejan
By organisation
Software and Computer systems, SCS
Computer SystemsCommunication Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 38 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 170 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf