Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Evaluating model serving strategies over streaming data
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Programvaruteknik och datorsystem, SCS.ORCID-id: 0000-0002-8573-0090
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Programvaruteknik och datorsystem, SCS.ORCID-id: 0000-0002-9351-8508
2022 (engelsk)Inngår i: Proceedings of the 6th Workshop on Data Management for End-To-End Machine Learning, DEEM 2022 - In conjunction with the 2022 ACM SIGMOD/PODS Conference, Association for Computing Machinery (ACM) , 2022, artikkel-id 4Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

We present the first performance evaluation study of model serving integration tools in stream processing frameworks. Using Apache Flink as a representative stream processing system, we evaluate alternative Deep Learning serving pipelines for image classification. Our performance evaluation considers both the case of embedded use of Machine Learning libraries within stream tasks and that of external serving via Remote Procedure Calls. The results indicate superior throughput and scalability for pipelines that make use of embedded libraries to serve pre-trained models. Whereas, latency can vary across strategies, with external serving even achieving lower latency when network conditions are optimal due to better specialized use of underlying hardware. We discuss our findings and provide further motivating arguments towards research in the area of ML-native data streaming engines in the future.

sted, utgiver, år, opplag, sider
Association for Computing Machinery (ACM) , 2022. artikkel-id 4
Emneord [en]
data streams, machine learning inference
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-317104DOI: 10.1145/3533028.3533308ISI: 001119155700006Scopus ID: 2-s2.0-85133190958OAI: oai:DiVA.org:kth-317104DiVA, id: diva2:1693181
Konferanse
6th Workshop on Data Management for End-To-End Machine Learning, DEEM 2022 - In conjunction with the 2022 ACM SIGMOD/PODS Conference, 12 June 2022, Virtual, Online
Merknad

QC 20220906

Part of proceedings: ISBN 978-145039375-1

Tilgjengelig fra: 2022-09-06 Laget: 2022-09-06 Sist oppdatert: 2025-12-05bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Horchidan, Sonia-FlorinaCarbone, Paris

Søk i DiVA

Av forfatter/redaktør
Horchidan, Sonia-FlorinaCarbone, Paris
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 172 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf