kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
μWheel: Aggregate Management for Streams and Queries
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.ORCID iD: 0000-0003-1149-5021
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS. RISE Research Institutes of Sweden, Stockholm, Sweden.ORCID iD: 0000-0002-9351-8508
2024 (English)In: DEBS 2024 - Proceedings of the 18th ACM International Conference on Distributed and Event-Based Systems, Association for Computing Machinery (ACM) , 2024, p. 54-65Conference paper, Published paper (Refereed)
Abstract [en]

Aggregate management is equally significant for both streaming and query workloads. However, the prevalent approach of separating stream processing and query analysis impairs performance, hinders aggregate reuse, increases resource demands, and lowers data freshness. μWheel addresses this problem by unifying aggregate management needs within a single system optimized for continuous event streams. μWheel pre-aggregates and indexes timestamped data arriving out-of-order, enabling the sharing of aggregates across arbitrary time intervals while respecting low watermarks. Our performance analysis demonstrates that μWheel dramatically outperforms current aggregate sharing techniques for high-volume streaming, particularly when handling numerous concurrent window slides. Crucially, μWheel also delivers performance comparable to specialized pre-aggregation indexes for supporting ad-hoc queries and does so with significantly reduced storage requirements. μWheel's efficiency stems from its compact wheel-based data layout, featuring implicit timestamps, a query-agnostic time hierarchy, and a query optimizer designed to minimize aggregate operations.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2024. p. 54-65
Keywords [en]
aggregate management, embedded analytics, stream processing
National Category
Computer Sciences Communication Systems
Identifiers
URN: urn:nbn:se:kth:diva-351923DOI: 10.1145/3629104.3666031ISI: 001283849100007Scopus ID: 2-s2.0-85200696289OAI: oai:DiVA.org:kth-351923DiVA, id: diva2:1890139
Conference
18th ACM International Conference on Distributed and Event-Based Systems, DEBS 2024, Villeurbanne, France, Jun 25 2024 - Jun 28 2024
Note

Part of ISBN 9798400704437

QC 20240910

Available from: 2024-08-19 Created: 2024-08-19 Last updated: 2025-12-05Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Meldrum, MaxCarbone, Paris

Search in DiVA

By author/editor
Meldrum, MaxCarbone, Paris
By organisation
Software and Computer systems, SCS
Computer SciencesCommunication Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 74 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf