Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Real-Time Reactive Platform for Data Integration and Event Stream Processing
KTH, School of Information and Communication Technology (ICT).
2014 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

This thesis presents a Real-time Reactive platform for Data Integration and Event Stream Processing. The Data Integration part is composed of data pullers that incrementally pull data changes from REST data sources and propagates them as streams of immutable events across the system according to the Event-Sourcing principle. The Stream Processing part is a Tree-like structure of event-sourced stream processors where a processor can react in various ways to events sent by its parent and send derived sub-streams of events to child processors. A processor use case is maintaining a pre-computed view on aggregated data, which allows to define low read latency business dashboards that are updated in real-time.

The platform follows the Reactive architecture principles to maximize performance and minimize resource consumption using an asynchronous nonblocking architecture with an adaptive push-pull stream processing model with automatic back-pressure. Moreover, the platform uses functional programming abstractions for simple and composable asynchronous programming. Performance tests have been performed on a prototype application, which validates the architecture model by showing expected performance patterns concerning event latency between the top of the processing tree and the leaves, and expected fault-tolerance behaviours with acceptable recovery times.

Place, publisher, year, edition, pages
2014. , 90 p.
Series
TRITA-ICT-EX, 2014:100
National Category
Computer and Information Science
Identifiers
URN: urn:nbn:se:kth:diva-177203OAI: oai:DiVA.org:kth-177203DiVA: diva2:871995
Examiners
Available from: 2015-12-08 Created: 2015-11-17 Last updated: 2017-08-03Bibliographically approved

Open Access in DiVA

fulltext(1634 kB)30 downloads
File information
File name FULLTEXT01.pdfFile size 1634 kBChecksum SHA-512
b40d3c275f87e8ba7ed79fbc1c4f0791ccdaa79944beadf58c50a2467096b60f63f58a7b99bda751dbfc40e96ca5bd976f419546d1a7232ad43141a73003f2c2
Type fulltextMimetype application/pdf

By organisation
School of Information and Communication Technology (ICT)
Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 30 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 36 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf