Change search
ReferencesLink to record
Permanent link

Direct link
A Real-Time Reactive Platform for Data Integration and Event Stream Processing
KTH, School of Information and Communication Technology (ICT).
2014 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

This thesis presents a Real-time Reactive platform for Data Integration and Event Stream Processing. The Data Integration part is composed of data pullers that incrementally pull data changes from REST data sources and propagates them as streams of immutable events across the system according to the Event-Sourcing principle. The Stream Processing part is a Tree-like structure of event-sourced stream processors where a processor can react in various ways to events sent by its parent and send derived sub-streams of events to child processors. A processor use case is maintaining a pre-computed view on aggregated data, which allows to define low read latency business dashboards that are updated in real-time.

The platform follows the Reactive architecture principles to maximize performance and minimize resource consumption using an asynchronous nonblocking architecture with an adaptive push-pull stream processing model with automatic back-pressure. Moreover, the platform uses functional programming abstractions for simple and composable asynchronous programming. Performance tests have been performed on a prototype application, which validates the architecture model by showing expected performance patterns concerning event latency between the top of the processing tree and the leaves, and expected fault-tolerance behaviours with acceptable recovery times.

Place, publisher, year, edition, pages
2014. , 90 p.
TRITA-ICT-EX, 2014:100
National Category
Computer and Information Science
URN: urn:nbn:se:kth:diva-177203OAI: diva2:871995
Available from: 2015-12-08 Created: 2015-11-17 Last updated: 2015-12-08Bibliographically approved

Open Access in DiVA

No full text

By organisation
School of Information and Communication Technology (ICT)
Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 21 hits
ReferencesLink to record
Permanent link

Direct link