kth.sePublikationer KTH
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Conceptualization and scalable execution of big data workflows using domain-specific languages and software containers
SINTEF AS, Forskningsveien 1, N-0373 Oslo, Norway..
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Programvaruteknik och datorsystem, SCS.
Norwegian Univ Sci & Technol NTNU, Teknol Vegen 22, N-2815 Gjovik, Norway..
OsloMet Oslo Metropolitan Univ, Pilestredet 46, N-0167 Oslo, Norway..
Visa övriga samt affilieringar
2021 (Engelska)Ingår i: INTERNET OF THINGS, ISSN 2543-1536, Vol. 16, s. 100440-, artikel-id 100440Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Big Data processing, especially with the increasing proliferation of Internet of Things (IoT) technologies and convergence of IoT, edge and cloud computing technologies, involves handling massive and complex data sets on heterogeneous resources and incorporating different tools, frameworks, and processes to help organizations make sense of their data collected from various sources. This set of operations, referred to as Big Data workflows, requires taking advantage of Cloud infrastructures' elasticity for scalability. In this article, we present the design and prototype implementation of a Big Data workflow approach based on the use of software container technologies, message-oriented middleware (MOM), and a domain-specific language (DSL) to enable highly scalable workflow execution and abstract workflow definition. We demonstrate our system in a use case and a set of experiments that show the practical applicability of the proposed approach for the specification and scalable execution of Big Data workflows. Furthermore, we compare our proposed approach's scalability with that of Argo Workflows - one of the most prominent tools in the area of Big Data workflows - and provide a qualitative evaluation of the proposed DSL and overall approach with respect to the existing literature.

Ort, förlag, år, upplaga, sidor
Elsevier BV , 2021. Vol. 16, s. 100440-, artikel-id 100440
Nyckelord [en]
Big data workflows, Internet of Things, Domain-specific languages, Software containers
Nationell ämneskategori
Datorsystem
Identifikatorer
URN: urn:nbn:se:kth:diva-306770DOI: 10.1016/j.iot.2021.100440ISI: 000723420400012Scopus ID: 2-s2.0-85119205685OAI: oai:DiVA.org:kth-306770DiVA, id: diva2:1622747
Anmärkning

QC 20211223

Tillgänglig från: 2021-12-23 Skapad: 2021-12-23 Senast uppdaterad: 2022-11-28Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Person

Dessalk, Yared DejeneMatskin, MihhailPayberah, Amir H.

Sök vidare i DiVA

Av författaren/redaktören
Dessalk, Yared DejeneMatskin, MihhailPayberah, Amir H.
Av organisationen
Programvaruteknik och datorsystem, SCS
Datorsystem

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 83 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf