Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Conceptualization and scalable execution of big data workflows using domain-specific languages and software containers
SINTEF AS, Forskningsveien 1, N-0373 Oslo, Norway..
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Programvaruteknik och datorsystem, SCS.
Norwegian Univ Sci & Technol NTNU, Teknol Vegen 22, N-2815 Gjovik, Norway..
OsloMet Oslo Metropolitan Univ, Pilestredet 46, N-0167 Oslo, Norway..
Vise andre og tillknytning
2021 (engelsk)Inngår i: INTERNET OF THINGS, ISSN 2543-1536, Vol. 16, s. 100440-, artikkel-id 100440Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Big Data processing, especially with the increasing proliferation of Internet of Things (IoT) technologies and convergence of IoT, edge and cloud computing technologies, involves handling massive and complex data sets on heterogeneous resources and incorporating different tools, frameworks, and processes to help organizations make sense of their data collected from various sources. This set of operations, referred to as Big Data workflows, requires taking advantage of Cloud infrastructures' elasticity for scalability. In this article, we present the design and prototype implementation of a Big Data workflow approach based on the use of software container technologies, message-oriented middleware (MOM), and a domain-specific language (DSL) to enable highly scalable workflow execution and abstract workflow definition. We demonstrate our system in a use case and a set of experiments that show the practical applicability of the proposed approach for the specification and scalable execution of Big Data workflows. Furthermore, we compare our proposed approach's scalability with that of Argo Workflows - one of the most prominent tools in the area of Big Data workflows - and provide a qualitative evaluation of the proposed DSL and overall approach with respect to the existing literature.

sted, utgiver, år, opplag, sider
Elsevier BV , 2021. Vol. 16, s. 100440-, artikkel-id 100440
Emneord [en]
Big data workflows, Internet of Things, Domain-specific languages, Software containers
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-306770DOI: 10.1016/j.iot.2021.100440ISI: 000723420400012Scopus ID: 2-s2.0-85119205685OAI: oai:DiVA.org:kth-306770DiVA, id: diva2:1622747
Merknad

QC 20211223

Tilgjengelig fra: 2021-12-23 Laget: 2021-12-23 Sist oppdatert: 2022-11-28bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Dessalk, Yared DejeneMatskin, MihhailPayberah, Amir H.

Søk i DiVA

Av forfatter/redaktør
Dessalk, Yared DejeneMatskin, MihhailPayberah, Amir H.
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 82 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf