DATACLOUDDSL: Textual and Visual Presentation of Big Data PipelinesShow others and affiliations
2022 (English)In: 2022 IEEE 46TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2022) / [ed] Leong, HV Sarvestani, SS Teranishi, Y Cuzzocrea, A Kashiwazaki, H Towey, D Yang, JJ Shahriar, H, Institute of Electrical and Electronics Engineers (IEEE) , 2022, p. 1165-1171Conference paper, Published paper (Refereed)
Abstract [en]
This paper describes the DATACLOUDDSL language and the DEF-PIPE tool for describing Big Data pipelines. DATACLOUDDSL has both a textual and a visual form and supports requirements obtained both from analyzing existing data pipeline specification tools and from interviews with relevant industrial actors. Particularly, DATACLOUDDSL supports (i) separation of concerns between design and run-time issues, (ii) reuse of previously developed pipeline steps and pipelines in designing new pipelines, (iii) flexible data transfer between pipelines steps and containerization of pipelines and pipeline steps, and (iv) integration of description and simulation components in Big Data pipeline orchestration systems. Additionally, it provides an interface to the discovery and deployment tools of the DataCloud toolbox.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2022. p. 1165-1171
Keywords [en]
Domain Specific Languages, Computing Continuum, Big Data Pipelines, Visual Pipeline Description
National Category
Other Computer and Information Science
Identifiers
URN: urn:nbn:se:kth:diva-319702DOI: 10.1109/COMPSAC54236.2022.00183ISI: 000855983300175Scopus ID: 2-s2.0-85136915589OAI: oai:DiVA.org:kth-319702DiVA, id: diva2:1706767
Conference
46th Annual IEEE-Computer-Society International Computers, Software, and Applications Conference (COMPSAC) - Computers, Software, and Applications in an Uncertain World, JUN 27-JUL 01, 2022, ELECTR NETWORK
Note
Part of proceedings: ISBN 978-1-6654-8810-5
QC 20221027
2022-10-272022-10-272023-01-16Bibliographically approved