kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Integrating FTS in the Fenix HPC infrastructure
Forschungszentrum Julich, Julich Supercomp Ctr, D-52425 Julich, Germany..
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST).ORCID iD: 0000-0001-7296-7817
CERN, CH-1211 Geneva 23, Switzerland..
CINECA, I-40033 Casalecchio Di Reno, Italy..
Show others and affiliations
2024 (English)In: 26th international conference on computing in high energy and nuclear physics, CHEP 2023 / [ed] Espinal, X DeVita, R Laycock, P Shadura, O, EDP Sciences , 2024, Vol. 295, article id 01037Conference paper, Published paper (Refereed)
Abstract [en]

As compute requirements in experimental high-energy physics are expected to significantly increase, there is a need for leveraging high-performance computing (HPC) resources. However, HPC systems are currently organised and operated in a way that this is not easily possible. Here we will focus on a specific e-infrastructure that incorporates HPC resources, namely Fenix, which is based on a consortium of 6 leading European supercomputing centres. Fenix was initiated through the Human Brain Project (HBP) but also provides resources to other research communities in Europe. The Fenix sites are integrated into a common AAI and provide a so-called Archival Data Repository that can be accessed through a Swift API. In this paper, we report on our efforts to realise a data transfer service that allow to exchange data with the Fenix e-infrastructure. This has been enabled by implementing support of Swift in FTS3 and related software components. We will, in particular, discuss how FTS3 has been integrated into the Fenix AAI, which largely follows the architectural principles of the European Open Science Cloud (EOSC). Furthermore, we show how end-users can use this service through a WebFTS service that has been integrated into the science gateway of the HBP, which is also known as the HBP Collaboratory. Finally, we discuss how transfer commands can be automatically distributed over several FTS3 instances to optimise transfer between different Fenix sites.

Place, publisher, year, edition, pages
EDP Sciences , 2024. Vol. 295, article id 01037
Series
EPJ Web of Conferences, ISSN 2100-014X
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-353118DOI: 10.1051/epjconf/202429501037ISI: 001244151900037Scopus ID: 2-s2.0-85212211207OAI: oai:DiVA.org:kth-353118DiVA, id: diva2:1897365
Conference
26th International Conference on Computing in High Energy and Nuclear Physics (CHEP), May 08-12, 2023, Norfolk, VA, USA
Note

QC 20240912

Available from: 2024-09-12 Created: 2024-09-12 Last updated: 2025-01-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Pleiter, Dirk

Search in DiVA

By author/editor
Pleiter, Dirk
By organisation
Computational Science and Technology (CST)
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 14 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf