Integrating FTS in the Fenix HPC infrastructureShow others and affiliations
2024 (English)In: 26th international conference on computing in high energy and nuclear physics, CHEP 2023 / [ed] Espinal, X DeVita, R Laycock, P Shadura, O, EDP Sciences , 2024, Vol. 295, article id 01037Conference paper, Published paper (Refereed)
Abstract [en]
As compute requirements in experimental high-energy physics are expected to significantly increase, there is a need for leveraging high-performance computing (HPC) resources. However, HPC systems are currently organised and operated in a way that this is not easily possible. Here we will focus on a specific e-infrastructure that incorporates HPC resources, namely Fenix, which is based on a consortium of 6 leading European supercomputing centres. Fenix was initiated through the Human Brain Project (HBP) but also provides resources to other research communities in Europe. The Fenix sites are integrated into a common AAI and provide a so-called Archival Data Repository that can be accessed through a Swift API. In this paper, we report on our efforts to realise a data transfer service that allow to exchange data with the Fenix e-infrastructure. This has been enabled by implementing support of Swift in FTS3 and related software components. We will, in particular, discuss how FTS3 has been integrated into the Fenix AAI, which largely follows the architectural principles of the European Open Science Cloud (EOSC). Furthermore, we show how end-users can use this service through a WebFTS service that has been integrated into the science gateway of the HBP, which is also known as the HBP Collaboratory. Finally, we discuss how transfer commands can be automatically distributed over several FTS3 instances to optimise transfer between different Fenix sites.
Place, publisher, year, edition, pages
EDP Sciences , 2024. Vol. 295, article id 01037
Series
EPJ Web of Conferences, ISSN 2100-014X
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-353118DOI: 10.1051/epjconf/202429501037ISI: 001244151900037Scopus ID: 2-s2.0-85212211207OAI: oai:DiVA.org:kth-353118DiVA, id: diva2:1897365
Conference
26th International Conference on Computing in High Energy and Nuclear Physics (CHEP), May 08-12, 2023, Norfolk, VA, USA
Note
QC 20240912
2024-09-122024-09-122025-01-07Bibliographically approved