Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Adaptive data management in the ARC Grid middleware
University of Oslo, Nordic Data Grid Facility, Kastrup, Danmark. (Department of Physics)
KTH, Skolan för datavetenskap och kommunikation (CSC), Centra, Parallelldatorcentrum, PDC.
University of Oslo. (Department of Physics)
University of Oslo, Vilnius University Institute of Applied Research. (Department of Physics)
2011 (engelsk)Inngår i: Journal of Physics, Conference Series, ISSN 1742-6588, E-ISSN 1742-6596, Vol. 331, nr 062006Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

The Advanced Resource Connector (ARC) Grid middleware was designed almost 10 years ago, and has proven to be an attractive distributed computing solution and successful in adapting to new data management and storage technologies. However, with an ever-increasing user base and scale of resources to manage, along with the introduction of more advanced data transfer protocols, some limitations in the current architecture have become apparent. The simple first-in first-out approach to data transfer leads to bottlenecks in the system, as does the built-in assumption that all data is immediately available from remote data storage. We present an entirely new data management architecture for ARC which aims to alleviate these problems, by introducing a three-layer structure. The top layer accepts incoming requests for data transfer and directs them to the middle layer, which schedules individual transfers and negotiates with various intermediate catalog and storage systems until the physical file is ready to be transferred. The lower layer performs all operations which use large amounts of bandwidth, i.e. the physical data transfer. Using such a layered structure allows more efficient use of the available bandwidth as well as enabling late-binding of jobs to data transfer slots based on a priority system. Here we describe in full detail the design and implementation of the new system.

sted, utgiver, år, opplag, sider
2011. Vol. 331, nr 062006
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-66434DOI: 10.1088/1742-6596/331/6/062006ISI: 000301120500006Scopus ID: 2-s2.0-84858142842OAI: oai:DiVA.org:kth-66434DiVA, id: diva2:484026
Merknad
QC 20120201Tilgjengelig fra: 2012-01-26 Laget: 2012-01-26 Sist oppdatert: 2018-01-12bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Søk i DiVA

Av forfatter/redaktør
Gholami, Ali
Av organisasjonen
I samme tidsskrift
Journal of Physics, Conference Series

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 232 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf