Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Managing Service Levels in Grid Computing Systems: Quota Policy and Computational Market Approaches
KTH, School of Computer Science and Communication (CSC), Numerical Analysis and Computer Science, NADA.
2007 (English)Licentiate thesis, comprehensive summary (Other scientific)
Abstract [en]

We study techniques to enforce and provision differentiated service levels in Computational Grid systems. The Grid offers simplified provisioning of peak-capacity for applications with computational requirements beyond local machines and clusters, by sharing resources across organizational boundaries. Current systems have focussed on access control, i.e., managing who is allowed to run applications on remote sites. Very little work has been done on providing differentiated service levels for those applications that are admitted. This leads to a number of problems when scheduling jobs in a fair and efficient way. For example, users with a large number of long-running jobs could starve out others, both intentionally and non-intentionally. We investigate the requirements of High Performance Computing (HPC) applications that run in academic Grid systems, and propose two models of service-level management. Our first model is based on global real-time quota enforcement, where projects are granted resource quota, such as CPU hours, across the Grid by a centralized allocation authority. We implement the SweGrid Accounting System to enforce quota allocated by the Swedish National Allocations Committee in the SweGrid production Grid, which connects six Swedish HPC centers. A flexible authorization policy framework allows provisioning and enforcement of two different service levels across the SweGrid clusters; high-priority and low-priority jobs. As a solution to more fine-grained control over service levels we propose and implement a Grid Market system, using a market-based resource allocator called Tycoon. The conclusion of our research is that although the Grid accounting solution offers better service level enforcement support than state-of-the-art production Grid systems, it turned out to be complex to set the resource price and other policies manually, while ensuring fairness and efficiency of the system. Our Grid Market on the other hand sets the price according to the dynamic demand, and it is further incentive compatible, in that the overall system state remains healthy even in the presence of strategic users.

Place, publisher, year, edition, pages
Stockholm: KTH , 2007. , v, 35 p.
Series
Trita-CSC-A, ISSN 1653-5723 ; 2007:6
Keyword [en]
Grid Market, Computational Grid, Service Level Management, QoS, HPC, Grid Middleware
National Category
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-4346ISBN: 978-91-7178-658-6 (print)OAI: oai:DiVA.org:kth-4346DiVA: diva2:11914
Presentation
2007-05-14, Rum 304, KTH, Teknikringen 14, Stockholm, 10:00
Supervisors
Note
QC 20101116Available from: 2007-05-02 Created: 2007-05-02 Last updated: 2010-11-16Bibliographically approved
List of papers
1. A service-oriented approach to enforce Grid resource allocations
Open this publication in new window or tab >>A service-oriented approach to enforce Grid resource allocations
Show others...
2006 (English)In: International Journal of Cooperative Information Systems, ISSN 0218-8430, Vol. 15, no 3, 439-459 p.Article in journal (Refereed) Published
Abstract [en]

We present the SweGrid Accounting System (SGAS) - a decentralized and standards-based system for Grid resource allocation enforcement that has been developed with an emphasis on a uniform data model and easy integration into existing scheduling and workload management software. The system has been tested at the six high-performance computing centers comprising the SweGrid computational resource, and addresses the need for soft, real-time quota enforcement across the SweGrid clusters. The SGAS framework is based on state-of-the-art Web and Grid services technologies. The openness and ubiquity of Web services combined with the fine-grained resource control and cross-organizational security models of Grid services proved to be a perfect match for the SweGrid needs. Extensibility and customizability of policy implementations for the three different parties that the system serves (the user, the resource manager, and the allocation authority) are key design goals. Another goal is end-to-end security and single sign-on, to allow resources to reserve allocations and charge for resource usage on behalf of the user. We conclude this paper by illustrating the policy customization capabilities of SGAS in a simulated setting, where job streams are shaped using different modes of allocation policy enforcement. Finally, we discuss some of the early experiences from the production system.

Keyword
OGSA, Grid, accounting, HPC
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-15950 (URN)10.1142/S0218843006001426 (DOI)000240115600007 ()2-s2.0-33747085152 (Scopus ID)
Note
QC 20100525 QC 20110927. Conference: 2nd International Conference on Service-Oriented Computing. Columbia Univ, New York, NY. NOV, 2004Available from: 2010-08-05 Created: 2010-08-05 Last updated: 2011-09-27Bibliographically approved
2. Service level agreement requirements of an accounting-driven computional grid
Open this publication in new window or tab >>Service level agreement requirements of an accounting-driven computional grid
(English)Manuscript (preprint) (Other academic)
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-26128 (URN)
Note
QC 20101116Available from: 2010-11-16 Created: 2010-11-16 Last updated: 2010-11-16Bibliographically approved
3. The Design implementation and Evaluation of a Market-Based Resource Allocation System
Open this publication in new window or tab >>The Design implementation and Evaluation of a Market-Based Resource Allocation System
(English)Manuscript (preprint) (Other academic)
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-26129 (URN)
Note
QC 20101116Available from: 2010-11-16 Created: 2010-11-16 Last updated: 2010-11-16Bibliographically approved
4. Market-Based Resource Allocation using Price Prediction in a high performance computing Grid for scientific applications
Open this publication in new window or tab >>Market-Based Resource Allocation using Price Prediction in a high performance computing Grid for scientific applications
2006 (English)In: Proceedings of the IEEE International Symposium on High Performance Distributed Computing 2006, 2006, Vol. 15th IEEE International Symposium, 132-143 p.Conference paper, Published paper (Refereed)
Abstract [en]

We present the implementation and analysis of a market-based resource allocation system for computational Grids. Although Grids provide a way to share resources and take advantage of statistical multiplexing, a variety of challenges remain. One is the economically efficient allocation of resources to users from disparate organizations who have their own and sometimes conflicting requirements for both the quantity and quality of services. Another is secure and scalable authorization despite rapidly changing allocations.

Our solution to both of these challenges is to use a market-based resource allocation system. This system allows users to express diverse quantity- and quality-of-service requirements, yet prevents them from denying service to other users. It does this by providing tools to the user to predict and tradeoff risk and expected return in the computational market. In addition, the system enables secure and scalable authorization by using signed money-transfer tokens instead of identity-based authorization. This removes the overhead of maintaining and updating access control lists, while restricting usage based on the amount of money transferred We examine the performance of the system by running a bioinformatics application on a fully operational implementation of an integrated Grid market.

Keyword
Computational methods, Marketing, Multiplexing, Quality of service, Resource allocation, Statistical methods, Computational market, Computing grid, Market based resource allocation system, Quantity of service
National Category
Industrial Biotechnology Information Science
Identifiers
urn:nbn:se:kth:diva-7799 (URN)10.1109/HPDC.2006.1652144 (DOI)000239086500011 ()2-s2.0-33845897137 (Scopus ID)
Conference
The IEEE International Symposium on High Performance Distributed Computing 2006
Note
QC 20100622Available from: 2007-12-10 Created: 2007-12-10 Last updated: 2010-11-16Bibliographically approved

Open Access in DiVA

fulltext(1889 kB)705 downloads
File information
File name FULLTEXT01.pdfFile size 1889 kBChecksum MD5
7d65439e9385ed0be9eb74b7567d226daeee12c995c666cc86b22050f3d6f66071c22699
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Sandholm, Thomas
By organisation
Numerical Analysis and Computer Science, NADA
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 705 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1053 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf