Resource federation in grid using automated intelligent agent negotiation

https://doi.org/10.1016/j.future.2010.05.012Get rights and content

Abstract

This paper provides a novel approach for enabling grid users to perform resource federation using intelligent agent negotiation. The features of agents including autonomous and distributed are designed to address the federation problems in grid, such as resource selection and policy reconciliation. Early work of resource federation is still highly depending on resource administrator (a person who manages the resources for corresponding institute). In this paper, automated agent negotiation in grid is presented to maximize the satisfaction level of federation outcome for involving parties. Using a new conflict resolution technique–creative negotiation, is introduced in solving communication problems during negotiation. A framework of automated negotiation with conflict resolution–select, match, negotiate and expand (SMNE) protocol, is proposed to guide resource administrators in performing resource federation with intelligent agent. According to the experimental result, the proposed SMNE protocol is able to guide resource administrator in conflict resolution when negotiated parties are unable to make further a concession in resource federation.

Introduction

Grid computing [1] is an infrastructure to enable heterogeneous resources to be shared dynamically between various parties. The parties involved can federate for a period of time as a team or given a name as Virtual Organization (VO) [2], [3]. The process of aggregating resources within distributed VOs is called resource federation. The federation of resources is not limited to computer and storage, but also other scientific instruments and devices. The accessibility of each resource has a set of rules imposed by corresponding owners to avoid overloading of tasks during resource federation. This set of rules is known as policy in this paper.

A policy is a plan of actions to guide decisions and actions of individuals or groups. The term “policy” mentioned in this paper is referring to resource usage policy [2] which defines the access and usage over resources. As shown in Fig. 1, a policy is detailed with different criteria. Those criteria listed out the terms and conditions in resource accessibility, such as the object to be shared (data server), the parties who are allowed to utilize (UTAR members) and restrictions of sharing (share data storage for 3 days with maximum storage of 2 TB).

Before resource federation, every local administrator may impose a set of resource usage policy [4] on a particular resource (e.g. CPU usage, disk storage and network bandwidth) to allow a third party (a party who responsible to construct a VO) to perform resource selection [5], [6]. The third party or VO administrator will classify and select the appropriate resources from different domains to construct a VO by referring to resource usage policies. The VO administrator is responsible in the selection of the best candidate to join a VO. However, the resource selection is a difficult task since every local administrator has different interests and aims (self-interest) when contributing resources to a VO. In most of the cases, policy applied on a particular resource is complex, thus increasing the burden of a VO administrator. Sometimes, much effort and time are spent to generate a mutual acceptance between VO administrator and participant but failed. Would it be a better solution to look for another VO participant (may time and effort consuming) or resolve the current negotiation problem? What if the current VO participant is the only available candidate?

Due to these difficulties, an automated policy reconciliation method is needed to reduce the workload for VO administrator in resource federation. In this paper, a concept of Creative Negotiation [7] which yet to be applied in automated conflict resolution with agent technologies is proposed. Using autonomous agent in resource federation becomes state-of-the-art in current grid domain [8]. However, the feasibility of autonomous agent with appropriate features is still an opened issue. In this paper, several policy reconciliation techniques from manual to automatic are being studied, and a novel automated negotiation and conflict resolution protocol is proposed using intelligent agent for resource federation. A comparison of different approaches in resource federation is also analyzed via a multi-agent system (MAS) grid simulator.

The rest of the paper is as follows; Section 2 discusses the related work on agent negotiation in resource federation. Section 3 gives description on creative negotiation, policy representation and SMNE protocol. Two scenarios require creative negotiation are also described in this section. Section 4 presents the implementation of MAS in grid simulation. Section 5 explains the experimental setting, evaluation criteria and experimental results. Last section is the conclusion with future work.

Section snippets

Resource federation with intelligent agent negotiation

Resource federation in grid emphasizes flexible, secure and scalable transaction. Higher flexibility of federation context and secure resource accessibility provide a more scalable VO because all resource administrators have more confidence during resource contribution and consumption. However, these characteristics created several challenges in particularly on user authentication and authorization, resource allocation and resource monitoring. In this paper, a mechanism to provide flexible

Creative negotiation in policy reconciliation

According to the research of multi-agent automated negotiation in [6], a one-to-many resource selection protocol with one-to-one policy reconciliation framework is proposed. The framework is tested and performed well with variable set of experimental data [33]. The variety of experimental data included multiple quantitative and qualitative policy criteria and also different sizes and structures of VO. These set of data is purposely generated to represent a dynamic grid environment with

Automated multi-agent grid simulation

Java Agent Development Extension Framework (JADEX) [46] is chosen as the agent development tool in this research. JADEX is applied because of the outstanding embedded reasoning engine—Belief–Desire–Intention (BDI) model [47]. The concept of BDI is applied in performing decision making according to human mental attitudes. This concept is adopted by the automated agent in this research since the agent is required to perform negotiation according to administrator preference. Besides BDI reasoning

Experimental design

In experimental design, a multi-agent simulation test bed with 11 machines has been adopted. As shown in Fig. 7, these machines are connected through a network switch. Each machine may host different numbers of agents in each experiment scenario. Each agent represents as a local administrator for particular local resource. Each of them may own resource usage policy with different criteria and values during the simulation. Furthermore, each machine is equipped with different machine

Conclusion and future works

This study has presented an idea of creative negotiation which applied in select, match, negotiate and expand (SMNE) protocol to assist resource administrators in performing automated negotiation using multi-agent system. Overall, the results have shown that creative negotiation approach is able to perform conflicts resolution in several scenarios and achieve a mutual acceptance. The first experiment has proved the reliability of intelligent agent with BDI model in automated negotiation. The

Wai-Khuen Cheng is currently an assistant professor in the Faculty of Information and Communication Technology (FICT) at Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and Ph.D. Degrees from Universiti Sains Malaysia in 2004 and 2009, respectively. His research interests include grid computing, multi-agent system, multi-criteria analysis and artificial intelligence.

References (47)

  • W. Edwards et al.

    SMARTS and SMARTER: improved simple methods for multiattribute utility measurement

    Organizational Behavior and Human Decision Processes

    (1994)
  • I. Foster et al.

    The Grid: Blueprint for a New Computing Infrastructure

    (1999)
  • I. Foster et al.

    The anatomy of grid—enabling scalable virtual organization

    International Journal of Supercomputer Applications

    (2001)
  • B.R. Katzy, Design and Implementation of Virtual Organizations, in: 31st Hawaii International Conference on System...
  • S. Godik, A. Anderson, B. Parducci, P. Humenn, et al. OASIS—eXtensible Access Control Markup Language (XACML), accessed...
  • I. Foster et al.

    Globus: a metacomputing infrastructure toolkit

    International Journal Supercomputer Applications

    (1997)
  • W.K. Cheng et al.

    A framework for multi-agent negotiation system using adaptive fuzzy logic in resource allocation

    International Journal on Information Technology (IJIT), Information Communication Institute of Singapore (ICIS)

    (2005)
  • Gregorio Billikopf, Chapter 18: Creative Negotiation, in: Labor Management Agriculture: Cultivating Personnel...
  • I. Foster, N.R. Jennings, C. Kesselman, Brain meets brawn: why Grid and agents need each other, in: 3rd International...
  • I. Djordjevic et al.

    Towards dynamic security perimeters for virtual collaborative networks

  • S. Naqvi, P. Mori, Security and trust management for virtual organisations: gridtrust approach, in: IFIP International...
  • K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, S. Tuecke, A Resource Management Architecture...
  • R. Raman, M. Livny, M. Solomon, Matchmaking: distributed resource management for high throughput computing, in:...
  • R. Raman, M. Livny, M. Solomon, Policy driven heterogeneous resource co-allocation with gangmatching, in: Proceedings...
  • O. Lassila, R.S. Ralph, Resource description framework (RDF) model and syntax, in Technical report...
  • K. Czajkowski, Df. Ferguson, I. Foster, J. Frey, S. Graham, et al. The WS-Resource Framework, accessed in 2004 at URL:...
  • Roy T. et al.

    Principled design of the modern web architecture

    ACM Transactions on Internet Technology

    (2002)
  • D. Russell, P. Dew, K. Djemame, Access control for dynamic virtual organisations, in: Proceedings of the UK e-Science...
  • Xie Jingming, Qi Deyu, A spaces based coordination model for virtual organizations, in: International Symposium on...
  • Cray Research, Introducing NQE, Document number in-2153 2/97, Technical report, Cray Research,...
  • R. Henderson, D. Tweten, Portable Batch System: External reference specification, NASA Technical report, Ames Research...
  • S. Zhou, LSF: load sharing in large-scale heterogeneous distributed systems, in: Proceedings of Workshop on Cluster...
  • A.S. Grimsaw, W.A. Wulf, Legion—a view from 50,000 Feet, in: Proceedings of the Fifth IEEE International Symposium on...
  • Cited by (14)

    • A novel approach to optimize workflow in grid-based teleradiology applications

      2016, Computer Methods and Programs in Biomedicine
      Citation Excerpt :

      Radiologist characteristics [31,32] and expert ratings are used as initial indicators and report quality feedback [33] is utilized to recalculate the corresponding ratings. In previous research studies, multiple types of workflow optimization and semantic matching strategies are evaluated such as reinforcement learning [29,28], machine learning (SVM, Bayes) [34] and relation based negotiation [35]. In this study, a RBSM algorithm enhanced by ILP is utilized as RWOA to design medical image distribution strategy based on reporting workflow optimization.

    • Chargeback for cloud services

      2014, Future Generation Computer Systems
      Citation Excerpt :

      An interesting future work is to quantitatively analyze the effects of the individual factors on chargeback factors leading towards the ranking of the factors based on importance and allow for an investigation why certain factors in chargeback are effective and what can be done to effectively improve chargeback. It would be interesting to see if models that exploit non-dedicated resources for cloud/grid computing [48,65–67] could be integrated with chargeback models. This would allow for a synergy between economic and technical aspects which would be compelling, but also integrating just the economic perspectives of both non-dedicated resource exploitation with chargeback modeling would be an interesting case as it potentially could show the economic value of both models.

    • A time-constrained SLA negotiation strategy in competitive computational grids

      2012, Future Generation Computer Systems
      Citation Excerpt :

      In this paper we tackle the subject of automating SLA negotiation in computational grids, with competing participants and under time constraints. Previous work regarding SLA negotiation in grids [2,4,11–19] focuses on devising SLA negotiation frameworks using bargaining models with agents employing various concession-based strategies. However, negotiation time is not explicitly considered as a resource and opponent modeling is absent.

    • Cost-benefit analysis of an SLA mapping approach for defining standardized Cloud computing goods

      2012, Future Generation Computer Systems
      Citation Excerpt :

      There is a large body of work about managing resource provisions, negotiations, and federation of Cloud and Grid resources. An example is [8]. They designed agent technology to address the federation problems in Grids, i.e., resource selection and policy reconciliation. [9]

    • SLA enabled CARE resource broker

      2011, Future Generation Computer Systems
      Citation Excerpt :

      The formal SLA specification, integration and calculation of remaining execution time are not addressed in this model. The literature [25] explains about the methodology to federate multiple resources using agent negotiation. In our current work, we implement the proposed GSMA architecture as grid services and integrate it with CRB in order to ensure that the user’s QoS requirements are fulfilled till the end of the execution.

    View all citing articles on Scopus

    Wai-Khuen Cheng is currently an assistant professor in the Faculty of Information and Communication Technology (FICT) at Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and Ph.D. Degrees from Universiti Sains Malaysia in 2004 and 2009, respectively. His research interests include grid computing, multi-agent system, multi-criteria analysis and artificial intelligence.

    Boon-Yaik Ooi is a Ph.D. candidate from the School of Computer Sciences, Universiti Sains Malaysia. He is currently working as a lecturer at Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and M.Sc. Degrees from Universiti Sains Malaysia in 2004 and 2007, respectively. He is interested in research related to grid computing and artificial intelligence.

    Huah-Yong Chan is an associate professor in the School of Computer Sciences, Universiti Sains Malaysia (USM), Malaysia. He is also the Chief of the research group of grid computing at USM. He received his Ph.D. Degree from the Université de Franche-Comté, France, in 1999. He is actively involved in grid computing research activities, both, at the national and international level. His research spans from grid computing, to a more specific issues such as resource allocation, load balancing, software agents, and middleware engineering.

    View full text