Resource federation in grid using automated intelligent agent negotiation
Introduction
Grid computing [1] is an infrastructure to enable heterogeneous resources to be shared dynamically between various parties. The parties involved can federate for a period of time as a team or given a name as Virtual Organization (VO) [2], [3]. The process of aggregating resources within distributed VOs is called resource federation. The federation of resources is not limited to computer and storage, but also other scientific instruments and devices. The accessibility of each resource has a set of rules imposed by corresponding owners to avoid overloading of tasks during resource federation. This set of rules is known as policy in this paper.
A policy is a plan of actions to guide decisions and actions of individuals or groups. The term “policy” mentioned in this paper is referring to resource usage policy [2] which defines the access and usage over resources. As shown in Fig. 1, a policy is detailed with different criteria. Those criteria listed out the terms and conditions in resource accessibility, such as the object to be shared (data server), the parties who are allowed to utilize (UTAR members) and restrictions of sharing (share data storage for 3 days with maximum storage of 2 TB).
Before resource federation, every local administrator may impose a set of resource usage policy [4] on a particular resource (e.g. CPU usage, disk storage and network bandwidth) to allow a third party (a party who responsible to construct a VO) to perform resource selection [5], [6]. The third party or VO administrator will classify and select the appropriate resources from different domains to construct a VO by referring to resource usage policies. The VO administrator is responsible in the selection of the best candidate to join a VO. However, the resource selection is a difficult task since every local administrator has different interests and aims (self-interest) when contributing resources to a VO. In most of the cases, policy applied on a particular resource is complex, thus increasing the burden of a VO administrator. Sometimes, much effort and time are spent to generate a mutual acceptance between VO administrator and participant but failed. Would it be a better solution to look for another VO participant (may time and effort consuming) or resolve the current negotiation problem? What if the current VO participant is the only available candidate?
Due to these difficulties, an automated policy reconciliation method is needed to reduce the workload for VO administrator in resource federation. In this paper, a concept of Creative Negotiation [7] which yet to be applied in automated conflict resolution with agent technologies is proposed. Using autonomous agent in resource federation becomes state-of-the-art in current grid domain [8]. However, the feasibility of autonomous agent with appropriate features is still an opened issue. In this paper, several policy reconciliation techniques from manual to automatic are being studied, and a novel automated negotiation and conflict resolution protocol is proposed using intelligent agent for resource federation. A comparison of different approaches in resource federation is also analyzed via a multi-agent system (MAS) grid simulator.
The rest of the paper is as follows; Section 2 discusses the related work on agent negotiation in resource federation. Section 3 gives description on creative negotiation, policy representation and SMNE protocol. Two scenarios require creative negotiation are also described in this section. Section 4 presents the implementation of MAS in grid simulation. Section 5 explains the experimental setting, evaluation criteria and experimental results. Last section is the conclusion with future work.
Section snippets
Resource federation with intelligent agent negotiation
Resource federation in grid emphasizes flexible, secure and scalable transaction. Higher flexibility of federation context and secure resource accessibility provide a more scalable VO because all resource administrators have more confidence during resource contribution and consumption. However, these characteristics created several challenges in particularly on user authentication and authorization, resource allocation and resource monitoring. In this paper, a mechanism to provide flexible
Creative negotiation in policy reconciliation
According to the research of multi-agent automated negotiation in [6], a one-to-many resource selection protocol with one-to-one policy reconciliation framework is proposed. The framework is tested and performed well with variable set of experimental data [33]. The variety of experimental data included multiple quantitative and qualitative policy criteria and also different sizes and structures of VO. These set of data is purposely generated to represent a dynamic grid environment with
Automated multi-agent grid simulation
Java Agent Development Extension Framework (JADEX) [46] is chosen as the agent development tool in this research. JADEX is applied because of the outstanding embedded reasoning engine—Belief–Desire–Intention (BDI) model [47]. The concept of BDI is applied in performing decision making according to human mental attitudes. This concept is adopted by the automated agent in this research since the agent is required to perform negotiation according to administrator preference. Besides BDI reasoning
Experimental design
In experimental design, a multi-agent simulation test bed with 11 machines has been adopted. As shown in Fig. 7, these machines are connected through a network switch. Each machine may host different numbers of agents in each experiment scenario. Each agent represents as a local administrator for particular local resource. Each of them may own resource usage policy with different criteria and values during the simulation. Furthermore, each machine is equipped with different machine
Conclusion and future works
This study has presented an idea of creative negotiation which applied in select, match, negotiate and expand (SMNE) protocol to assist resource administrators in performing automated negotiation using multi-agent system. Overall, the results have shown that creative negotiation approach is able to perform conflicts resolution in several scenarios and achieve a mutual acceptance. The first experiment has proved the reliability of intelligent agent with BDI model in automated negotiation. The
Wai-Khuen Cheng is currently an assistant professor in the Faculty of Information and Communication Technology (FICT) at Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and Ph.D. Degrees from Universiti Sains Malaysia in 2004 and 2009, respectively. His research interests include grid computing, multi-agent system, multi-criteria analysis and artificial intelligence.
References (47)
- et al.
SMARTS and SMARTER: improved simple methods for multiattribute utility measurement
Organizational Behavior and Human Decision Processes
(1994) - et al.
The Grid: Blueprint for a New Computing Infrastructure
(1999) - et al.
The anatomy of grid—enabling scalable virtual organization
International Journal of Supercomputer Applications
(2001) - B.R. Katzy, Design and Implementation of Virtual Organizations, in: 31st Hawaii International Conference on System...
- S. Godik, A. Anderson, B. Parducci, P. Humenn, et al. OASIS—eXtensible Access Control Markup Language (XACML), accessed...
- et al.
Globus: a metacomputing infrastructure toolkit
International Journal Supercomputer Applications
(1997) - et al.
A framework for multi-agent negotiation system using adaptive fuzzy logic in resource allocation
International Journal on Information Technology (IJIT), Information Communication Institute of Singapore (ICIS)
(2005) - Gregorio Billikopf, Chapter 18: Creative Negotiation, in: Labor Management Agriculture: Cultivating Personnel...
- I. Foster, N.R. Jennings, C. Kesselman, Brain meets brawn: why Grid and agents need each other, in: 3rd International...
- et al.
Towards dynamic security perimeters for virtual collaborative networks
Principled design of the modern web architecture
ACM Transactions on Internet Technology
Cited by (14)
A novel approach to optimize workflow in grid-based teleradiology applications
2016, Computer Methods and Programs in BiomedicineCitation Excerpt :Radiologist characteristics [31,32] and expert ratings are used as initial indicators and report quality feedback [33] is utilized to recalculate the corresponding ratings. In previous research studies, multiple types of workflow optimization and semantic matching strategies are evaluated such as reinforcement learning [29,28], machine learning (SVM, Bayes) [34] and relation based negotiation [35]. In this study, a RBSM algorithm enhanced by ILP is utilized as RWOA to design medical image distribution strategy based on reporting workflow optimization.
Chargeback for cloud services
2014, Future Generation Computer SystemsCitation Excerpt :An interesting future work is to quantitatively analyze the effects of the individual factors on chargeback factors leading towards the ranking of the factors based on importance and allow for an investigation why certain factors in chargeback are effective and what can be done to effectively improve chargeback. It would be interesting to see if models that exploit non-dedicated resources for cloud/grid computing [48,65–67] could be integrated with chargeback models. This would allow for a synergy between economic and technical aspects which would be compelling, but also integrating just the economic perspectives of both non-dedicated resource exploitation with chargeback modeling would be an interesting case as it potentially could show the economic value of both models.
A time-constrained SLA negotiation strategy in competitive computational grids
2012, Future Generation Computer SystemsCitation Excerpt :In this paper we tackle the subject of automating SLA negotiation in computational grids, with competing participants and under time constraints. Previous work regarding SLA negotiation in grids [2,4,11–19] focuses on devising SLA negotiation frameworks using bargaining models with agents employing various concession-based strategies. However, negotiation time is not explicitly considered as a resource and opponent modeling is absent.
Cost-benefit analysis of an SLA mapping approach for defining standardized Cloud computing goods
2012, Future Generation Computer SystemsCitation Excerpt :There is a large body of work about managing resource provisions, negotiations, and federation of Cloud and Grid resources. An example is [8]. They designed agent technology to address the federation problems in Grids, i.e., resource selection and policy reconciliation. [9]
SLA enabled CARE resource broker
2011, Future Generation Computer SystemsCitation Excerpt :The formal SLA specification, integration and calculation of remaining execution time are not addressed in this model. The literature [25] explains about the methodology to federate multiple resources using agent negotiation. In our current work, we implement the proposed GSMA architecture as grid services and integrate it with CRB in order to ensure that the user’s QoS requirements are fulfilled till the end of the execution.
Open Science Cloud Federation: background, applications architecture and key technologies
2022, Gaojishu Tongxin/Chinese High Technology Letters
Wai-Khuen Cheng is currently an assistant professor in the Faculty of Information and Communication Technology (FICT) at Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and Ph.D. Degrees from Universiti Sains Malaysia in 2004 and 2009, respectively. His research interests include grid computing, multi-agent system, multi-criteria analysis and artificial intelligence.
Boon-Yaik Ooi is a Ph.D. candidate from the School of Computer Sciences, Universiti Sains Malaysia. He is currently working as a lecturer at Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Malaysia. He received his B.Sc. and M.Sc. Degrees from Universiti Sains Malaysia in 2004 and 2007, respectively. He is interested in research related to grid computing and artificial intelligence.
Huah-Yong Chan is an associate professor in the School of Computer Sciences, Universiti Sains Malaysia (USM), Malaysia. He is also the Chief of the research group of grid computing at USM. He received his Ph.D. Degree from the Université de Franche-Comté, France, in 1999. He is actively involved in grid computing research activities, both, at the national and international level. His research spans from grid computing, to a more specific issues such as resource allocation, load balancing, software agents, and middleware engineering.