Abstract
In recent global business environments, collaborations among organisations raise an increased demand for swift establishment. Such collaborations are formed between organisations entering Virtual Organizations (VOs), crossing geographic borders and frequently without prior experience of the other partner’s previous performance. In VOs, every participant risks engaging with partners who may exhibit unexpected fraudulent or otherwise untrusted behaviour. In order to cope with this risk, the STochastic REputation system (STORE) was designed to provide swift, automated decision support for selecting partner organisations in the early stages of the VO’s formation. The contribution of this paper first consists of a multi-agent simulation framework design and implementation to evaluate the STORE reputation system. This framework is able to simulate dynamic agent behaviour, agents hereby representing organisations, and to capture the business context of different VO application scenarios. A configuration of agent classes is a powerful tool to obtain not only well or badly performing agents for simulation scenarios, but also agents which are specialized in particular VO application domains or even malicious agents, attacking the VO community. The second contribution comprises of STORE’s evaluation in two simulation scenarios, set in the VO application domains of Collaborative Engineering and Ad-hoc Service provisioning. Besides the ability to clearly distinguish between agents of different classes according to their reputation, the results prove STORE’s ability to take an agent’s dynamic behaviour into account. The simulation results show, that STORE solves the difficult task of selecting the most trustworthy partner for a particular VO application domain from a set of honest agents that are specialized in a wide spread of VO application domains.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Strader, T., Lin, F., Shaw, M.: Information structure for electronic virtual organization management. Decision Support Systems, 75–94 (1998)
Robinson, P., Karabulut, Y., Haller, J.: Dynamic virtual organization management for service oriented enterprise applications. In: The First International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2005) (2005)
Cruz, M.G.: Modeling, measuring and hedging operational risk. Wiley, Chichester [u.a.] (2003)
Winkler, T.J., Haller, J., Gimpel, H., Weinhardt, C.: Trust indicator modeling for a reputation service in virtual organizations. In: The 15th European Conference on Information Systems (ECIS) (2006)
Gambetta, D.: Can We Trust Trust? pp. 213–237. Blackwell, Malden (1988); reprinted in electronic edition from Department of Sociology, University of Oxford, ch. 13
Haller, J.: A stochastic approach for trust management. In: International Workshop on Security and Trust in Decentralized/Distributed Data Structures (STD3S) (2006)
Josang, A., Ismail, R., Boyd, C.: A survey of trust and reputation systems for online service provision. Decision Support Systems (August 2004)
Blaze, M., Feigenbaum, J., Lacy, J.: Decentralized trust management. In: SP 1996: Proceedings of the 1996 IEEE Symposium on Security and Privacy, Washington, DC, USA, p. 164. IEEE Computer Society, Los Alamitos (1996)
Egger, F.N.: From Interactions to Transactions: Designing the Trust Experience for Business-to-Consumer Electronic Commerce (2003)
Mui, L., Mohtashemi, M., Halberstadt, A.: A computational model of trust and reputation. In: 35th Annual Hawaii International Conference on System Sciences (HICSS-35), vol. 7, p. 188 (2002)
Ismail, R., Josang, A.: The beta reputation system. In: Proceedings of the 15th Bled Conference on Electronic Commerce (2002)
Teacy, W.T.L., Patel, J., Jennings, N.R., Luck, M.: Travos: Trust and reputation in the context of inaccurate information sources (2006)
Regan, K., Cohen, R., Poupart, P.: Bayesian reputation modeling in e-marketplaces sensitive to subjectivity, deception and change. In: Twenty-First National Conference on Artificial Intelligence (AAAI) (2006)
Josang, A., Haller, J.: Dirichlet reputation systems. In: The 2nd International Conference on Availability, Reliability and Security (ARES) (2007)
Mui, L., Mohtashemi, M., Halberstadt, A.: Notions of reputation in multi-agents systems: a review. In: Proceedings of the first international joint conference on Autonomous agents and multiagent systems, pp. 280–287. ACM Press, New York (2002)
Kearney, P. (ed.): Case study scenarios- WP11 problem definition. TrustCoM (IST Framework 6 integrated project, grant 001945) public deliverable (2004)
Gale, D., Shapley, L.S.: College admissions and the stability of marriage. American Mathematical Monthly 69, 9–14 (1962)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Andrulis, J., Haller, J., Weinhardt, C., Karabulut, Y. (2009). Evaluating the STORE Reputation System in Multi-Agent Simulations. In: Ferrari, E., Li, N., Bertino, E., Karabulut, Y. (eds) Trust Management III. IFIPTM 2009. IFIP Advances in Information and Communication Technology, vol 300. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02056-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-02056-8_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02055-1
Online ISBN: 978-3-642-02056-8
eBook Packages: Computer ScienceComputer Science (R0)