Abstract
Negotiation has been extensively discussed in game-theoretic, economic, and management science literatures for decades. Recent growing interest in autonomous interacting software agents and their potential application in areas such as electronic commerce has given increased importance to automated negotiation. Evidence both from theoretical analysis and from observations of human interactions suggests that if decision makers can somehow take into consideration what other agents are thinking and furthermore learn during their interactions how other agents behave, their payoff might increase. In this paper, we propose a sequential decision making model of negotiation, called Bazaar. It provides an adaptive, multi-issue negotiation model capable of exhibiting a rich set of negotiation behaviors. Within the proposed negotiation framework, we model learning as a Bayesian belief update process. We prove that under certain conditions learning is indeed beneficial.
This research has been sponsored in part by ONR grant #N00014-95-1-1092 and by ARPA Grant #F33615-93-1-1330.
Preview
Unable to display preview. Download preview PDF.
References
Ravi Anupindi. Supply Management Under Uncertainty. PhD thesis, Graduate School of Industrial Administration, Carnegie Mellon University, 1993.
Dimitri P. Bertsekas. Dynamic Programming and Optimal Control. Athena Scientific, Belmont, MA, 1995.
Morris A. Cohen and Hau L. Lee. Strategic analysis of integrated production-distribution systems: Models and methods. Operations Research, 36(2):216–228, 1988.
Richard M. Cyert and Morris H. DeGroot. Bayesian analysis and uncertainty in economic theory. Rowman & Littlefield, 1987.
P. J. Gmytrasiewicz and E. H. Durfee. Logic of knowledge and belief for recursive modeling: Preliminary report. In Proceedings of the National Conference on Artificial Intelligence, pages 628–634, July 1992.
John C. Harsanyi and R. Selten. A generalized nash solution for two-person bargaining games with incomplete information. Management Science, 18:80–106, 1972.
J. S. Jordan. The exponential covergence of bayesian learning in normal form games. Games and Economic Behavior, 4:202–217, 1992.
Ehud Kalai and Ehud Lehrer. Rational learning leads to nash equilibrium. Econometrica, 61(5):1019–1045, September 1993.
S. Kraus and V. S. Subrahmanian. Multiagent reasoning with probability, time, and beliefs. International Journal of Intelligent Systems, 10(5):459–499, May 1995.
Hau L. Lee and Corey Billington. 1992. Sloan Management Review, pages 65–73, Spring 1992.
R. Duncan Luce and Howard Raiffa. Games and decisions; introduction and critical surveyl. New York, Wiley, 1957.
Yishay Mor, Claudia V. Goldman, and Jeffrey S. Rosenschein. Learn your opponent's strategy (in polynomial time). In Proceedings of IJCAI-95 Workshop on Adaptation and Learning in Multiagent Systems, 1995.
Martin J. Osborne and Ariel Rubinstein. A course in game theory. The MIT Press, 1994.
Judea Pearl. Proabilistic reasoning in intelligent systems. Morgan Kaufmann Publishers, Inc., second edition, 1988.
J. Rosenschein and G. Zlotkin. Rules of Encounter. MIT Press, Cambridge, Mass., 1994.
Tuomas W. Sandholm and Victor R. Lesser. Coalition fromation among bounded rational agents. In Proceedings of 14th International Joint Conference on Artificial Intelligence, 1995.
Sandip Sen and Mahendra Sekaran. Multiagent coordination with learning classifier systems. In Proceedings of IJCAI-95 Workshop on Adaptation and Learning in Multiagent Systems, 1995.
K. Sycara. Negotiation planning: An AI approach. European Journal of Operational Research, 46:216–234, 1990.
Oran R. Young. Bargaining: formal theories of negotiation. University of Illinois Press, 1975.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zeng, D., Sycara, K. (1997). How can an agent learn to negotiate?. In: Müller, J.P., Wooldridge, M.J., Jennings, N.R. (eds) Intelligent Agents III Agent Theories, Architectures, and Languages. ATAL 1996. Lecture Notes in Computer Science, vol 1193. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0013589
Download citation
DOI: https://doi.org/10.1007/BFb0013589
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62507-0
Online ISBN: 978-3-540-68057-4
eBook Packages: Springer Book Archive