Skip to main content
SpringerLink
Log in

Solving a Dynamic User-Optimal Route Guidance Problem Based on Joint Strategy Fictitious Play

  • Chapter
  • First Online:
Game Theoretic Analysis of Congestion, Safety and Security

Part of the book series: Springer Series in Reliability Engineering ((RELIABILITY))

Abstract

Dynamic route guidance systems aim to provide users with on-line information on traffic conditions and suggest relevant route guidance to facilitate route choices for users. In this study, we consider the problem as a multi-player repeated game in a dynamic multi-agent transportation system. We propose a game theory approach based on joint strategy fictitious play by explicitly modeling users’ compliances to route recommendations as an inertia term. Each guided user makes his travel time estimations and local outgoing link decisions based on his historical experiences and traffic time information received en-route as provided by a system administrator. Based on the travel times estimated en-route, users adapt their route choices progressively via fast routes to their destinations. The dynamic user-optimal route guidance problem is formulated as a variational inequality problem in a queue-based traffic flow model. We show that the proposed approach can solve a dynamic user-optimal route guidance problem based on users’ local outgoing link choice decisions. The numerical studies are implemented by considering two classes of users in the system: informed and non-informed users. The results demonstrate the convergence of the proposed algorithm and highlight significant travel times and delay reduction in a congested situation. Although the user-compliance mechanism for the route recommendations is currently modeled as a static term, it provides rooms for further improvement based on more realistic compliance mechanisms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note that one can also incorporate the learning behavior of non-guided users in the URG problem and solve the corresponding fixed point problem for both classes of users [6].

References

  1. Aichinger C, Aigner-breuss E, Aleksa M, Kaiser S, Müller A, Russwurm K (2014) Evaluation of navigation systems from a road safety perspective. Paper presented in european conference on human centered design for intelligent transport systems, Vienna, Austria

    Google Scholar 

  2. Balakrishna R, Koutsopoulos HN, Ben-Akiva M, Fernandez-Ruiz BM, Mehta M (2005) Simulation-based evaluation of advanced traveler information systems. Transp Res Rec 1910:90–98

    Article  Google Scholar 

  3. Ben-Akiva M, Bierlaire M, Bottom J, Koutsopoulos HN, Mishalani R (1997) Development of a route guidance generation system for real-time application. In: Proceedings of the 8th IFAC symposium on transportation systems, Chania, Greece

    Google Scholar 

  4. Berger U (2007) Two more classes of games with the continuous-time fictitious play property. Games Econ Behav 60(2):247–261

    Article  MATH  Google Scholar 

  5. Bottom JA (2000) Consistent anticipatory route guidance. Ph.D. thesis, Massachusetts institute of technology

    Google Scholar 

  6. Bottom J, Kachani S, Perakis G (2006) The anticipatory route guidance problem: Formulations, analysis and computational results. Working paper

    Google Scholar 

  7. Brown GW (1951) Iterative solution of games by fictitious play. In: Activity analysis of production and allocation. Wiley, New York

    Google Scholar 

  8. Chen B, Xie Y, Tong W, Dong C, Shi D, Wang B (2012) A comprehensive study of advanced information feedbacks in real-time intelligent traffic systems. Phys A 391:2730–2739

    Article  Google Scholar 

  9. Chorus CG, Dellaert BGC (2012) Travel choice inertia: The joint role of risk aversion and learning. J Transp Econ Policy 46(1):139–155

    Google Scholar 

  10. Chorus CG, Arentze TA, Timmermans HJP (2009) Traveler compliance with advice: A Bayesian utilitarian perspective. Transp Res Part E 45:486–500

    Article  Google Scholar 

  11. Chorus CG, Walker JL, Ben-Akiva M (2013) A joint model of travel information acquisition and response to received messages. Transp Res Part C 26:61–77

    Article  Google Scholar 

  12. Cominetti R, Melo E, Sorin S (2010) A payoff-based learning procedure and its application to traffic games. Games Econ Behav 70(1):71–83

    Article  MATH  MathSciNet  Google Scholar 

  13. Correa JR, Stier-Moses NE (2011) Wardrop equilibria. Wiley encyclopedia of operations research and management science. Wiley, New York

    Google Scholar 

  14. Crittin F, Bierlaire M (2003) Solving the anticipatory route guidance generation problem using a generalization of secant methods. In: Proceedings of the 3rd swiss transport research conference, Monte Verità

    Google Scholar 

  15. Deflorio FP (2003) Evaluation of a reactive dynamic route guidance strategy. Transp Res Part C 11(5):375–388

    Article  Google Scholar 

  16. Dong CF, Ma X, Wang GW, Sun XY, Wang BH (2009) Prediction feedback in intelligent traffic systems. Phys A 388:4651–4657

    Article  Google Scholar 

  17. Dong CF, Ma X, Wang BH, Sun XY (2010) Effects of prediction feedback in multi-route intelligent traffic systems. Phys A 389:3274–3281

    Article  Google Scholar 

  18. Friesz T, Mookherjee R (2006) Solving the dynamic network user equilibrium problem with state-dependent time shifts. Transp Res Part B 40:207–229

    Article  Google Scholar 

  19. Friesz TL, Bernstein D, Smith T, Tobin R, Wie B (1993) A variational inequality formulation of the dynamic network user equilibrium problem. Oper Res 41:80–91

    Article  MathSciNet  Google Scholar 

  20. Fudenberg D, Levine DK (1998) The theory of learning in games. MIT Press, Cambridge, MA

    MATH  Google Scholar 

  21. Gaetani F, Minciardi R (2002) Dynamic models and optimal control methods for route guidance in urban traffic networks. The 5th IEEE international conference on intelligent transportation systems, Singapore, pp 454 – 459

    Google Scholar 

  22. Gao S, Huang H (2012) Real-time traveler information for optimal adaptive routing in stochastic time-dependent networks. Transp Res Part C 21:196–213

    Article  MathSciNet  Google Scholar 

  23. Garcia A, Reaume D, Smith RL (2000) Fictitious play for finding system optimal routings in dynamic traffic networks. Transp Res Part B 34:147–156

    Article  Google Scholar 

  24. Gawron C (1998) An iterative algorithm to determine the dynamic user equilibrium in a traffic simulation model. Int J Mod Phys C 9(3):393–408

    Article  Google Scholar 

  25. Gentile G, Meschini L, Papola N (2007) Spillback congestion in dynamic traffic assignment: A macroscopic flow model with time-varying bottlenecks. Transp Res Part B Methodol 41(10):1114–1138

    Article  Google Scholar 

  26. Hart S (2005) Adaptive heuristics. Econometrica 73(5):1401–1430

    Article  MATH  MathSciNet  Google Scholar 

  27. Hart S, Mas-Colell A (2000) A simple adaptive procedure leading to correlated equilibrium. Econometrica 68:1127–1150

    Article  MATH  MathSciNet  Google Scholar 

  28. Huang H-J, Lam WHK (2002) Modeling and solving the dynamic user equilibrium route and departure time choice problem in network with queues. Transp Res Part B 36(3):253–273

    Article  Google Scholar 

  29. Huang H-J, Lam WHK (2003) A multi-class dynamic user equilibrium route and departure time choice problem in queuing networks with advanced traveler information systems. J Math Model Algorithms 2:349–377

    Article  MATH  MathSciNet  Google Scholar 

  30. Hurkens S (1995) Learning by forgetful players. Games Econ Behav 11(2):304–329

    Article  MATH  MathSciNet  Google Scholar 

  31. Jahn O, Möhring R, Schulz A, Moses NS (2005) System-optimal routing of traffic flows with user constraints in networks with congestion. Oper Res 53(4):600–616

    Article  MATH  MathSciNet  Google Scholar 

  32. Jha M, Madanat S, Peeta S (1998) Perception updating and day-to-day travel choice dynamics in traffic networks with information provision. Transp Res Part C 6:189–212

    Article  Google Scholar 

  33. Kaufman DE, Smith RL, Wunderlich KE (1991) An iterative routing/assignment method for anticipatory real-time route guidance. In: Proceedings of IEEE vehicle navigation and information systems conference, pp 693–700

    Google Scholar 

  34. Kuwahara M, Akamatsu T (1997) Decomposition of the reactive assignments with queues for many-to-many origin-destination pattern. Transp Res Part B 31(1):1–10

    Article  Google Scholar 

  35. Kuwahara M, Akamatsu T (2001) Dynamic user optimal assignment with physical queues for a many-to-many OD pattern. Transp Res Part B Methodol 35(5):461–479

    Article  Google Scholar 

  36. Lambert TJ III, Epelman MA, Smith RL (2005) A fictitious play approach to large-scale optimization. Oper Res 53(3):477–489

    Article  MATH  MathSciNet  Google Scholar 

  37. Lebacque JP (1996) The Godunov scheme and what it means for first order traffic flow models. In: Lesort JB (eds) Proceedings of the 13th international symposium on transportation and traffic theory, Pergamon, Amsterdam, pp 647–678

    Google Scholar 

  38. Lebacque J-P, Khoshyaran MM (2005) First order macroscopic traffic flow models: intersection modeling, network modeling. In: Mahmasani, H.S. (eds) Proceedings of the 16th international symposium on transportation and traffic theory, Elsevier, pp 365–386

    Google Scholar 

  39. Lebacque J-P, Mammar S, Haj-Salem H (2007) Generic second order traffic flow modeling. In: Proceedings of the 17th international symposium on transportation and traffic flow theory, London, pp 755–776

    Google Scholar 

  40. Ma T-Y, Lebacque J-P (2013) A cross-entropy based multiagent approach for multiclass activity chain modeling and simulation. Transp Res Part C 28:116–129

    Article  Google Scholar 

  41. Marchesini P, Weijermars W (2010) The relationship between road safety and congestion on motorways. Report No. R-2010-12, SWOV institute for road safety research–Leidschendam, The Netherlands

    Google Scholar 

  42. Marden JR, Arslan G, Shamma JS (2009) Joint strategy fictitious play with inertia for potential games. IEEE Trans Autom Control 54(2):208–220

    Article  MathSciNet  Google Scholar 

  43. Minciardi R, Gaetani F (2001) A decentralized optimal control scheme for route guidance in urban road networks. In: Proceedings of IEEE intelligent transportation systems conference, pp 1195–1199

    Google Scholar 

  44. Miyagi T, Peque G Jr, Fukumoto J (2013) Adaptive learning algorithms for traffic games with naive users. Procedia–Soc Behav Sci 80:806–817

    Article  Google Scholar 

  45. Monderer D, Shapley L (1996) Fictitious play property for games with identical interests. J Econ Theor 68:258–265

    Article  MATH  MathSciNet  Google Scholar 

  46. Nagel K, Schreckenberg M (1992) A cellular automaton model for traffic flow. J Phys I 2(12):2221–2229

    Google Scholar 

  47. Papageorgiou M (1990) Dynamic modeling, assignment, and route guidance in traffic networks. Transp Res Part B 24:471–496

    Article  Google Scholar 

  48. Paz A, Peeta S (2009) Behavior-consistent real-time traffic routing under information. Transp Res Part C 17:642–661

    Article  Google Scholar 

  49. Peeta S, Yu JW (2004) Adaptability of a hybrid route choice model to incorporating driver behavior dynamics under information provision. IEEE Trans Syst Man Cybern Part A 34(2):243–256

    Article  Google Scholar 

  50. Peeta S, Yu JW (2005) A hybrid model for driver route choice incorporating en-route attributes and real-time information effects. Netw Spat Econ 5(1):21–40

    Article  MATH  Google Scholar 

  51. Peeta S, Ziliaskopoulos AK (2001) Foundations of dynamic traffic assignment: the past, the present and the future. Netw Spat Econ 1:233–265

    Article  Google Scholar 

  52. Rantzer A (2008) Using game theory for distributed control engineering. Technical report ISRN LUTFD2/TFRT–7620–SE, Department of automatic control, Lund University, Sweden. Paper presented at Games 2008, 3rd world congress of the game theory society

    Google Scholar 

  53. Rehborn H, Klenov SL (2009) Traffic prediction of congested patterns. Encyclopedia of complexity and systems science. Springer, Berlin, pp 9500–9536

    Chapter  Google Scholar 

  54. Selten R, Schreckenberg M, Chmura T, Pitz T, Kube S, Hafstein SF, Chrobok R, Pottmeier A, Wahle J (2004) Experimental investigation of day-to-day route-choice behaviour and network simulations of autobahn traffic in North Rhine-Westphalia. In: Schreckenberg A, Selten R (eds) Human behaviour and traffic networks. Springer, Berlin, pp 1–21

    Chapter  Google Scholar 

  55. Sinuany-Stem Z, Stern E, Sfaradi Z, Holm E (1997) The effect of information on commuters’ behavior: A comparative micro-simulation approach. Eur J Oper Res 96:455–470

    Article  Google Scholar 

  56. Swenson B, Kar S, Xavier J (2012) Distributed learning in large-scale multi-agent games: A modified fictitious play approach. In: 46th Asilomar conference on signals, systems, and computers, pp 1490–1495

    Google Scholar 

  57. Szeto WY, Wong SC (2012) Dynamic traffic assignment: model classifications and recent advances in travel choice principles. Cent Eur J Eng 2(1):1–18

    Article  MATH  Google Scholar 

  58. Transportation Research Board (U.S.) Highway Capacity Manual HCM 2010. Washington, DC

    Google Scholar 

  59. Wahle J, Bazzan A, Klügl F, Schreckenberg M (2002) The impact of real-time information in a two-route scenario using agent-based simulation. Transp Res Part C 10:399–417

    Article  Google Scholar 

  60. Wang C (2010) The relationship between traffic congestion and road accidents: An econometric approach using GIS. PhD Thesis. Loughborough university, UK

    Google Scholar 

  61. Wardrop JG (1952) Some theoretical aspects of road traffic research. Proc Inst Civ Eng Part II 1:325–378

    Google Scholar 

  62. Weymann J, Farges J-L, Henry J-J (1995) Optimization of traffic dynamic route guidance with drivers reactions in a queue-based model. IEEE Trans Syst Man Cybern 25(7):1161–1165

    Article  Google Scholar 

  63. Xie C, Liu Z (2014) On the stochastic network equilibrium with heterogeneous routing inertia. Trans Res Part B. doi: http://dx.doi.org.proxy.bnl.lu/10.1016/j.trb.2014.01.005

  64. Yang H, Huang H-J (2004) Modeling user adoption of advanced traveler information systems: A control theoretic approach for optimal endogenous growth. Transp Res Part C 12:193–207

    Article  Google Scholar 

  65. Young PH (2005) Strategic learning and its limit. Oxford University Press, Oxford

    Google Scholar 

  66. Ziliaskopoulos AK, Mahmassani HS (1993) A time-dependent shortest path algorithm for real-time intelligent vehicle/highway systems. Transp Res Rec 1408:94–104

    Google Scholar 

  67. Ziliaskopoulos AK, Waller S, Li Y, Byram M (2004) Large-scale dynamic traffic assignment: implementation issues and computational analysis. J Transp Eng 130(5):585–593

    Article  Google Scholar 

  68. Zuurbier FS (2010) Intelligent Route Guidance. PhD thesis, Technische Universiteit Delft

    Google Scholar 

  69. Zuurbier FS, van Zuylen HJ, Hoogendoorn SP, Chen Y (2006) Generating optimal controlled prescriptive route guidance in realistic traffic networks: A generic approach. Transp Res Rec 1944:58–66

    Article  Google Scholar 

Download references

Acknowledgments

The author acknowledges helpful comments of anonymous referees and the editor to improve the quality of this paper.

Author information

Authors and Affiliations

  1. CEPS/INSTEAD, 3, Avenue de la Fonte, L-4364, Esch-sur-Alzette, Luxembourg

    Tai-Yu Ma

Authors
  1. Tai-Yu Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tai-Yu Ma .

Editor information

Editors and Affiliations

  1. Faculty of Sciences, University of Stavanger, Stavanger, Norway

    Kjell Hausken

  2. Dept of Industrial & Systems Engineering, University at Buffalo State University of New York, Buffalo, New York, USA

    Jun Zhuang

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Ma, TY. (2015). Solving a Dynamic User-Optimal Route Guidance Problem Based on Joint Strategy Fictitious Play. In: Hausken, K., Zhuang, J. (eds) Game Theoretic Analysis of Congestion, Safety and Security. Springer Series in Reliability Engineering. Springer, Cham. https://doi.org/10.1007/978-3-319-11674-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11674-7_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11673-0

  • Online ISBN: 978-3-319-11674-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation