skip to main content
10.1145/3340964.3340984acmotherconferencesArticle/Chapter ViewAbstractPublication PagessstdConference Proceedingsconference-collections
demonstration
Public Access

Demonstrating GeoSparkSim: A Scalable Microscopic Road Network Traffic Simulator Based on Apache Spark

Published:19 August 2019Publication History

ABSTRACT

Road network traffic data has been widely studied by researchers and practitioners in different areas such as urban planning, traffic prediction and spatial-temporal databases. The existing urban traffic simulators suffer from two critical issues (1) scalability: most of them only offer single-machine solutions which are not adequate to produce large-scale data. Some simulators can generate traffic in parallel but do not well balance the load among machines in a cluster. (2) granularity: many simulators do not consider microscopic traffic situations including traffic lights, lane changing, and car following. In the paper, we propose GeoSparkSim, a scalable traffic simulator which extends Apache Spark to generate large-scale road network traffic datasets with microscopic traffic simulation. The proposed system seamlessly integrates with a Spark-based spatial data management system, GeoSpark, to deliver a holistic approach that allows data scientists to simulate, analyze and visualize large-scale urban traffic data. To implement microscopic traffic models, GeoSparkSim employs a simulation-aware vehicle partitioning method to partition vehicles among different machines such that each machine has a balanced workload. A full-fledged prototype of GeoSparkSim is implemented in Apache Spark. In this demonstration, we will show the attendees how to issue GeoSparkSim simulation tasks via the user interface, visualize simulated vehicle movements, and monitor the backend Spark cluster status.

References

  1. Brinkhoff, T. A framework for generating network-based moving objects. GeoInformatica 6, 2 (2002), 153--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Düntgen, C., Behr, T., and Güting, R. H. Berlinmod: a benchmark for moving object databases. VLDB J. 18, 6 (2009), 1335--1368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Fu, Z., Yu, J., and Sarwat, M. Building a large-scale microscopic road network traffic simulator in apache spark. In MDM (2019).Google ScholarGoogle Scholar
  4. Apache Hadoop. http://hadoop.apache.org/.Google ScholarGoogle Scholar
  5. Kesting, A., Treiber, M., and Helbing, D. General lane-changing model mobil for car-following models. Transportation Research Record 1999, 1 (2007), 86--94.Google ScholarGoogle ScholarCross RefCross Ref
  6. Kesting, A., Treiber, M., and Helbing, D. Enhanced intelligent driver model to access the impact of driving strategies on traffic capacity. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 368, 1928 (2010), 4585--4605.Google ScholarGoogle ScholarCross RefCross Ref
  7. Klefstad, R., Zhang, Y., Lai, M., Jayakrishnan, R., and Lavanya, R. A distributed, scalable, and synchronized framework for large-scale microscopic traffic simulation. In Intelligent Transportation Systems, 2005. Proceedings. 2005 IEEE (2005), IEEE, pp. 813--818.Google ScholarGoogle ScholarCross RefCross Ref
  8. Krajzewicz, D., Hertkorn, G., Rössel, C., and Wagner, P. Sumo (simulation of urban mobility)-an open-source traffic simulation. In Proceedings of the 4th middle East Symposium on Simulation and Modelling (MESM20002) (2002), pp. 183--187.Google ScholarGoogle Scholar
  9. Lu, J., and Guting, R. H. Parallel Secondo: Boosting Database Engines with Hadoop. In ICPADS (2012), pp. 738--743. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Nagel, K., and Rickert, M. Parallel implementation of the transims micro-simulation. Parallel Computing 27, 12 (2001), 1611--1639.Google ScholarGoogle ScholarCross RefCross Ref
  11. Ramamohanarao, K., Xie, H., Kulik, L., Karunasekera, S., Tanin, E., Zhang, R., and Khunayn, E. B. Smarts: Scalable microscopic adaptive road traffic simulator. TIST 8, 2 (2017), 26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Vinoski, S. Corba: integrating diverse applications within distributed heterogeneous environments. IEEE Communications magazine 35, 2 (1997), 46--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Waraich, R. A., Charypar, D., Balmer, M., and Axhausen, K. W. Performance improvements for large scale traffic simulation in matsim. In 9th STRC Swiss Transport Research Conference: Proceedings (2009), vol. 565, Swiss Transport Research Conference.Google ScholarGoogle Scholar
  14. Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauly, M., Franklin, M. J., Shenker, S., and Stoica, I. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In NSDI (2012), pp. 15--28. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Demonstrating GeoSparkSim: A Scalable Microscopic Road Network Traffic Simulator Based on Apache Spark

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          SSTD '19: Proceedings of the 16th International Symposium on Spatial and Temporal Databases
          August 2019
          245 pages

          Copyright © 2019 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 19 August 2019

          Check for updates

          Qualifiers

          • demonstration
          • Research
          • Refereed limited

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader