Skip to main content

Multimodal Location Based Services—Semantic 3D City Data as Virtual and Augmented Reality

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Geoinformation and Cartography ((ICA))

Abstract

The visualization of cross-domain spatial data sets has become an important task within the analysis of energy models. The representation of these models is especially important in urban areas, in which the under-standing of patterns of energy production and demand is key for an efficient city planning. Location Based Services (LBS) provide a valuable addition towards the analysis and visualization of those data sets as the user can explore the output of different models and simulations in the real environment at the location of interest. Towards this aim, the present research explores mobile alternatives to the visual analysis of temporal data series and 3D building models. Based on the fields of numerical simulation, GIS and computer graphics, this work presents a novel mobile service that allows exploring urban models at different Level of Details (LoDs) using well-known standards such as CityGML. Ultimately, the project enables researchers, city planners and technicians to explore urban energy datasets in an interactive and immersive manner as Virtual Globes, Virtual Reality and Augmented Reality. Using models of the city of Karlsruhe, the final service has been implemented and tested on the iOS platform providing an empirical insight on the performance of the system. In addition, this research provides a holistic approach by developing one application that is capable of seamlessly change the visualization mode.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.google.com/glass/start/.

  2. 2.

    http://www.samsung.com/us/explore/gear-vr/.

  3. 3.

    https://vr.google.com/cardboard/index.html.

  4. 4.

    https://cesiumjs.org/.

  5. 5.

    https://github.com/3dcitydb.

  6. 6.

    http://www.jboss.org/.

  7. 7.

    http://en.wiki.energy.sig3d.org/index.php/Main_Page.

  8. 8.

    http://www.opengeospatial.org/standards/sos.

References

  • Ahas, R. and Mark, Ü. (2005). Location based services—new challenges for planning and public administration? Futures, 37 (6), 547–561. doi:10.1016/j.futures.2004.10.012

  • Anthopoulos, L. and Fitsilis, P. (2010). From Digital to Ubiquitous Cities: Defining a Common Architecture for Urban Development. 2010 Sixth International Conference on Intelligent Environments (S. 301–306). IEEE. doi:10.1109/IE.2010.61

  • Apple Inc. (2014a). AVCaptureDeviceFormat Class Reference.

    Google Scholar 

  • Apple Inc. (2014b). Grand Central Dispatch (GCD) Reference.

    Google Scholar 

  • Apple Inc. (2016a). iOS Human Interface Guidelines. IOS Developer Library. http://developer.apple.com/library/ios/#documentation/UserExperience/Conceptual/MobileHIG/Introduction/Introduction.html. Accessed 10 June 2016

  • Apple Inc. (2016b). iOS Human Interface Guidelines: Bars. https://developer.apple.com/library/ios/documentation/UserExperience/Conceptual/MobileHIG/Bars.html#//apple_ref/doc/uid/TP40006556-CH12-SW1. Accessed 10 June 2016

  • Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S. and MacIntyre, B. (2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21 (6), 34–47. doi:10.1109/38.963459

  • Biljecki, F., Ledoux, H. and Stoter, J. (2016). An improved LOD specification for 3D building models. Computers, Environment and Urban Systems (59). doi:10.1016/j.compenvurbsys.2016.04.005

  • Biljecki, F., Stoter, J., Ledoux, H., Zlatanova, S. and Çöltekin, A. (2015). Applications of 3D City Models: State of the Art Review. ISPRS International Journal of Geo-Information, 4 (4), 2842–2889. Multidisciplinary Digital Publishing Institute. doi:10.3390/ijgi4042842

  • Blum, J.R., Greencorn, D. and Cooperstock, J.R. (2013). Smartphone sensor reliability for augmented reality applications. Mobile and ubiquitous systems: computing, networking, and services, 127–138. doi:10.1007/978-3-642-40238-8_11

  • Boas, Y. (2013). Overview of virtual reality technologies. Interactive Multimedia Conference 2013.

    Google Scholar 

  • Bolstad, L.E., Jackson, D., Nilsson, C., Percivall, G. and Turner, D.M. (2011) DeviceOrientation Event Specificaiton. W3C Working Draft. https://www.w3.org/TR/2011/WD-orientation-event-20110628/. Accessed 22 August 2016.

  • Celik, B., Karatepe, E., Gokmen, N. and Silvestre, S. (2013). A virtual reality study of surrounding obstacles on BIPV systems for estimation of long-term performance of partially shaded PV arrays. Renewable Energy, 60, 402–414. doi:10.1016/j.renene.2013.05.040

  • Civil, A. (2008). Best Practices for Working with Vertex Data. Data Management.

    Google Scholar 

  • Clark, J. and DeRose, S. (2010). XML Path Language (XPath). Engineering. https://www.w3.org/TR/xpath/ Accesed 27th September 2016.

  • Döllner, J., Kolbe, T.H., Liecke, F., Sgouros, T. and Teichmann, K. (2006). The Virtual 3D City Model of Berlin-Managing, Integrating, and Communicating Complex Urban Information. Proceedings of the 25th Urban Data Management Symposium UDMS, (May 2006), 15–17.

    Google Scholar 

  • Eberly, D. (2002). Triangulation by ear clipping. Magic Software, Inc, 1–13.

    Google Scholar 

  • Feiner, S., MacIntyre, B., Höllerer, T. and Webster, A. (1997). A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies, 1 (4), 208–217. Springer-Verlag. doi:10.1007/BF01682023

  • Fernández, P., Santana, J.M., Ortega, S., Trujillo, A., Suárez, J.P., Domínguez, C. et al. (2016). SmartPort: A Platform for Sensor Data Monitoring in a Seaport Based on FIWARE. Sensors, 16 (3), 417. Multidisciplinary Digital Publishing Institute. doi:10.3390/xx

  • Gateau, S. (2009). 3D Vision Technology - Develop, Design, Play in 3D Stereo. Acm Siggraph 2009.

    Google Scholar 

  • Gröger, G., Kolbe, T.H., Czerwinski, A. and Nagel, C. (2008). OpenGIS City Geography Markup Language (CityGML) Encoding Standard, Version 1.0.0. OGC Document No. 08-007r1, 234.

    Google Scholar 

  • Harrower, M., and Brewer, C. A. (2003). ColorBrewer.org: an online tool for selecting colour schemes for maps. The Cartographic Journal40(1), 27–37.

    Google Scholar 

  • Heuveline, V., Ritterbusch, S. and Ronnas, S. (2011). Augmented Reality for Urban Simulation Visualization. INFOCOMP 2011 : The First International Conference on Advanced Communications and Computation, (c), 115–119.

    Google Scholar 

  • Heydarian, A., Carneiro, J.P., Gerber, D., Becerik-Gerber, B., Hayes, T. and Wood, W. (2015). Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations. Automation in Construction, 54, 116–126. doi:10.1016/j.autcon.2015.03.020

  • Höllerer, T., Feiner, S., Terauchi, T., Rashid, G. and Hallaway, D. (1999). Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. Computers and Graphics, 23 (6), 779–785. doi:10.1016/S0097-8493(99)00103-X

  • Jenks, G. F. (1977). Optimal data classification for choropleth maps. University of Kansas. Dept. of Geography.

    Google Scholar 

  • Klobe, T. H. Burger, B., and Berit, C. (2015). City GML goes to Broadway. Photogrammetric Week ‘15, Wichmann, 2015, 343–356

    Google Scholar 

  • Krevelen, D.W.F. van and Poelman, R. (2010). A Survey of Augmented Reality Technologies, Applications and Limitations. The International Journal of Virtual Reality, 9 (2), 1–20. doi:10.1155/2011/721827

  • Lovett, A., Appleton, K., Warren-Kretzschmar, B. and Von Haaren, C. (2015). Using 3D visualization methods in landscape planning: An evaluation of options and practical issues. Landscape and Urban Planning, 142, 85–94. doi:10.1016/j.landurbplan.2015.02.021

  • Megginson, D. (2004). SAX. http://sax.soursforge.net. Accessed 15 June 2016

  • Meisters, G.H. (1975). Polygons have ears. American Mathematical Monthly, 82 (6), 648–651. Mathematical Association of America.

    Google Scholar 

  • Nouvel, R., Zirak, M., Dastageeri, H., Coors, V. and Eicker, U. (2014). Urban Energy Analysis Based on 3D City Model for National Scale Applications. IBPSA Germany Conference.

    Google Scholar 

  • Ortega, S., Trujillo, A., Santana, J.M., Suárez, J.P. and Gómez-Deck, D. (2016). Rendering large datasets of georeferenced markers in mobile devices, In Press. doi:10.1145/2948628.2948638

  • Paolantonio, M. Di, Fernández, C.G., Latorre, M.J. and Pedrera, F. (2015). 3D virtual representation of drones’ flights through Cesium. js and Oculus Rift. Geomatics Workbooks n 12 – „FOSS4G Europe Como 2015“, 577–578.

    Google Scholar 

  • Phong, B.T. (1975). Illumination for Computer-Generated Images. Communications of the ACM. The University of Utah.

    Google Scholar 

  • Prandi, F., Staso, U. Di, Berti, M., Giovannini, L. and Amicis, R. De. (2015). Hybrid approach for large-scale Energy Performance estimation based on 3D city model data and typological classification, (November), 329–330.

    Google Scholar 

  • Ratti, C., Frenchman, D., Pulselli, R.M. and Williams, S. (2006). Mobile Landscapes: Using Location Data from Cell Phones for Urban Analysis. Environment and Planning B: Planning and Design, 33 (5), 727–748. doi:10.1068/b32047

  • Rehman, U. and Cao, S. (2015). Augmented Reality-Based Indoor Navigation Using Google Glass as a Wearable Head-Mounted Display. Systems, Man, and Cybernetics (SMC), 2015 IEEE International Conference on (S. 1452–1457).

    Google Scholar 

  • Rosenberg, L.B. (1993). The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks. Virtual Reality Annual International Symposium, 1993. IEEE (S. 27–32). doi:10.1109/VRAIS.1993.380802

  • Saed, S. and Wendel, J. (2015). Estimating heating energy consumption and CO2 production - A novel modeling approach. Proceedings of the 14th International Conference on Computers in Urban Planning and Urban Management.

    Google Scholar 

  • Schall, G., Schmalstieg, D. and Junghanns, S. (2010). Vidente - 3D Visualization of Underground Infrastructure using Handheld Augmented Reality. Integrating GIS and Water, 1 (4), 1–17. doi:10.1.1.173.3513

    Google Scholar 

  • Shen, Z. (2012). Geospatial Techniques in Urban Planning (Advances in Geographic Information Science). Springer Berlin Heidelberg.

    Google Scholar 

  • Simons, A. and Nichersu, A. (2014). Development of a CityGML infrastructure for the imple-mentation of an energy demand method with different data sources. GIScience 2014.

    Google Scholar 

  • Suárez, J.P., Trujillo, A., De La Calle, M., Gómez-Deck, D. and Santana, J.M. (2012). An open source virtual globe framework for iOS, Android and WebGL compliant browser. Proceedings of the 3rd International Conference on Computing for Geospatial Research and Applications.

    Google Scholar 

  • Suárez, J.P., Trujillo, A., Santana, J.M., de la Calle, M. and Gómez-Deck, D. (2015). An efficient terrain Level of Detail implementation for mobile devices and performance study. Computers, Environment and Urban Systems, 52, 21–33. Elsevier. doi:10.1016/j.compenvurbsys.2015.02.004

  • Tanaka, E.H., Paludo, J.A., Cordeiro, C.S., Domingues, L.R., Gadbem, E. V. and Euflausino, A. (2015). Using Immersive Virtual Reality for Electrical Substation Training. International Association for Development of the Information Society. International Association for the Development of the Information Society.

    Google Scholar 

  • Trapp, M. (2004). OpenGL-Performance and Bottlenecks. Hasso Plattner Institut - Universität Potsdam, (January 2004), 15 pages.

    Google Scholar 

  • Trujillo, A., Suárez, J.P., La Calle, M. De, Gómez, D., Pedriza, A. and Santana, J.M. (2013). Glob3 mobile: An open source framework for designing virtual globes on iOS and android mobile devices. Lecture Notes in Geoinformation and Cartography (S. 211–229). Quebec, Canada: Springer. doi:10.1007/978-3-642-29793-9-12

  • Trujillo, A., Suárez, J.P., Santana, J.M., De La Calle, M. and Gómez-Deck, D. (2014). An efficient architecture for automatic shaders management on virtual globes. Proceedings - 5th International Conference on Computing for Geospatial Research and Application, COM.Geo 2014 (S. 38–42). doi:10.1109/COM.Geo.2014.23

  • Tussyadiah, I. (2013). Expectation of Travel Experiences with Wearable Computing Devices. Information and Communication Technologies in Tourism 2014 (S. 539–552). Cham: Springer International Publishing. doi:10.1007/978-3-319-03973-2_39

  • Veillard, D. (2009). The XML C parser and toolkit of Gnome. http://xmlsoft.org/. Accessed 10 June 2016

  • Wendel, J., Murshed, S.M., Sriramulu, A. and Nichersu, A. (2016). Development of a Web-Browser Based Interface for 3D Data—A Case Study of a Plug-in Free Approach for Visualizing Energy Modelling Results (S. 185–205). Springer International Publishing. doi:10.1007/978-3-319-19602-2_12

  • Wieland, M. and Wendel, J. (2015). Computing Solar Radiation on CityGML Building Data. 18th AGILE International conference on Geographic Information Science 2015. Lisbon, Portugal. 9th June 2015

    Google Scholar 

  • Wiki, O. (2013). Tile usage policy --- OpenStreetMap Wiki. http://wiki.openstreetmap.org/w/index.php?title=Tile_usage_policy&oldid=947750. Accessed 28 May 2016

  • World Wide Web Consortium. (2006). W3C Document Object Model. http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:W3C+Document+Object+Model#2. Accessed 10 June 2016

  • Zamyadi, A., Pouliot, J. and Bédard, Y. (2013). A Three Step Procedure to Enrich Augmented Reality Games with CityGML 3D Semantic Modeling (S. 261–275). Springer Berlin Heidelberg. doi:10.1007/978-3-642-29793-9_15

Download references

Acknowledgments

The first author wants to thank Agencia Canaria de Investigación, Innovación y Sociedad de la Información, and the European Social Fund, for the grant “Formación del Personal Investigador-2012” that made possible this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jochen Wendel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Santana, J.M., Wendel, J., Trujillo, A., Suárez, J.P., Simons, A., Koch, A. (2017). Multimodal Location Based Services—Semantic 3D City Data as Virtual and Augmented Reality. In: Gartner, G., Huang, H. (eds) Progress in Location-Based Services 2016. Lecture Notes in Geoinformation and Cartography(). Springer, Cham. https://doi.org/10.1007/978-3-319-47289-8_17

Download citation

Publish with us

Policies and ethics