Skip to main content

Pre-aggregation in Spatial Data Warehouses

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2121))

Abstract

Data warehouses are becoming increasingly popular in the spatial domain, where they are used to analyze large amounts of spatial information for decision-making purposes. The data warehouse must provide very fast response times if popular analysis tools such as On-Line Analytical Processing [2](OLAP) are to be applied successfully. In order for the data analysis to have an adequate performance, pre-aggregation, i.e., pre-computation of partial query answers, is used to speed up query processing. Normally, the data structures in the data warehouse have to be very “well-behaved” in order for pre-aggregation to be feasible. However, this is not the case in many spatial applications.

In this paper, we analyze the properties of topological relationships between 2D spatial objects with respect to pre-aggregation and show why traditional pre-aggregation techniques do not work in this setting. We then use this knowledge to significantly extend previous work on pre-aggregation for irregular data structures to also cover special spatial issues such as partially overlapping areas.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T. Barclay, D. R. Slutz, and J. Gray. TerraServer: A Spatial Data Warehouse. In Proceedings of ACM SIGMOD 2000, pp. 307–318.

    Google Scholar 

  2. E. F. Codd. Providing OLAP (on-line analytical processing) to user-analysts: An IT mandate. Technical report, E.F. Codd and Associates, 1993.

    Google Scholar 

  3. M. J. Egenhofer and R. D. Franzosa. Point Set Topological Relations. International Journal of Geographical Information Systems 5:161–174, 1991.

    Article  Google Scholar 

  4. M. Ester, H.-P. Kriegel, and J. Sander. Spatial Data Mining: A Database Approach. In Proceedings of SSD 1999, pp. 47–66.

    Google Scholar 

  5. J. Gray, S. Chaudhuri, A. Bosworth, A. Layman, D. Reichart, M. Venkatrao, F. Pellow, and H. Pirahesh. Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab and Sub-Totals. Data Mining and Knowledge Discovery, 1(1):29–54, 1997.

    Article  Google Scholar 

  6. A. Gupta, V. Harinarayan, and D. Quass. Aggregate Query Processing in Data Warehousing Environments. In Proceedings VLDB 1995, pp. 358–369.

    Google Scholar 

  7. H. Gupta. Selection of Views to Materialize in a Data Warehouse. In Proceedings of ICDT 1997, pp. 98–112.

    Google Scholar 

  8. J. Han. Spatial Data Mining and Spatial Data Warehousing. In Proceedings of SSD 1997, (tutorial note).

    Google Scholar 

  9. J. Han, Koperski, and N. Stefanovic. GeoMiner: A System Prototype for Spatial Data Mining. In Proceeding of the SIGMOD Conference, 1997 (prototype description).

    Google Scholar 

  10. V. Harinarayan, A. Rajaraman, and J.D. Ullman. Implementing Data Cubes Efficiently. In Proceedings of ACM SIGMOD 1996, pp. 205–216.

    Google Scholar 

  11. T. Hadzilacos and N. Tryfona. An Extended Entity-Relationship Model for Geographie Applications. SIGMOD Record 26(3):24–29, 1997.

    Article  Google Scholar 

  12. R. Kimball. The Data Warehouse Toolkit. Wiley Computer Publishing, 1996.

    Google Scholar 

  13. H. Lenz and A. Shoshani. Summarizability in OLAP and Statistical Data Bases. In Proceedings of SSDBM 1997, pp. 39–48.

    Google Scholar 

  14. National Health Service (NHS). Read Codes version 3. NHS, September 1999.

    Google Scholar 

  15. The OLAP Report. Database Explosion. URL: <http://www.olapreport.com/DatabaseExplosion.htm> Current as of February 10, 1999.

  16. J. O’Rourke. Computational Geometry (2nd edition). Cambridge University Press, 1998.

    Google Scholar 

  17. T. B. Pedersen and C. S. Jensen. Multidimensional Data Modeling for Complex Data. In Proceedings of ICDE 1999, pp. XXX–XXX.

    Google Scholar 

  18. T. B. Pedersen, C. S. Jensen, and C. E. Dyreson. Extending Practical Pre-Aggregation for On-Line Analytical Processing. In Proceedings of the Twenty-Fifth International Conference on Very Large Databases, pp. 663–674, 1999.

    Google Scholar 

  19. T. B. Pedersen, C. S. Jensen, and C. E. Dyreson. The TreeScape System: Reuse of Pre-Computed Aggregates over Irregular OLAP Hierarchies. In Proceedings of VLDB 2000, pp. 595–598.

    Google Scholar 

  20. T. B. Pedersen, C. S. Jensen, and C. E. Dyreson. A Foundation for Capturing and Querying Complex Multidimensional Data. In Information Systems-Special Issue: Data Warehousing, 2001, 42 pages, to appear.

    Google Scholar 

  21. T. B. Pedersen, C. S. Jensen, and C. E. Dyreson. Pre-Aggregation for Irregular OLAP Hierarchies With The TreeScape System. In Proceedings of ICDE 2001, demo track, pp. 1–3.

    Google Scholar 

  22. M. Rafanelli and A. Shoshani. STORM: A Statistical Object Representation Model. In Proceedings of SSDBM 1990, pp. 14–29.

    Google Scholar 

  23. J. Sander, M. Ester, H.-P. Kriegel, and X. Xu. Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications. Data Mining and Knowledge Discovery 2(2): 169–194, 1998.

    Article  Google Scholar 

  24. A. Shukla, P. M. Deshpande, J. F. Naughton, and K. Ramasamy. Storage Estimation for Multidimensional Aggregates in the Presence of Hierarchies. In Proceedings of VLDB 1996, pp. 522–531.

    Google Scholar 

  25. N. Tryfona and C. S. Jensen. Conceptual Data Modeling for Spatiotemporal Applications. GeoInformatica 3(3):245–268, 1999.

    Article  Google Scholar 

  26. N. Tryfona and S. Jensen. Using Abstractions for Spatio-Temporal Conceptual Modeling. In Proceedings of ACM SAC 2000, pp. 313–322.

    Google Scholar 

  27. R. Winter. Databases: Back in the OLAP game. Intelligent Enterprise, 1(4):60–64, 1998.

    Google Scholar 

  28. X. Zhou, D. Truffet, and J. Han. Efficient Polygon Amalgamation Methods for Spatial OLAP and Spatial Data Mining. In Proceeding of SSD 1999, pp. 167–187.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pedersen, T.B., Tryfona, N. (2001). Pre-aggregation in Spatial Data Warehouses. In: Jensen, C.S., Schneider, M., Seeger, B., Tsotras, V.J. (eds) Advances in Spatial and Temporal Databases. SSTD 2001. Lecture Notes in Computer Science, vol 2121. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47724-1_24

Download citation

  • DOI: https://doi.org/10.1007/3-540-47724-1_24

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42301-0

  • Online ISBN: 978-3-540-47724-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics