Skip to main content
SpringerLink
Log in

A Distributed Clustering with Intelligent Multi Agents System for Materialized Views Selection

  • Conference paper
Knowledge Engineering and Management

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 123))

  • 1721 Accesses

Abstract

Materialized views are the most common approach that can provide optimal performance in processing time, especially for OLAP queries known for their great complexity. Due to the large computation and storage limitation, materialization of all possible views is not possible. Therefore, the key issue is to choose an optimal set of views to materialize. However, this task is a very hard, especially in the data warehouses context, where a trade-of-between performance and view storage cost must be taken into account when deciding which views should be materialized. Addressing this problem, we propose a new approach with two main phases. The first involves pruning the search space to reduce the number of views candidates. In this order, we use a distributed clustering approach using multi agents system that can significantly reduces the complexity of the selection process The second phase uses also a multi agent’s architecture to capture the relationships between views candidates to select the final set of materialized views. This set minimizes the query processing cost and satisfy the storage constraint. We validate our proposed approach using an experimental evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Agrawal, R., Aggarwal, C., Prasad, V.V.: Depth first generation of long patterns. In: 7th International Conference on Knowledge Discovery and Data Mining, pp. 108–118 (2000)

    Google Scholar 

  2. Anderberg, M.R.: Cluster analysis for applications. Academic Press (1973)

    Google Scholar 

  3. Aouiche, K., Darmont, J.: Data mining based materialized view and index selection in data warehouses. Journal of Intelligent Information Systems 33(1) (2009)

    Google Scholar 

  4. Aouiche, K., Jouve, P.-E., Darmont, J.: Clustering-based materialized view selection in data warehouses. In: Manolopoulos, Y., Pokorný, J., Sellis, T.K. (eds.) ADBIS 2006. LNCS, vol. 4152, pp. 81–95. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  5. Baralis, E., Paraboschi, S., Teniente, E.: Materialized view selection in a multidimensional database. In: Very Large Data Base, pp. 156–165 (1997)

    Google Scholar 

  6. Baril, X., Bellahsene, Z.: Selection of materialized views: a cost-based approach. In: Proceedings of the 15th International Conference on Advanced Information Systems Engineering, pp. 665–680 (2003)

    Google Scholar 

  7. Bellatreche, L.: Utilisation des vues matérialisées, des index et de la fragmentation dans la conception logique et physique d’un entrepôt de données. Phd thesis. Clermont-ferrant University. France (2000)

    Google Scholar 

  8. Gasser, L., Bond, A.H.: Readings in distributed artificial intelligence. Morgan Kaufmann Publishers, San Mateo (1988)

    Google Scholar 

  9. Cao, L.: Data mining and multi-agent integration, 1st edn., pp. 77–92. Springer, Heidelberg (2009)

    Book  MATH  Google Scholar 

  10. Chaib-draa, B., Jarras, I., Moulin, B.: Systèmes multi-agents: principes généraux et applications. In: Principes et architectures des systèmes multi-agents. Collection IC2, hermes science publication (2002)

    Google Scholar 

  11. Chan, G.K.Y., Li, Q., Feng, L.: Design and selection of materialized views in a data warehousing environment: a case study. In: Proceedings of the 2nd ACM International Workshop on Data Warehousing and OLAP, pp. 42–47 (1999)

    Google Scholar 

  12. Derakhshan, R., Stantic, B., Korn, O., Dehne, F.: Parallel simulated annealing for materialized view selection in data warhousing environments. In: Proceedings of the International Conference on Algorithms and Architectures for Parallel Processing, pp. 121–132 (2008)

    Google Scholar 

  13. Grumbach, S., Rafanelli, M., Tininini, L.: On the equivalence and rewriting of aggregate queries. Acta informatica 40(8), 529–584 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  14. Guessoum, Z., et al.: Monitoring and organizational-level adaptation of multi agent systems. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multi Agent Systems, pp. 514–521 (2004)

    Google Scholar 

  15. Gupta, H.: Selection of views to materialize in a data warehouse. In: Afrati, F.N., Kolaitis, P.G. (eds.) ICDT 1997. LNCS, vol. 1186, pp. 98–112. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  16. Gupta, H., Mumick, S.: Selection of views to materialize under a maintenance cost constraint. In: Proceeding of 7th International Conference on Extended Database Theory, pp. 453–470 (1999)

    Google Scholar 

  17. Gupta, H., Mumick, S.: Selection of views to materialize in a data warehouse. IEEE Transactions on Knowledge and Data Engineering 17(11), 24–43 (2005)

    Article  Google Scholar 

  18. Hammouda, K., Kamel, M.: Incremental document clustering using cluster similarity histograms. In: The 2003 IEEE/WIC International Conference on Web Intelligence, pp. 597–601 (2003)

    Google Scholar 

  19. Harinarayan, V., Rajaraman, A., Ullman, J.D.: Implementing data cubes efficiently. In: Proceedings of International Conference of ACM SIGMOD, pp. 205–216 (1996)

    Google Scholar 

  20. Horng, J.T., Chang, Y.J., Liu, B.J.: Applying evolutionary algorithm to materialized view selection in data warehouse. In: Soft Computing, pp. 574–581 (2003)

    Google Scholar 

  21. Karayannidis, N., Tsois, A., Sellis, T., Pieringer, R., Markl, V., Ramsak, F., Fenk, R., Elhardt, K., Bayer, R.: Processing star queries on hierarchically clustered fact tables. In: International Conference on Very Large Data Bases, VLDB, pp. 730–741 (2002)

    Google Scholar 

  22. Kimball, R., Ross, M.: The data warehouse toolkit: the complete guide to dimensional modeling, 2nd edn. John Wiley & Sons (2002)

    Google Scholar 

  23. Kotidis, Y., Roussopoulos, N.: Dynamat: A dynamic view management system for data warehouses. In: Proc of the ACM SIGMOD, pp. 371–382 (1999)

    Google Scholar 

  24. Lee, M., Hammer, J.: Speeding up materialized view selection in data warehouses using a randomized algorithm. International Journal of Cooperative Information System 10(3), 327–353 (2001)

    Article  Google Scholar 

  25. MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297. University of California press, Berkeley (1967)

    Google Scholar 

  26. McCallum, A., Nigam, K., Ungar, L.: Efficient clustering of high dimensional data sets with application to reference matching. In: Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 169–178 (2000)

    Google Scholar 

  27. Overeinder, B., van Steen, M., Brazier, F.: Group formation among peer-to-peer agents: Learning group characteristics. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 789–796 (2003)

    Google Scholar 

  28. Parunak, H.V.D.: Manufacturing experience with the contract net, pp. 285–310. Morgan Kaufmann (1987)

    Google Scholar 

  29. Rizzi, S., Saltarelli, E.: View materialization vs indexing: balancing space constraints in data warehouse design. In: The 15th International Conference on Advanced Information Systems Engineering, pp. 502–519 (2003)

    Google Scholar 

  30. Shukla, A., Deshpande, P., Naughton, J.: Materialized view selection of multidimensional datasets. In: The 24th International Conference on Very Large Data Bases, pp. 488–499 (1998)

    Google Scholar 

  31. Steels, L.: Cooperation between distributed agents through self organization Decentralized AI. In: Demazeau, Y., Müller, J.-P. (eds.), pp. 175–196. Elsevier Science Publishers B.V (1990)

    Google Scholar 

  32. Steinbrunn, M., Moerkotte, J., Kemper, A.: Heuristic and randomized optimization for the join ordering problem. International Journal on Very Large Database, 191–208 (1997)

    Google Scholar 

  33. Valduriez, P.: Join indices. ACM Transaction on Database Systes 12(2), 218–246 (1987)

    Article  Google Scholar 

  34. Valluri, S.R., Vadapalli, S., Karlapalem, K.: View relevance driven materialized view selection in data warehousing environment. In: The 13th Australasian Database Technologies, pp. 187–196 (2002)

    Google Scholar 

  35. Wang, A., Conradi, R., Liu, C.: A multi-agent architecture for cooperative software engineering. In: Twelfth International Conference of Software Engineering and Knowledge Engineering (2000)

    Google Scholar 

  36. Weiss, G., Sen, S. (eds.): Adaption and Learning in Multi-Agent Systems. LNCS, vol. 1042. Springer, Heidelberg (1996)

    MATH  Google Scholar 

  37. Widom, J.: Research problems in data warehouse. In: 4th International Conference on Information, Knowledge and Managment, pp. 25–30 (1995)

    Google Scholar 

  38. Wong, K.Y.M., Lim, S.W., Luo, P.: Diversity and adaptation in large population games. International Journal Mod Phys 18, 222–243 (2004)

    Google Scholar 

  39. Wooldridge, M.: An introduction to multi agent systems. John Wiley & Sons, Chichester (2002)

    Google Scholar 

  40. Yang, J., Karlapalem, K., Li, Q.: Algorithm for materialized view design in data warehousing environment. In: 23rd International Conference on Very Large Data Bases, pp. 136–145 (1997)

    Google Scholar 

  41. Zhang, C., Yang, J.: Genetic algorithm for materialized view selection in data warehouse environments. In: Mohania, M., Tjoa, A.M. (eds.) DaWaK 1999. LNCS, vol. 1676, pp. 116–125. Springer, Heidelberg (1999)

    Google Scholar 

  42. Zhang, C., Yao, X., Yang, J.: An evolutionary approach to materialized view selection in a data warehouse environment. IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews 31(3), 282–294 (2001)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Laboratory in Artificial Intelligence (LRIA) Department of Computer Science, Faculty of Electrical and Computer Science, USTHB, University Science and Technology Houari Boumediene, El Alia BP 32, Bab Ezzouar, Algiers, Algeria

    Hamid Necir & Habiba Drias

Authors
  1. Hamid Necir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Habiba Drias
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, 200240, Shanghai, China

    Yinglin Wang

  2. School of Information Science and Technology, Southwest Jiaotong University, 610031, Chengdu, Sichuan Province, China

    Tianrui Li

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Necir, H., Drias, H. (2011). A Distributed Clustering with Intelligent Multi Agents System for Materialized Views Selection. In: Wang, Y., Li, T. (eds) Knowledge Engineering and Management. Advances in Intelligent and Soft Computing, vol 123. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25661-5_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25661-5_54

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25660-8

  • Online ISBN: 978-3-642-25661-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation