Skip to main content
SpringerLink
Log in

Web Search Tailored Ontology Evaluation Framework

  • Conference paper
Advances in Web and Network Technologies, and Information Management (APWeb 2007, WAIM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4537))

Abstract

Ontologies are increasingly used in various applications (e.g., semantic interoperability, data integration). In particular, there is a trend in applying ontologies to improve results of search. Quality of ontology plays an important role in these applications. An important body of work exists in ontology quality assessment area. However, there is a lack of task- and scenario-based quality assessment methods. In this paper we propose a framework to assess fitness of ontology for use in ontology-based search. We define metrics for ontology fitness to particular search tasks and metrics for ontology capability to enhance recall and precision.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Burton-Jones, A., Storey, V., Sugumaran, V., Ahluwalia, P.: A semiotic metrics suite for assessing the quality of ontologies. Data and Knowledge Engineering 55(1), 84–102 (2005)

    Article  Google Scholar 

  2. Castells, P., Fernandez, M., Vallet, D.: An adaptation of the vector-space model for ontology-based information retrieval. IEEE Transactions on Knowledge and Data Engineering 19(2), 261–272 (2007)

    Article  Google Scholar 

  3. Ciorascu, C., Ciorascu, I., Stoffel, K.: knOWLer - ontological support for information retrieval systems. In: SIGIR 2003 Conference, Workshop on Semantic Web, Toronto, Canada (2003)

    Google Scholar 

  4. Suomela, S., Kekalainen, J.: Ontology as a search-tool: A study of real user’s query formulation with and without conceptual support. In: Losada, D.E., Fernández-Luna, J.M. (eds.) ECIR 2005. LNCS, vol. 3408, pp. 315–329. Springer, Heidelberg (2005)

    Google Scholar 

  5. Alani, H., Brewster, C., Shadbolt, N.: Ranking ontologies with AKTiveRank. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 1–15. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  6. Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: Ontology evaluation and validation. An integrated formal model for the quality diagnostic task. Technical report, ISTC-CNR, Trento, Italy (2005)

    Google Scholar 

  7. Lozano-Tello, A., Gomez-Perez, A.: Ontometric: A method to choose appropriate ontology. Journal of Database Management 15(2), 1–18 (2004)

    Google Scholar 

  8. Giboin, A., Gandon, F., Corby, O., Dieng, R.: Assessment of ontology-based tools: a step towards systemizing the scenario approach. In: EON 2002 workshop (2002)

    Google Scholar 

  9. Aitken, S., Reid, S.: Evaluation of an ontology-based information retrieval tool. In: Gomez-Perez, A., Benjamins, V., Guarino, N., Uschold, M. (eds.) Workshop on the Applications of Ontologies and Problem-Solving Methods, ECAI 2000, Berlin (2000)

    Google Scholar 

  10. Brasethvik, T.: Conceptual modelling for domain specific document description and retrieval: An approach to semantic document modelling. PhD thesis, NTNU, Trondheim, Norway (2004)

    Google Scholar 

  11. Aula, A.: Query formulation in web information search. In: IADIS International Conference WWW/Internet (ICWI 2003), Algarve, Portugal, IADIS, pp. 403–410 (2003)

    Google Scholar 

  12. Fox, S., Karnawat, K., Mydland, M., Dumais, S., White, T.: Evaluating implicit measures to improve web search. ACM Transactions on Information Systems 23(2), 147–168 (2005)

    Article  Google Scholar 

  13. Jansen, B., Spink, A., Saracevic, T.: Real life, real users, and real needs: A study and analysis of user queries on the web. Information Processing and Management 36(2), 207–227 (2000)

    Article  Google Scholar 

  14. Spink, A., Wolfram, D., Jansen, B., Saracevic, T.: Searching the web: the public and their queries. Journal of the American Society for Information Science 52(3), 226–234 (2001)

    Article  Google Scholar 

  15. Guha, R., McCool, R., Miller, E.: Semantic search. In: (WWW2003). 12th International Conference on World Wide Web, pp. 700–709. ACM Press, New York (2003)

    Google Scholar 

  16. Rose, D., Levinson, D.: Understanding user goals in web search. In: Proceedings of WWW 2004, pp. 13–19. ACM Press, New York (2004)

    Chapter  Google Scholar 

  17. McGuinness, D.: Question answering on the semantic web. IEEE Intelligent Systems 19(1), 82–85 (2004)

    Article  Google Scholar 

  18. Bonino, D., Corno, F., Farinetti, L., Bosca, A.: Ontology driven semantic search. WSEAS Transaction on Information Science and Application 1(6), 1597–1605 (2004)

    Google Scholar 

  19. Braga, R., Werner, C., Mattoso, M.: Using ontologies for domain information retrieval. In: Proceedings of the 11th International Workshop on Database and Expert Systems Applications, pp. 836–840. IEEE Computer Society, Los Alamitos (2000)

    Chapter  Google Scholar 

  20. Kiryakov, A., Popov, B., Terziev, I., Manov, D.D.: Semantic annotation, indexing, and retrieval. Journal of Web Semantics 2(1), 49–79 (2004)

    Google Scholar 

  21. Paralic, J., Kostial, I.: Ontology-based information retrieval. In: Proceedings of the 14th International Conference on Information and Intelligent systems (IIS 2003), Varazdin, Croatia, pp. 23–28 (2003)

    Google Scholar 

  22. Rocha, C., Schwabe, D., de Aragao, M.: A hybrid approach for searching in the semantic web. In: Proceedings of WWW 2004, pp. 374–383. ACM Press, New York (2004)

    Chapter  Google Scholar 

  23. Song, J.F., Zhang, W.M., Xiao, W., Li, G.H., Xu, Z.N.: Ontology-based information retrieval model for the semantic web. In: EEE 2005, pp. 152–155. IEEE Computer Society, Los Alamitos (2005)

    Google Scholar 

  24. Nagypal, G.: Improving information retrieval effectiveness by using domain knowledge stored in ontologies. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM Workshops. LNCS, vol. 3762, pp. 780–789. Springer, Heidelberg (2005)

    Google Scholar 

  25. Tomassen, S., Gulla, J., Strasunskas, D.: Document space adapted ontology: Application in query enrichment. In: Kop, C., Fliedl, G., Mayr, H.C., Métais, E. (eds.) NLDB 2006. LNCS, vol. 3999, pp. 46–57. Springer, Heidelberg (2006)

    Google Scholar 

  26. Tartir, S., Arpinar, I., Moore, M., Sheth, A., Aleman-Meza, B.: OntoQA: Metric-based ontology quality analysis. In: IEEE Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources, Houston, TX, USA, pp. 45–53. IEEE Computer Society, Los Alamitos (2005)

    Google Scholar 

  27. Patel, C., Supekar, K., Lee, Y., Park, E.: OntoKhoj: A semantic web portal for ontology searching, ranking and classification. In: Proceedings of the Workshop on Web Information and Data Management, pp. 58–61. ACM Press, New York (2003)

    Chapter  Google Scholar 

  28. Brewster, C., Alani, H., Dasmahapatra, S., Wilks, Y.: Data driven ontology evaluation. In: International Conference on Language Resources and Evaluation, Lisbon, Portugal (2004)

    Google Scholar 

  29. Spyns, P., Reinberger, M.L.: Lexically evaluating ontology triples generated automatically from texts. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 563–577. Springer, Heidelberg (2005)

    Google Scholar 

  30. Buitelaar, P., Eigner, T., Declerck, T.: OntoSelect: A dynamic ontology library with support for ontology selection. In: Proceedings of the Demo Session at the International Semantic Web Conference, Hiroshima, Japan (2004)

    Google Scholar 

  31. Alani, H., Brewster, C.: Ontology ranking based on the analysis of concept structures. In: 3rd Intl. Conf. on Knowledge Capture (K-CAP 05), Banff, Canada, pp. 51–58. ACM Press, New York (2005)

    Chapter  Google Scholar 

  32. Supekar, K.: A peer-review approach for ontology evaluation. In: Proceedings of 8th International Protege Conference, Madrid, Spain (2005)

    Google Scholar 

  33. Ding, L., Finin, T., Joshi, A., Pan, R., Cost, R.S., Peng, Y., Reddivari, P., Doshi, V., Sachs, J.: Swoogle: A search and metadata engine for the semantic web. In: Proceedings of the 13th ACM Conference on Information and Knowledge Management (CIKM), pp. 652–659. ACM Press, New York (2004)

    Chapter  Google Scholar 

  34. Guarino, N., Welty, C.: 8. An Overview of OntoClean. In: Handbook on Ontologies, pp. 151–172. Springer, Heidelberg (2004)

    Google Scholar 

  35. Supekar, K., Patel, C., Lee, Y.: Characterizing quality of knowledge on semantic web. In: Proceedings of AAAI Florida AI Research Symposium (FLAIRS-2004) (2004)

    Google Scholar 

  36. Tomassen, S., Strasunskas, D.: Query terms abstraction layers. In: Meersman, R., Tari, Z., et al. (eds.) OTM 2006 Workshops. LNCS, vol. 4278, pp. 1786–1795. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer and Information Science, Norwegian University of Science and Technology, NO-7491 Trondheim, Norway

    Darijus Strasunskas & Stein L. Tomassen

Authors
  1. Darijus Strasunskas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stein L. Tomassen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Kevin Chen-Chuan Chang Wei Wang Lei Chen Clarence A. Ellis Ching-Hsien Hsu Ah Chung Tsoi Haixun Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Strasunskas, D., Tomassen, S.L. (2007). Web Search Tailored Ontology Evaluation Framework. In: Chang, K.CC., et al. Advances in Web and Network Technologies, and Information Management. APWeb WAIM 2007 2007. Lecture Notes in Computer Science, vol 4537. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72909-9_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-72909-9_41

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-72908-2

  • Online ISBN: 978-3-540-72909-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation