ABSTRACT
Multimedia does not exhibit a unique semantics but multiple semantics that are influenced by many factors. Current approaches and systems lack from considering this problemin its entirety. What is needed is a holistic approach that describes and embraces the complex and challenging problem of multimedia semantics. Consequently, we are developing with the Semantics Ecosystem (SES) an approach that aimsat providing a "framework" for solving this problem. The SES defines five types of semantics and their relationships to each other and to the real world. In the paper, we present the SES and show its application to the domain of authoring multimedia albums. We show the benefits of having such a theoretical framework to handle the semantics of multimedia albums. The SES allows us to better understand, describe, and communicate the many different factors that are influencing multimedia semantics.
- B. Adams, C. Dorai, and S. Venkatesh. Towards automatic extraction of expressive elements from motion pictures: Tempo. In IEEE International Conference on Multimedia and Expo (II), pages 641--644, 2000.Google ScholarCross Ref
- B. Adams, S. Venkatesh, and R. Jain. IMCE: Integrated media creation environment. TOMCCAP, 1(3):211--247, 2005. Google ScholarDigital Library
- S. Boll, P. Sandhaus, A. Scherp, and U. Westermann. Semantics, content, and structure of many for the creation of personal photo albums. In Proc. of the ACM Multimedia Conf., Brave New Topics Session; Augsburg, Germany. ACM Press, Sept. 2007. Google ScholarDigital Library
- G. Brososky. Signs, symbols and icons (Encyclopedia of educational technology), 2006. Retrieved April 5, 2007, from http://coe.sdsu.edu/eet/Articles/ssilayout/start.htm.Google Scholar
- P. Brusilovsky and M. T. Maybury. From adaptive hypermedia to the adaptive Web. Communications of the ACM, 45(5):30--33, 2002. Google ScholarDigital Library
- P. R. Cohen and C. R. Beal. Natural semantics for a mobile robot. Technical Report 00-59, Department of Computer Science, University of Massachusettes, Amherst, MA, 2000. Google ScholarDigital Library
- A. K. Dey and G. D. Abowd. Towards a Better Understanding of Context and Context--Awareness. Technical Report GIT-GVU-99-22, Graphics, Visualization and Usability Center and College of Computing, Georgia Institute of Technology, Atlanta, GA, USA, June 1999.Google Scholar
- J. Fink, A. Kobsa, and J. Schreck. Personalized hypermedia information through adaptive and adaptable system features: User modeling, privacy and security issues. In A. Mullery, M. Besson, M. Campolargo, R. Gobbi, and R. Reed, editors, Intelligence in Services and Networks: Technology for Cooperative Competition, pages 459--467. Springer-Verlag, 1997. Google ScholarDigital Library
- W. I. Grosky, D. V. Sreenath, and F. Fotouhi. Emergent Semantics and the Multimedia Semantic Web. SIGMOD Rec., 31(4):54--58, 2002. Google ScholarDigital Library
- W. I. Grosky, D. V. Sreenath, and F. Fotouhi. Deriving emergent semantics. In Association for Information Systems, SIG on Semantic Web and IS, Retrieved January 9, 2007, from http://www.sigsemis.org/articles/grosky/document view/, Nov. 2004.Google Scholar
- A. Kobsa, J. Koenemann, and W. Pohl. Personalized Hypermedia Presentation Techniques for Improving Online Customer Relationships. In The Knowledge Engineering Review, volume 16, pages 111--155. Cambridge University Press, 2001. Google ScholarDigital Library
- C. A. Lindley, J. R. Davis, F. Nack, and L. W. Rutledge. The application of rhetorical structure theory to interactive news program generation from digital archives. Technical report, CWI (Centre for Mathematics and Computer Science), Amsterdam, The Netherlands, 2001. Google ScholarDigital Library
- K. Popper. Three worlds {the tanner lecture on human values: Delivered at the university of michigan}, Apr. 1978. Retrieved May 7, 2007, from http://www.tannerlectures.utah.edu/lectures/popper80.pdf.Google Scholar
- S. Santini, A. Gupta, and R. Jain. Emergent semantics through interaction in image databases. IEEE Transactions on Knowledge and Data Engineering, 13(3):337--351, 2001. Google ScholarDigital Library
- S. Santini and R. Jain. The "El NiÜno"; Image Database System. In IEEE Int. Conf. on Multimedia Computing and Systems, Vol. 1, pages 524--529, 1999. Google ScholarDigital Library
- A. Scherp. A Component Framework for Personalized Multimedia Applications. PhD thesis, Carl von Ossietzky University of Oldenburg, School of Computing Science, Business Administration, Economics and Law, Department of Computing Science, 2007.Google Scholar
- A. Scherp and S. Boll. Context-driven smart authoring of multimedia content with xSMART. In Proc. of the 13th annual ACM Int. Conf. on Multimedia; Hilton, Singapore, pages 802--803. ACM Press, 2005. Google ScholarDigital Library
- A. Scherp and S. Boll. MM4U-a framework for creating personalized multimedia content. In S. Nepal and U. Srinivasan, editors, Managing Multimedia Semantics, chapter 11, pages 246--287. Idea Group Publishing, 2005.Google Scholar
- A. Scherp and S. Boll. Paving the Last Mile for Multi-Channel Multimedia Presentation Generation. In Y.-P. P. Chen, editor, Proc. of the 11th Int. Conf. on Multimedia Modeling; Melbourne, Australia, pages 190--197. IEEE Computer Society Press, Jan. 2005. Google ScholarDigital Library
- A. Scherp, S. Boll, and H. Cremer. Emergent semantics in personalized multimedia content. J. of Digital Information Management, 5(2), Apr. 2007.Google Scholar
- B. Schilit, N. Adams, and R. Want. Context-Aware Computing Applications. In Workshop on Mobile Computing Systems and Applications; Santa Cruz, CA, USA, pages 85--90. IEEE Computer Society Press, 1994.Google Scholar
- A. Schmidt, M. Beigl, and H.-W. Gellersen. There is more to context than location. Computers & Graphics, 23(6):893--901, 1999.Google ScholarCross Ref
- D. Sreenath, W. Grosky, and F. Fotouhi. Deriving emergent web page semantics. In Workshop on Implicit Measures of User Interests and Preferences at the 26th Annual Int. ACM SIGIR Conf.; Toronto, Canada, Aug. 2003.Google Scholar
- Stanford Encyclopedia of Philosophy, USA. Karl Popper (Stanford encyclopedia of philosophy), Oct. 2006. Retrieved June 28, 2007, from http://plato.stanford.edu/entries/popper/.Google Scholar
- U. Westermann and R. Jain. E-a generic event model for event-centric multimedia data management in eChronicle applications. In Proc. of the 22nd Int. Conf. on Data Engineering Workshops, page 106. IEEE Computer Society Press, 2006. Google ScholarDigital Library
- U. Westermann and R. Jain. Toward a common event model for multimedia applications. IEEE Multimedia, 14(1):19--29, Jan./Mar. 2007. Google ScholarDigital Library
- Wikipedia. 4 (number), June 2007. Retrieved July 3, 2007, from http://en.wikipedia.org/wiki/4 (number)#In other fields.Google Scholar
- 3rd Special Workshop on Multimedia Semantics; Pisa, Italy, June 2005. Retrieved January 30, 2007, from http://www.kettering.edu/<pstanche/wms05homepage/wms05.html.Google Scholar
Index Terms
- Towards an ecosystem for semantics
Recommendations
An Ecosystem for Semantics
The article presents a theoretical approach to semantics that embraces the complex and challenging problems associated with authoring multimedia albums.
Template Semantics for Model-Based Notations
We propose a template-based approach to structuring the semantics of model-based specification notations. The basic computation model is a nonconcurrent, hierarchical state-transition machine (HTS), whose execution semantics are parameterized. Semantics ...
Semantics for an Actor-Based Real-Time Language
WPDRTS '96: Proceedings of the 4th International Workshop on Parallel and Distributed Real-Time SystemsWe give formal semantics for a distributed concurrent object-oriented real-time programming language based on a variant of the actor model which includes an extension enabling the specification of time constraints on message-invocation. Real-time ...
Comments