Abstract
This paper describes the results of an ongoing collaborative project between KPN Research and the Telematics Institute on multimedia information handling. The focus of the paper is the modelling and retrieval of audiovisual information. The paper presents a general framework for modeling multimedia information (ADMIRE) and discusses the application of this framework to the specific area of soccer video clips. The core of the paper is the integration of feature extraction and concept inference in a general framework for representing audio visual data. The work on feature extraction is built on existing feature extraction algorithms. The work on concept inference introduces a new approach to assigning semantics to collections of features in order to support concept-based retrieval, rather than feature-based retrieval. Finally, the paper describes our experiences with the implementation of the methods and techniques within the ADMIRE framework using a collection of commercially available tools. The latter is done by implementing a soccer video clip annotation and query tool.
Contact person for ADMIRE framework
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S. Adali., K.S. Candan, Y. Papakonstantinou, and V.S. Subrahmania, Query Caching and Optimization in Distributed Media Systems In Proc. of SIGMOD’96, Canada, pp137–148.
P. Aigraine, P. Joly and V. Longueville, Medium Knowledge-Based Macro-Segmentation of Video into Sequences. In Intelligent Multimedia Information Retrieval M. T. Maybury (Ed.) AAAI/MIT Press, 1997, pp 159–173
A. Akutsu, Y. Tonomura, Y. Ohba, and H. Hashimoto, Video Indexing Using Motion Vectors. In Proc. of SPIE Visual Comm. and Image Processing’ 92, Boston, Massachusetts, pp343–350, 1992
C. Baumgarten, and K. Meyer-Wegener, Towards a Scalable Networked Retrieval System for Searching Multimedia Databases. SIGIR’97 Networked Information Retrieval workshop, Philadelphia, July, 1997
C.H.C. Leung, J. Hibler, and N. Mwara, Content-based Retrieval in Multimedia Databases, In Computer Graphics, Vol. 28 No. 1, February 1994, pp 24–28
R.W. Picard and T.P. Minka, Visual texture for annotation, In Multimedia Systems, Springer Verlag, Vol. 3, No. 1, 1995, pp 3–13
J. C. Fuller Bach, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R Jain and C. Shu, Virage image search engine: An open framework for image management. In Proc. of the Symposium on Storage & Retrieval for Image and Video Databases VI, IS&T/SPIE, San Jose, California, Feb. 1996
]M.G. Brown, J.T. Foote, G.J.F Jones, K. Sparck Jones and S.J. Young, Automatic Contentbased Retrieval of Broadcast News. In Proceedings of ACM Multimedia, pp 35–43, San Francisco, 1995
S.F. Chang, W. Chen, H. Meng, H. Sundaram, and d. Zhong, VideoQ: An automatic content based video search system using visual cues. In Proc. of ACM Multimedia’ 97, Seattle, Washington, Nov. 1997
M.W. Davis and W.C. Ogden. QUILT: Implementing a Large Scale Cross-Language Text Retrieval System. In Proc. of SIGIR’97, Philadelphia, USA, pp. 91–98, July 1997.
M.E. Davis, Media streams: representing video for retrieval and repurposing, PhD. Thesis, MIT, 1995
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Stelle and P. Yanker. Query by Image and Video content: The QBIC System, IEEE Computer, September 1995, pp23–32
R.C. Gonzalez, & Woods, R.E. (1992). Digital Image Processing. Addison-Wesley
Gu J., and E.J. Neuhold, A data model for multimedia information retrieval. Proc. of 1st Int. Conf. on Multimedia Modeling, Singapore, 1993, p. 113–127
V.N. Gudivada, V.V. Raghavan, and K. Vanapipat, A Unified Approach to data Modelling and Retrieval for a Class of Image database applications. In Multimedia Database Systems, Issues and Research Directions, Subrahmanian, V.S., S. Jajodia (Eds.), Springer Verlag, pp37–78, 1996
W.I. Grosky, Managing Multimedia Information Database Systems. In Communications of the ACM, Vol. 40., No. 12, pp 72–80
V. Burrill, Group I Report: Authoring Systems, In Multimedia Systems and Applications, J.L. EncarnaÇÃo, J.D. Foley (Eds.), Springer-Verlag, 1994, pp 11–23
A.G. Hauptmann, and M. Witbrock. Informedia: News-on-Demand Multimedia Information Acquisition and Retrieval. In Intelligent Multimedia Retrieval. Maybary (Ed.), AAAI/MIT Press 1997, pp 215–239
J.N.H. Heemskerk, R.G. Heller, W. Jonker, E.J. Sommer & A. Woudstra (1997 Multi Media Manifestation Part II: Implementation of a Soccer VDS. KPN Research, R&D-RA-97-1036
R. Lienhart, S. Pfeiffer, and W. Effelsberg, Video Abstracting. In Communications of the ACM, Vol. 40, No.12, December 1997, pp55–62
I. Mani, D. House, M.T. Maybury and M. Green, Towards Content-Based Browsing of Broadcast News Video, In Intelligent Multimedia Information Retrieval, M. T. Maybury (Ed.) AAAI/MIT Press, 1997, pp 241–258
J.R. Parker, Algorithms for Image Processing and Computer Vision. John Wiley & Sons, Inc. 1997
A. Pentland, R. Picard, and S. Sclaroff, Photobook: Tools for Content Based Manipulation of Image Databases. In International Journal on Computer Vision, Vol. 18, No. 3, 1996, pp 233–154.
H.J.G. de Poot, F. Moelaert El-Hadidy and D.D. Velthausz (1997). Multi Media Manifestation Part I: Modelling a Soccer VDS using ADMIRE. Telematica Instituut, internal report IRS/97020.
R.K. Srihari, Automatic Indexing and Content-Based Retrieval of Captioned Images. In Special Issue of Computer, IEEE, September 1995 Content-Based Image Retrieval Systems, pp 49–56
K. Tsuda, and K. Yamamoto, M. Hirakawa, and T. Ichikawa, MORE: An object-oriented data model with a facility for changing object structures. IEEE on Knowledge and Data Engineering, vol. 3–4, 91, p. 444–460
H.J. Zhang, A. Kankanhalli, and S. Smoliar, Automatic Partitioning of Full Motion Video. In Multimedia System Vol. 1 No 1., pp 1–28, 1993.
H.J. Zhang, C.Y. Low, S.W. Smoliar and J.H. Wu, Video parsing, retrieval and browsing: an integrated and content-based solution. In Proc. 3rd ACM Int. Multimedia Conf., San Francisco, USA,’ 95, p. 15–24
D.D. Velthausz, Bal, C.M.R., Eertink, E.H., A Multimedia Information Object Model for Information Disclosure. MMM’96 proc. of the Third International Conference on MultiMedia Modelling, Toulouse, France, 12–15 November 1996, pp 289–304
D.D. Velthausz, Cost-effective networked based multimedia information retrieval. PhD. thesis to be published in 1998.
J.K. Wu, A.D. Narasimhalu, B.M. Mehtre, A.P. Lam and Y.J. Gao, CORE: a content-based retrieval engine for multimedia information systems. In Multimedia Systems, Vol. 3, No. 1, 1995, p. 25–41
E.A. Fox, R.M. Akscyn, R.K. Furuta, and J.L. Leggett (Eds), Special issue of Communication of the ACM on Digital Libararies, April 1995.
Narisimhalu, Special section on content-based retrieval. In Multimedia Systems, Vol. 3., No. 1, 1995, pp 1–2
D.B. Lenat, and R.V. Guha, Building Large Knowledge-Based Systems, Representation and Inference in the Cyc Project, Addison-Wesley Publishing Company, 1990
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Woudstra, A. et al. (1998). Modeling and Retrieving Audiovisual Information - A Soccer Video Retrieval System. In: Advances in Multimedia Information Systems. MIS 1998. Lecture Notes in Computer Science, vol 1508. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49651-3_16
Download citation
DOI: https://doi.org/10.1007/3-540-49651-3_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65107-9
Online ISBN: 978-3-540-49651-9
eBook Packages: Springer Book Archive