Alberto Messina
ABSTRACT
Current Web technology has enabled the distribution of informative content through dynamic media platforms.
In addition, the availability of the same content in the form of digital multimedia data has dramatically increased.
Content-based, cross-media retrieval applications are needed to efficiently access desired information from this variety of data sources. This paper presents a novel approach for cross-media information aggregation, and describes a prototype system implementing this approach. The prototype adopts online newspaper articles and TV newscasts as information sources, to deliver a service made up of items including both contributions. Extensive experiments prove the effectiveness of the proposed approach in a real-world business context.
- J. W. Ahn, P. Brusilovsky, J. Grady, D. He, and S. Y.Syn. Open user profiles for adaptive news systems: help or harm? In Proc. of WWW07, pages 11--20,2007. Google Scholar
Digital Library
- J. Arlandis, P. Over, and W. Kraaij. Boundary Error Analysis and Categorization in the TRECVID News Story Segmentation Task. In Proc. of CIVR05, pages 103--112, 2005. Google ScholarDigital Library
- R. Basili, M. Cammisa, and E. Donati. RitroveRAI: A Web Application for Semantic Indexing and Hyperlinking of Multimedia News. In Proc. of the Intl. Semantic Web Conf., pages 97--111, 2005. Google ScholarDigital Library
- L. Bolelli, S. Ertekin, D. Zhou, and C. L. Giles. K-svmeans: A hybrid clustering algorithm for multi-type interrelated datasets. In Proc. of Web Intelligence 2007, pages 198--204, 2007. Google ScholarDigital Library
- F. Brugnara, M. Cettolo, M. Federico, and D. Giuliani. A system for the segmentation and transcription of Italian radio news. In Proc. of RIAO, Content-Based Multimedia Information Access, 2000.Google ScholarDigital Library
- A. S. Das, M. Datar, A. Garg, and S. Rajaram. Google news personalization: scalable online collaborative filtering. In Proc. of WWW07, pages 271--280, 2007. Google ScholarDigital Library
- K. Deschacht and M.-F. Moens. Finding the Best Picture: Cross-Media Retrieval of Content. In Proc. of ECIR 2008, pages 539--546, 2008. Google ScholarDigital Library
- M. Di Iulio and A. Messina. Use of Probabilistic Clusters Supports for Broadcast News Segmentation. In DEXA Workshops, pages 600--604, 2008. Google ScholarDigital Library
- M. Farr¶us, P. Ejarque, A. Temko, and J. Hernando. Histogram equalization in svm multimodal person verification. In Proc. of the Intl. Conf. on Advances in Biometrics, pages 819--827, 2007. Google ScholarDigital Library
- M. Henzinger, B. wei Chang, B. Milch, and S. Brin. Query-free news search. In Proc. of WWW03, pages 1--10, 2003. Google ScholarDigital Library
- V. Kashyap and A. Sheth. Semantic and schematic similarities between database objects: a context-based approach. The VLDB Journal, 5(4):276--304, 1996. Google ScholarDigital Library
- X. Li, J. Yan, Z. Deng, L. Ji, W. Fan, B. Zhang, and Z. Chen. A novel clustering-based RSS aggregator. In Proc. of WWW07, pages 1309--1310, 2007. Google ScholarDigital Library
- A. Messina. An application of NLP and audiovisual content analysis for integration of multimodal databases of current events. In Proc. of NLDB08, pages 350--351, 2008. Google ScholarDigital Library
- A. Messina, R. Borgotallo, G. Dimino, D. A. Gnota, and L. Boch. Ants: A complete system for automatic news programme annotation based on multimodal analysis. In Proc. of WIAMIS 2008, 2008. Google ScholarDigital Library
- H. T. Pao, Y. Y. Xu, S. C. Chung, and H. C. Fu. Constructing and application of multimedia tv news archives. In Intl. Workshop on Multimedia Content Analysis and Mining, pages 151--160, 2007. Google ScholarDigital Library
- C. Wang, M. Zhang, S. Ma, and L. Ru. Automatic online news issue construction in web environment. In Proc. of WWW08, pages 457--466, 2008. Google ScholarDigital Library
- D. Webster, W. Huang, D. Mundy, and P. Warren. Context-orientated news filtering for web 2.0 and beyond. In Proc. of WWW06, pages 1001--1002, 2006. Google ScholarDigital Library
- X. Wu, J. Li, Y. Zhang, S. Tang, and S. Y. Neo. Personalized multimedia web summarizer for tourist. In Proc. of WWW08, pages 1025--1026, 2008. Google ScholarDigital Library
- C. Xu, J. Wang, H. Lu, and Y. Zhang. A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans. on Multimedia, 10(3):421--436, 2008. Google ScholarDigital Library
- Y. Zhang, C. Xu, Y. Rui, J. Wang, and H. Lu. Semantic event extraction from basketball games using multi-modal analysis. In Proc. of the ICME 2007, pages 2190--2193, 2007.Google ScholarCross Ref
Index Terms
- A generalised cross-modal clustering method applied to multimedia news semantic indexing and retrieval
Recommendations
A new approach to cross-modal multimedia retrieval
MM '10: Proceedings of the 18th ACM international conference on MultimediaThe problem of joint modeling the text and image components of multimedia documents is studied. The text component is represented as a sample from a hidden topic model, learned with latent Dirichlet allocation, and images are represented as bags of ...
Cross-media Relevance Computation for Multimedia Retrieval
MM '17: Proceedings of the 25th ACM international conference on MultimediaIn this paper, we summarize our works for cross-media retrieval where the queries and retrieval content are of different media types. We study cross-media retrieval in the context of two applications, i.e., ~image retrieval by textual queries, and ...
Multi modal semantic indexing for image retrieval
CIVR '10: Proceedings of the ACM International Conference on Image and Video RetrievalPopular image retrieval schemes generally rely only on a single mode, (either low level visual features or embedded text) for searching in multimedia databases. Many popular image collections (eg. those emerging over Internet) have associated tags, ...
Comments