Jie Shao
Skip Abstract Section
Abstract
Searching relevant visual information based on content features in large databases is an interesting and changeling topic that has drawn lots of attention from both the research community and industry. This paper gives an overview of our investigations on effective and efficient video similarity search. We briefly introduce some novel techniques developed for two specific tasks studied in this PhD project: video retrieval in a large collection of segmented video clips, and video subsequence identification from a long unsegmented stream. The proposed methods for processing these two types of similarity queries have shown encouraging performance and are being incorporated into our prototype system of video search named UQLIPS, which has demonstrated some marketing potentials for commercialisation.
- http://www.comscore.com/press/release.asp?press=1678.Google Scholar
- S. Berchtold, D. A. Keim, and H.-P. Kriegel. The x-tree: An index structure for high-dimensional data. In VLDB, pages 28--39, 1996. Google ScholarDigital Library
- M. Bertini, A. D. Bimbo, and W. Nunziati. Video clip matching using mpeg-7 descriptors and edit distance. In CIVR, pages 133--142, 2006. Google ScholarDigital Library
- C. Böhm, S. Berchtold, and D. A. Keim. Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases. ACM Comput. Surv., 33(3):322--373, 2001. Google ScholarDigital Library
- K. Chakrabarti and S. Mehrotra. Local dimensionality reduction: A new approach to indexing high dimensional spaces. In VLDB, pages 89--100, 2000. Google ScholarDigital Library
- L. Chen and T.-S. Chua. A match and tiling approach to content-based video retrieval. In ICME, pages 417--420, 2001.Google Scholar
- L. Chen and R. T. Ng. On the marriage of lp-norms and edit distance. In VLDB, pages 792--803, 2004. Google ScholarDigital Library
- S.-C. S. Cheung and A. Zakhor. Efficient video similarity measurement with video signature. IEEE Trans. Circuits Syst. Video Techn., 13(1):59--74, 2003. Google ScholarDigital Library
- C.-Y. Chiu, C.-H. Li, H.-A. Wang, C.-S. Chen, and L.-F. Chien. A time warping based approach for video copy detection. In ICPR (3), pages 228--231, 2006. Google ScholarDigital Library
- C. Faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast subsequence matching in time-series databases. In SIGMOD Conference, pages 419--429, 1994. Google ScholarDigital Library
- J. H. Friedman and L. C. Rafsky. Multivariate generalizations of the wald-wolfowitz and smirnov two-sample tests. Ann. Statist., 7(4):697--717, 1979.Google ScholarCross Ref
- A. Gionis, P. Indyk, and R. Motwani. Similarity search in high dimensions via hashing. In VLDB, pages 518--529, 1999. Google ScholarDigital Library
- A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf, and A. J. Smola. A kernel method for the two-sample-problem. In NIPS, pages 513--520, 2006.Google ScholarDigital Library
- A. Hampapur, K.-H. Hyun, and R. M. Bolle. Comparison of sequence matching techniques for video copy detection. In Storage and Retrieval for Image and Video Databases (SPIE), pages 194--201, 2002.Google Scholar
- H. V. Jagadish, B. C. Ooi, K.-L. Tan, C. Yu, and R. Zhang. idistance: An adaptive b+ -tree based indexing method for nearest neighbor search. ACM Trans. Database Syst., 30(2):364--397, 2005. Google ScholarDigital Library
- K. Kashino, T. Kurozumi, and H. Murase. A quick search method for audio and video signals based on histogram pruning. IEEE Transactions on Multimedia, 5(3):348--357, 2003. Google ScholarDigital Library
- E. J. Keogh. Exact indexing of dynamic time warping. In VLDB, pages 406--417, 2002. Google ScholarDigital Library
- C. Kim and B. Vasudev. Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Techn., 15(1):127--132, 2005. Google ScholarDigital Library
- S.-L. Lee, S.-J. Chun, D.-H. Kim, J.-H. Lee, and C.-W. Chung. Similarity search for multidimensional data sequences. In ICDE, pages 599--608, 2000. Google ScholarDigital Library
- M. R. Naphade, M. M. Yeung, and B.-L. Yeo. A novel scheme for fast and efficient video sequence matching using compact signatures. In Storage and Retrieval for Image and Video Databases (SPIE), pages 564--572, 2000.Google Scholar
- Y. Peng and C.-W. Ngo. Clip-based similarity measure for query-dependent clip retrieval and video summarization. IEEE Trans. Circuits Syst. Video Techn., 16(5):612--627, 2006. Google ScholarDigital Library
- T. K. Sellis. Multiple-query optimization. ACM Trans. Database Syst., 13(1):23--52, 1988. Google ScholarDigital Library
- J. Shao, Z. Huang, H. T. Shen, X. Zhou, and Y. Li. Dynamic batch nearest neighbor search in video retrieval. In ICDE, pages 1395--1399, 2007.Google ScholarCross Ref
- J. Shao, Z. Huang, H. T. Shen, X. Zhou, E.-P. Lim, and Y. Li. Batch nearest neighbor search for video retrieval. IEEE Transactions on Multimedia, 10(3):409--420, 2008. Google ScholarDigital Library
- H. T. Shen, B. C. Ooi, X. Zhou, and Z. Huang. Towards effective indexing for very large video sequence database. In SIGMOD Conference, pages 730--741, 2005. Google ScholarDigital Library
- H. T. Shen, X. Zhou, Z. Huang, J. Shao, and X. Zhou. Uqlips: A real-time near-duplicate video clip detection system. In VLDB, pages 1374--1377, 2007. Google ScholarDigital Library
- D. R. Shier. Matchings and assignments. In J. L. Gross and J. Yellen, editors, Handbook of Graph Theory, pages 1103--1116. CRC Press, 2004.Google Scholar
- C. Snoek and M. Worring. Multimodal video indexing: A review of the state-of-the-art. Multimedia Tools Appl., 25(1):5--35, 2005. Google ScholarDigital Library
- I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2:67--93, 2001. Google ScholarDigital Library
- M. Vlachos, D. Gunopulos, and G. Kollios. Discovering similar multidimensional trajectories. In ICDE, pages 673--684, 2002. Google ScholarDigital Library
- A. Wald and J. Wolfowitz. On a test whether two samples are from the same population. Ann. Math. Statist., 11(2):147--162, 1940.Google ScholarCross Ref
- H. Wang, A. Divakaran, A. Vetro, S.-F. Chang, and H. Sun. Survey of compressed-domain features used in audio-visual indexing and analysis. J. Visual Communication and Image Representation, 14(2):150--183, 2003.Google ScholarCross Ref
- R. Weber, H.-J. Schek, and S. Blott. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In VLDB, pages 194--205, 1998. Google ScholarDigital Library
- X. Wu, A. G. Hauptmann, and C.-W. Ngo. Practical elimination of near-duplicates from web video search. In ACM Multimedia, pages 218--227, 2007. Google ScholarDigital Library
- J. Yuan, L.-Y. Duan, Q. Tian, S. Ranganath, and C. Xu. Fast and robust short video clip search for copy detection. In PCM (2), pages 479--488, 2004. Google ScholarDigital Library
- J. Zhang, N. Mamoulis, D. Papadias, and Y. Tao. All-nearest-neighbors queries in spatial databases. In SSDBM, pages 297--306, 2004. Google ScholarDigital Library
Index Terms
- Challenges and techniques for effective and efficient similarity search in large video databases
Recommendations
Distinct nearest neighbors queries for similarity search in very large multimedia databases
WIDM '09: Proceedings of the eleventh international workshop on Web information and data managementAs the volume of multimedia data available on internet is tremendously increasing, the content-based similarity search becomes a popular approach to multimedia retrieval. The most popular retrieval concept is the k nearest neighbor (kNN) search. For a ...
Adaptable similarity search using non-relevant information
VLDB '02: Proceedings of the 28th international conference on Very Large Data BasesMany modern database applications require content-based similarity search capability in numeric attribute space. Further, users' notion of similarity varies between search sessions. Therefore online techniques for adaptively refining the similarity ...
Efficient and effective similarity-based video retrieval
SISAP '10: Proceedings of the Third International Conference on SImilarity Search and APplicationsThe retrieval of videos of interest from large video collections is a main open problem which calls for the definition of new video content characterization techniques in term of both visual descriptors and semantic annotations. In this paper, we ...
Comments