Skip to main content
SpringerLink
Log in

Knowledge-Supported Segmentation and Semantic Contents Extraction from MPEG Videos for Highlight-Based Annotation, Indexing and Retrieval

  • Conference paper
Advanced Intelligent Computing Theories and Applications. With Aspects of Theoretical and Methodological Issues (ICIC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5226))

Included in the following conference series:

Abstract

Automatic recognition of highlights from videos is a fundamental and challenging problem for content-based indexing and retrieval applications. In this paper, we propose techniques to solve this problem by using knowledge supported extraction of semantic contents, and compressed-domain processing is employed for efficiency. Firstly, video shots are detected by using knowledge-supported rules. Then, human objects are detected via statistical skin detection. Meanwhile, camera motion like zoom in is identified. Finally, highlights of zooming in human objects are extracted and used for annotation, indexing and retrieval of the whole videos. Results from large data of test videos have demonstrated the accuracy and robustness of the proposed techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cotsaces, C., Nikolaidis, N., Pitas, I.: Video Shot Detection and Condensed Representation: A Review. IEEE Signal Proc. Mag. 23(2), 28–37 (2006)

    Article  Google Scholar 

  2. Rasheed, Z., Shah, M.: Detection and Representation of Scenes in Videos. IEEE T-Multimedia 7(6), 1097–1105 (2005)

    Article  Google Scholar 

  3. Fang, H., Jiang, J., Feng, Y.: A Fuzzy Logic Approach for Detection of Video Shot Boundaries. Pattern Recognition 39(11), 2092–2100 (2006)

    Article  MATH  Google Scholar 

  4. Tan, Y.P., Saur, D.D., Kulkarni, S.R., Ramadge, P.J.: Rapid Estimation of Camera Motion from Compressed Video with Application to Video Annotation. IEEE-TCSVT 10(1), 133–146 (2000)

    Google Scholar 

  5. Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., Zhang, B.: A Formal Study of Shot Boundary Detection. IEEE-TCSVT 17(2), 168–186 (2007)

    Google Scholar 

  6. Sebe, N., Lew, M.S., Smeulders, A.W.M.: Editorial Introduction: Video retrieval and Summarization. J. CVIU. 92(2-3), 141–146 (2003)

    Google Scholar 

  7. Boccignone, G., Chianese, A., Moscato, V., Picariello, A.: Foveated Shot Detection for Video Segmentation. IEEE T-CSVT 15(3), 365–377 (2005)

    Google Scholar 

  8. Zhang, H.J., Low, S.Y., Smoliar, S.W.: Video Parsing and Browsing using Compressed Data. Multimedia Tools and Applications 1(1), 89–111 (1995)

    Article  Google Scholar 

  9. Bescos, J., Cisneros, G., Martinez, J.M., Menendez, J.M., Cabrera, J.: A Unifoed Model for Techniques on Video-Shot Transition Detection. IEEE T-Multimedia 7(2), 293–307 (2005)

    Article  Google Scholar 

  10. Ekin, A., Tekalp, M., Mehrotra, R.: Automatic Soccer Video Analysis and Summarization. IEEE T-IP 12(7), 796–807 (2003)

    Google Scholar 

  11. Duan, L.-Y., Xu, M., Tian, Q., Xu, C.-S., Jin, J.S.: A Unified Framework for Semantic Shot Classification in Sports Video. IEEE T-Multimedia 7(6), 1066–1083 (2005)

    Article  Google Scholar 

  12. Phung, S.L., Bouzerdoum, A., Chai, D.: Skin Segmentation Using Color Pixel Classification: Analysis and Comparison. IEEE T-PAMI 27(1), 148–154 (2005)

    Google Scholar 

  13. Sigal, L., Sclaroff, S., Athitsos, V.: Skin Color-Based Video Segmentation under Time-Varying Illumination. IEEE T-PAMI 26(7), 862–877 (2004)

    Google Scholar 

  14. Jones, M.J., Rehg, J.M.: Statistical Color Models with Application to Skin Detection. Int. J. Computer Vision. 46(1), 81–96 (2002)

    Article  MATH  Google Scholar 

  15. Kakumanu, P., Makrogiannis, S., Bourbakis, N.: A Survey of Skin-Color Modeling and Detection Methods. Pattern Recognition 40, 1106–1122 (2007)

    Article  MATH  Google Scholar 

  16. Habili, N., Lim, C.C., Moini, A.: Segmentation of the Face and Hands in Sign Language Video Sequences Using Color and Motion Cues. IEEE-TCSVT 14(8), 1086–1097 (2004)

    Google Scholar 

  17. Akutsu, A., Tonomura, Y., Hashimoto, H., Ohba, Y.: Video Indexing using Motion Vectors. In: Proc. SPIE Conf. Visual Commu. And Image Processing, vol. 1818, pp. 1522–1530 (1992)

    Google Scholar 

  18. Tan, Y.P., Kulkarni, S.R., Ramadge, P.J.: A New Method for Camera Motion Parameter Estimation. In: Proc. ICIP, vol. 1, pp. 406–409 (1995)

    Google Scholar 

  19. Kobla, V., Doermann, D., Lin, K.-I.: Archiving, Indexing, and Retrieval of Video in the Compressed Domain. In: Proc. SPIE, vol. 2916, pp. 78–89 (1996)

    Google Scholar 

  20. Ewerth, R., Schwalb, M., Tessmann, P., Freisleben, B.: Estimation of Arbitrary Camera Motion in MPEG videos. In: Proc. ICPR., vol. 1, pp. 512–515 (2004)

    Google Scholar 

  21. Dante, A., Brookes, M.: Precise Real-time Outlier Removal from Motion Vector Fields for 3D Reconstruction. In: Proc. ICIP, pp. 393–396 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Informatics, University of Bradford, BD7 1DP, UK

    Jinchang Ren, Juan Chen, Jianmin Jiang & Stan S. Ipson

Authors
  1. Jinchang Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jianmin Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stan S. Ipson
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Automation, University of Science and Technology of China, 230026, Hefei, Anhui, China

    De-Shuang Huang

  2. Applied Computational Intelligence Laboratory, P.O. Box

    Donald C. Wunsch II

  3. Arlington, USA

    Daniel S. Levine

  4. Graduate School of Electrical Engineering, University of Ulsan, Korea, San 29, Mugeo-Dong, 680 - 749, Nam-Ku, Ulsan, Korea

    Kang-Hyun Jo

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ren, J., Chen, J., Jiang, J., Ipson, S.S. (2008). Knowledge-Supported Segmentation and Semantic Contents Extraction from MPEG Videos for Highlight-Based Annotation, Indexing and Retrieval. In: Huang, DS., Wunsch, D.C., Levine, D.S., Jo, KH. (eds) Advanced Intelligent Computing Theories and Applications. With Aspects of Theoretical and Methodological Issues. ICIC 2008. Lecture Notes in Computer Science, vol 5226. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87442-3_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-87442-3_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-87440-9

  • Online ISBN: 978-3-540-87442-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation