Skip to main content
SpringerLink
Log in

Video retargeting using optimized crop-and-scale

  • Published:
Journal of Shanghai University (English Edition)

Abstract

Mobile devices are increasingly powerful in multimedia transmitting and browsing. However, the small screen and different aspect ratios of mobile devices lower visual quality while watching images or videos. Video retargeting is aim at fitting an existing video into arbitrary size and aspect ratio. Previous content-aware retargeting methods are mostly high computational cost, which limits their applications on the portable devices with low computation ability. In this paper, a new crop-and-scale approach is presented to adapt video to better suit the target display. We automatically find the optimal parameters of cropping window using the dynamic programming method, and then scale it to fit the target display. The cropping window can smoothly shift during a shot to follow the movement of important objects. The retargeting results using our approach introduce no deformation and jitter effects over the whole video. Experimental results show the success of our approach on adapting a variety of source videos to small display sizes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wolf L, Guttmann M, Cohen-Or D. Nonhomogeneous content-driven video-retargeting [C]// Proceedings of IEEE International Conference on Computer Vision (ICCV), Rio de Janeiro. 2007: 1–7.

  2. Wang Y S, Fu H B, Sorkine O, Lee T Y, Seidel H P. Motion-aware temporal coherence for video resizing [J]. ACM Transactions on Graphics, 2009, 28(5), DOI: 10.1145/1618452.1618473.

  3. Rubinstein M, Shamir A, Avidan S. Improved seam carving for video retargeting [J]. ACM Transactions on Graphics, 2008, 27(3), DOI: 10.1145/1399504.1360615.

  4. Matthias G, Vivek K, Han M, Irfan E. Discontinuous seam-carving for video retargeting [C]// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, San Francisco. 2010: 569–576.

  5. Thomas D, Philippe D, Hermann N. Pan, zoom, scan-time-coherent, trained automatic video cropping [C]// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Alaska. 2008: 1–8.

  6. Yuan Z, Lu T R, Yu H, Wu D P, Yu H. Video retargeting: A visual-friendly dynamic programming approach [C]// Proceedings of IEEE International Conference on Image Processing, Hong Kong. 2010: 2857–2860.

  7. Liu F, Gleicher M. Video retargeting: Automating pan and scan [C]// Proceedings of ACM International Conference on Multimedia, Santa Barbara. 2006: 241–250.

  8. Xue Y Z, Liu Z, Shi R. Saliency detection using multiple region-based features [J]. Optical Engineering, 2011, DOI: 10.1117/1.3582338.

  9. Viola P, Jones M J. Robust real-time face detection [J]. International Journal of Computer Vision, 2004, 57(2): 137–154.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Communication and Information Engineering, Shanghai University, Shanghai, 200072, P. R. China

    Yin-zhu Xue  (薛银珠), Huan Du  (杜 欢), Zhi Liu  (刘 志) & Zhao-yang Zhang  (张兆杨)

  2. Ministry of Education, Key Laboratory of Advanced Display and System Application (Shanghai University), Shanghai, 200072, P. R. China

    Zhi Liu  (刘 志) & Zhao-yang Zhang  (张兆杨)

Authors
  1. Yin-zhu Xue  (薛银珠)
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huan Du  (杜 欢)
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Liu  (刘 志)
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhao-yang Zhang  (张兆杨)
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhi Liu  (刘 志).

Additional information

Project supported by the the Science and Technology Commission of Shanghai Municipality (Grant No.11ZR1413000), the Innovation Program for Graduate Students of Shanghai University (Grant No.SHUCX112125), and the Key Laboratory for Advanced Displays and System Appliction (Shanghai University), Ministry of Education, China (Grant No.P201004)

About this article

Cite this article

Xue, Yz., Du, H., Liu, Z. et al. Video retargeting using optimized crop-and-scale. J. Shanghai Univ.(Engl. Ed.) 15, 331–334 (2011). https://doi.org/10.1007/s11741-011-0746-2

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11741-011-0746-2

Keywords

Search

Navigation