Skip to main content
SpringerLink
Log in

Frame rate up-conversion based on dual criterion motion estimation and motion vector adjustment

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper presents a novel motion-compensated frame rate up-conversion algorithm that uses dual criterion motion estimation to obtain accurate motion vectors in the circumstance of scene luminance changing. In the proposed algorithm, we also present a selective vector median filtering method and a motion vector refinement method to address block mismatching problem. Finally, a motion-compensated interpolation algorithm based on adaptive overlapped block motion compensation is proposed to reduce block artifact. Experimental results demonstrate that the proposed algorithm improves visual qualities compared with the existing algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ci, W., Lei, Z., Yuwen, H., Yap-Peng, T.: Frame rate up-conversion using trilateral filtering. IEEE Trans. Circuits Syst. Video Technol. 20, 886–893 (2010)

    Article  Google Scholar 

  2. Jung, H.S., Kim, U.S., Sunwoo, M.H.: Simplified frame rate up-conversion algorithm with low computational complexity. In: Proceedings of the 20th European Signal Processing Conference (EUSIPCO), pp. 385–389 (2012)

  3. Lei, Z., Ci, W., Wenjun, Z., Yap-Peng, T.: Frame rate up-conversion with edge-weighted motion estimation and trilateral interpolation. In: IEEE International Symposium on Circuits and Systems. ISCAS 2009, pp. 1637–1640

  4. Gunjae, K., Kyoung Won, L., Seung Jong, C.: Complementary block-based motion estimation for frame rate up-conversion. In: IEEE International Conference on Consumer Electronics (ICCE), 2011, pp. 523–524

  5. Cekic, M.M., Bayazit, U.: New frame rate up-conversion based on foreground/background segmentation. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2011)

  6. Akram, M., Izquierdo, E.: Fast motion estimation for surveillance video compression. Signal Image Video Process. 7, 1103–1112 (2013)

    Article  Google Scholar 

  7. Liu, T., Lo, K.-T., Feng, J., Zhang, X.: Frame interpolation scheme using inertia motion prediction. Signal Process.: Image Commun. 18, 221–229 (2003)

    MATH  Google Scholar 

  8. Liu, S., Jay Kuo, C.C., Kim, J.: Hybrid global-local motion compensated frame interpolation for low bit rate video coding. J. Vis. Commun. Image Represent. 14, 58–76 (2003)

    Article  Google Scholar 

  9. Hongbin, L., Ruiqin, X., Debin, Z., Ma, S., Wen, G.: Multiple hypotheses Bayesian frame rate up-conversion by adaptive fusion of motion-compensated interpolations. IEEE Trans. Circuits Syst. Video Technol. 22, 1188–1198 (2012)

    Article  Google Scholar 

  10. Tsai, T., Lin, H.: Hybrid frame rate up conversion method based on motion vector mapping. IEEE Trans. Circuits Syst. Video Technol. 23, 1901–1910 (2013)

  11. Demin, W., Vincent, A., Blanchfield, P., Klepko, R.: Motion-compensated frame rate up-conversion part II: new algorithms for frame interpolation. IEEE Trans. Broadcast. 56, 142–149 (2010)

    Article  Google Scholar 

  12. Benois-Pineau, J., Nicolas, H.: A new method for region-based depth ordering in a video sequence: application to frame interpolation. J. Vis. Commun. Image Represent. 13, 363–385 (2002)

    Article  Google Scholar 

  13. Bo-Won, J., Gun-Ill, L., Sung-Hee, L., Rae-Hong, P.: Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure. IEEE Trans. Consum. Electron. 49, 499–508 (2003)

  14. Hyeongchul, O., Joohyun, L., Changki, M., Jechang, J.: Frame interpolation method based on adaptive threshold and adjacent pixels. In: 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), pp. 264–267 (2010)

  15. Byeong-Doo, C., Jong-Woo, H., Chang-Su, K., Sung-Jea, K.: Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. IEEE Trans. Circuits Syst. Video Technol. 17, 407–416 (2007)

    Article  Google Scholar 

  16. Byung-Tae, C., Sung-Hee, L., Sung-Jea, K.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consum. Electron. 46, 603–609 (2000)

    Article  Google Scholar 

  17. Lee, Y.L., Nguyen, T.: Method and architecture design for motion compensated frame interpolation in high-definition video processing. In: Proceedings of IEEE International Symposium on Circuits Systems, pp. 1633–1636 (2009)

  18. Hyungjun, L., Dong Yoon, K., Hyun Wook, P., Jun Ho, C., Se Hyeok, P., Jae Hyun, K.: Motion estimation with adaptive block size for motion-compensated frame interpolation. In: Picture Coding Symposium (PCS), pp. 325–328 (2012)

  19. Orchard, M.T., Sullivan, G.J.: Overlapped block motion compensation: an estimation-theoretic approach. IEEE Trans. Image Process. 3, 693–699 (1994)

    Article  Google Scholar 

  20. Xiang You-jun, L.E.I., Wei-yu, X.I.E.: Research of block matching criterion for motion estimation. Comput. Sci., p. 09 (2009)

  21. Zhu, S., Ma, K.-K.: A new diamond search algorithm for fast block-matching motion estimation. IEEE Trans. Image Process. 9, 287–290 (2000)

    Article  Google Scholar 

  22. Jing, X., Chau, L.-P.: An efficient three-step search algorithm for block motion estimation. IEEE Trans. Multimed. 6, 435–438 (2004)

    Article  Google Scholar 

  23. Jain, J., Jain, A.: Displacement measurement and its application in interframe image coding. IEEE Trans. Commun. 29, 1799–1808 (1981)

    Article  Google Scholar 

  24. Lai, Y.-K., Chen, L.-G.: A data-interlacing architecture with two-dimensional data-reuse for full-search block-matching algorithm. IEEE Trans. Circuits Syst. Video Technol. 8, 124–127 (1998)

    Article  MathSciNet  Google Scholar 

  25. Tasdizen, O., Hamzaoglu, I.: Computation reduction techniques for vector median filtering and their hardware implementation. In: 2010 13th Euromicro Conference on Digital System Design: Architectures, Methods and Tools (DSD), pp. 731–736 (2010)

  26. Jiefu, Z., Keman, Y., Jiang, L., Shipeng, L.: A low complexity motion compensated frame interpolation method. In: ISCAS. IEEE International Symposium on Circuits and Systems, 2005, pp. 4927–4930 (2005)

  27. Jingjing, Z., Eryan, Y., Daojin, L.: An efficient motion estimation algorithm for frame rate conversion. In: Microelectronics and Electronics (PrimeAsia). Asia Pacific Conference on Postgraduate Research in, 2010, pp. 97–100 (2010)

  28. Truong Quang, V., Young-Chul, K., Sung-Hoon, H.: Frame rate up-conversion using forward-backward jointing motion estimation and spatio-temporal motion vector smoothing. In: Computer Engineering & Systems, : ICCES 2009. International Conference on, 2009, pp. 605–609 (2009)

  29. Suk-Ju, K., Kyoung-Rok, C., Young Hwan, K.: Motion compensated frame rate up-conversion using extended bilateral motion estimation. IEEE Trans. Consum. Electron. 53, 1759–1767 (2007)

    Article  Google Scholar 

  30. Chengzhou, T., Ronggang, W., Wenmin, W.: Adaptive motion estimation order for frame rate up-conversion. In: IEEE International Symposium on Circuits and Systems (ISCAS) 2013, pp. 2992–2995

Download references

Acknowledgments

This research is supported by two projects from committee on science and technology of Chongqing under Grant No. cstc2013jcsf0149, cstc2012gg-sfgc0079, and cstc2013yykfB0233, respectively.

Author information

Authors and Affiliations

  1. College of Automation,Chongqing University of Posts and Telecommunications, Nan’an District, Chongqing, 400065, China

    Junhua Chen

  2. Intelligent Multimedia Technology Research Center, Automated Reasoning and Cognition Key Laboratory of Chongqing, Chongqing, Institute of Green and Intelligent Technology, Chinese Academy of Sciences, 266 Fangzheng Ave, Shuitu technology development zone, Beibei District, Chongqing, 400714 , China

    Yanfei Liu

Authors
  1. Junhua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanfei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanfei Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, J., Liu, Y. Frame rate up-conversion based on dual criterion motion estimation and motion vector adjustment. SIViP 9, 1861–1869 (2015). https://doi.org/10.1007/s11760-014-0675-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-014-0675-y

Keywords

Search

Navigation