Skip to main content
SpringerLink
Log in

An effiicient full frame algorithm for object-based error concealment in 3D depth-based video

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In real-time video transmission, the loss of packet results in visual quality degraded for the succeeding frames. This paper proposes an efficient full frame algorithm for depth-based 3-D videos. Each frame can be regarded as combination of objects. True motion estimation (TME) and depth map are exploited to calculate the motion vector (MV) for each object. In this paper, the object is defined as the pixels with the same MV and similar depth value. The object-based MV can extrapolate each object in reference frame to reconstruct the damage frame. In the consideration of computational complexity, in this method, only the high frequency regions need to execute TME. In this paper, we provide a new method to obtain the objects according to temporal and depth information. From the simulation results, our algorithm gives better visual quality and PSNR in most case with lower complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Chen MJ, Chen CS, Chi MC (2005) Temporal error concealment algorithm by recursive block-matching principle. IEEE Trans Circ Syst Video Technol 15(11):1385–1393

    Article  Google Scholar 

  2. Chen C, Liu Y, Yang Z, Bu J, Deng X (2008) Multi-frame error concealment for H.264/AVC frames with complexity adaptation. IEEE Trans Consum Electron 54(3):1422–1429

    Article  Google Scholar 

  3. Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3DTV”. Proc SPIE Stereoscopic Displays Virtual Real Syst XI 5291:93–104

    Google Scholar 

  4. Hong CS (2006) “An object-base motion vector recovery strategy for H.264/AVC,” National Cheng Kung University of Education, Master dissertation

  5. Liu Y, Wang J, Zhang H (2010) Depth image-based temporal error concealment for 3-D video transmission. IEEE Trans Circ Syst Video Technol 20(4):600–604

    Article  Google Scholar 

  6. Tai SC, Chen YR, Huang ZB, Wang CC (2008) A multi-pass true motion estimation scheme with motion vector propagation for frame rate up-conversion applications. IEEE/OSA J Display Technol 4(2):188–197

    Article  Google Scholar 

  7. Thaipanich T, Wu PH, Kuo CCJ (2007) Video error concealment with outer and inner boundary matching algorithm. SPIE 6696:669607

    Google Scholar 

  8. Tsekeridou S, Pitas I (2000) MPEG-2 error concealment based on block-matching principles. IEEE Trans Circ Syst Video Technol 10(4):646–658

    Article  Google Scholar 

  9. Wang Z, Yu Y, Zhang D (1998) Best neighboring matching: an information loss restoration technique for block-based image coding systems. IEEE Trans Image Process 7:1056–1061

    Article  Google Scholar 

  10. Wang Y, Zhu QF (1998) Error control and concealment for video communication: a review. Proc IEEE 86:974–997

    Article  Google Scholar 

  11. Wang Y, Zhu QF, Shaw L (1993) Maximally smooth image recovery in transform coding. IEEE Trans Commun 41(10):1544–1551

    Article  MATH  Google Scholar 

  12. Wu Z, Boyce JM (2006) “An error concealment scheme for entire frame losses based on H.264/AVC”. IEEE Int Symp Circ Syst. 4463–4466

  13. Yan B (2007) “A novel H.264 based motion vector recovery method for 3D video transmission”. IEEE Trans Consum Electron 53(4)

  14. Yan B, Gharavi H (2010) A hybrid frame concealment algorithm for H.264/AVC. IEEE Trans Image Process 19:98–107

    Article  MathSciNet  Google Scholar 

  15. Yan B, Zhou J (2012) Efficient frame concealment for depth image-based 3-D Video transmission. IEEE Trans Multimed 4:936–941

    Article  Google Scholar 

Download references

Acknowledgments

The authors thank the National Science Council in Taiwan (NSC 99-2221-E-471-002- and 102-2221-E-244-017-) for the financial support.

Author information

Authors and Affiliations

  1. Institute of Computer and Communication Engineering, Cheng Kung University, Tainan, Taiwan, Republic of China

    Shen-Chuan Tai, Chien-Shiang Hong & Ya-Chiung Luo

  2. Department of Information Technology, Kao Yuan University, Kaohsiung, Taiwan, Republic of China

    Chuen-Ching Wang

Authors
  1. Shen-Chuan Tai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chuen-Ching Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chien-Shiang Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ya-Chiung Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chuen-Ching Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tai, SC., Wang, CC., Hong, CS. et al. An effiicient full frame algorithm for object-based error concealment in 3D depth-based video. Multimed Tools Appl 75, 9927–9947 (2016). https://doi.org/10.1007/s11042-015-2899-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2899-4

Keywords

Search

Navigation