Skip to main content
SpringerLink
Log in

Phase-based side information generation in distributed video coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In distributed video coding, the quality of side information (SI) directly affects the final compression efficiency and rate-distortion performance. In the process of generating SI, many methods require accurate pixel matching and produce intermediate frames based on calculating motion vectors. As a result, they perform poorly in scenarios such as light changes, motion blur, and so on. In this case, phase-based frame interpolation for video (PBFI) is proved to be effective. And it has the advantages of simple implementation and easy parallelization. However, this method cannot get a good result when interpolating the video sequence of large motion. This paper proposes a phase-based SI generation method, which applies PBFI to distributed video coding and improves it from two aspects. (1) Move the high frequency information to the low frequency, reduce the proportion of the high frequency components, so that more frequency components can be interpolated in phase; (2) By correcting the phase difference again, more accurate phase shift information can be obtained when facing the video sequence of large motion. Simulation results show that the proposed method can effectively improve the quality of the generated SI. Thereby the overall performance of the distributed video coding system can be improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Artigas X, Ascenso J, Dalai M, Klomp S, Kubasov D, Ouaret M (2007) The DISCOVER codec: architecture, techniques and evaluation. In: Proceedings of picture coding symposium, Lisbon, Portugal, pp 1–4

    Google Scholar 

  2. Cao Y, Sun L, Han C, Guo J (2018) Improved side information generation algorithm based on naive Bayesian theory for distributed video coding. IET Image Process 12(3):354–360. https://doi.org/10.1049/iet-ipr.2017.0892

    Article  Google Scholar 

  3. Dash B, Rup S, Mohapatra A, Mohapatra A, Majhi B, Swamy MN (2018) Decoder driven side information generation using ensemble of MLP networks for distributed video coding. Multimed Tools Appl 77(12):15221–15250. https://doi.org/10.1007/s11042-017-5103-1

    Article  Google Scholar 

  4. Dash B, Rup S, Mohapatra A, Mohapatra A, Majhi B, Swamy MN (2018) Multi-resolution extreme learning machine-based side information estimation in distributed video coding. Multimed Tools Appl 77(20):27301–27335. https://doi.org/10.1007/s11042-018-5921-9

    Article  Google Scholar 

  5. Didyk P, Sitthi-Amorn P, Freeman WT, Durand F, Matusik W (2013) Joint view expansion and filtering for automultiscopic 3D displays. ACM Transactions on Graphics 32(6):221:1–221:8. https://doi.org/10.1145/2508363.2508376

    Article  Google Scholar 

  6. Dufaux F, Gao W, Tubaro S, Vetro A (2009) Distributed video coding: trends and perspectives. EURASIP J Image Video Process 2009:508167. https://doi.org/10.1155/2009/508167

    Article  Google Scholar 

  7. Gautama T, Van Hulle MA (2002) A phase-based approach to the estimation of the optical flow field using spatial filtering. IEEE Trans Neural Netw 13(5):1127–1136. https://doi.org/10.1109/TNN.2002.1031944

    Article  Google Scholar 

  8. Jun D (2019) Distributed video coding with adaptive two-step side information generation for smart and interactive media. Displays 59:21–27. https://doi.org/10.1016/j.displa.2019.05.002

    Article  Google Scholar 

  9. Luong HV, Raket LL, Huang X, Forchhammer S (2012) Side information and noise learning for distributed video coding using optical flow and clustering. IEEE Trans Image Process 21(12):4782–4796. https://doi.org/10.1109/TIP.2012.2215621

    Article  MathSciNet  MATH  Google Scholar 

  10. Rup S, Majhi B, Padhy S (2014) An improved side information generation for distributed video coding. AEUE - International Journal of Electronics and Communications 68(3):201–209. https://doi.org/10.1016/j.aeue.2013.08.005

    Article  Google Scholar 

  11. Shen Y, Cheng H, Luo J, Lin Y, Wu J (2017) Efficient real-time distributed video coding by parallel progressive side information regeneration. IEEE Sensors J 17(6):1872–1883. https://doi.org/10.1109/JSEN.2017.2653100

    Article  Google Scholar 

  12. Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation.IEEE international conference on image processing, ICIP (3) 1995: 444-447. https://doi.org/10.1109/ICIP.1995.537667

    Chapter  Google Scholar 

  13. Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ (1992) Shiftable multiscale transforms. IEEE Trans Inf Theory 38(2):587–607. https://doi.org/10.1109/18.119725

    Article  MathSciNet  Google Scholar 

  14. Simone M, Oliver W, Henning Z, Max G, Alexander S (2015) Phase-based frame interpolation for video. In: IEEE Conference on Computer Vision and Pattern Recognition CVPR, vol 2015, pp 1410–1418. https://doi.org/10.1109/CVPR.2015.7298747

  15. Slepian D, Wolf J (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19(4):471–480. https://doi.org/10.1109/TIT.1973.1055037

    Article  MathSciNet  MATH  Google Scholar 

  16. Taheri YM, Ahmad MO, Swamy M (2019) Successive refinement of side information frames in distributed video coding. Multimed Tools Appl 78(15):1–26. https://doi.org/10.1007/s11042-019-7249-5

    Article  Google Scholar 

  17. Wadhwa N, Rubinstein M, Durand F, Freeman WT (2013) Phase-based video motion processing. ACM Transactions on Graphics 32(4):80:1–80:10. https://doi.org/10.1145/2461912.2461966

    Article  MATH  Google Scholar 

  18. Wang W, Li J, Mo H, Chen J (2021, 2021) Side information hybrid generation based on improved motion vector field. Multimed Tools Appl. https://doi.org/10.1007/s11042-021-10870-8

  19. Wyner AD, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22(1):1–10. https://doi.org/10.1109/TIT.1976.1055508

    Article  MathSciNet  MATH  Google Scholar 

  20. Zhou J, Fu Y, Yang Y, Yang Y, Ho A (2019) Distributed video coding using interval overlapped arithmetic coding. Signal Process Image Commun 76:118–124. https://doi.org/10.1016/j.image.2019.03.016

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant 61861045.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Yunnan University, Kunming, 650504, China

    Hongjiang Chen, Wei Wang, Jingjian Li, Hong Mo & Jianhua Chen

Authors
  1. Hongjiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jingjian Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hong Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jianhua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianhua Chen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, H., Wang, W., Li, J. et al. Phase-based side information generation in distributed video coding. Multimed Tools Appl 81, 21295–21312 (2022). https://doi.org/10.1007/s11042-022-12589-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12589-6

Keywords

Search

Navigation