Skip to main content
SpringerLink
Log in

Compressive Sensing Based Soft Video Broadcast Using Spatial and Temporal Sparsity

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Video broadcasting over wireless network has become a very popular application. However, the conventional digital video broadcasting framework can hardly accommodate heterogeneous users with diverse channel conditions, which is called the cliff effects. To overcome this cliff effects and provide a graceful degradation to multi-receivers, in this paper, we use the nonlocal sparsity and hierarchical GOP structure to propose a novel CS based soft video broadcast scheme. CS has properties of minimizing bandwidth consumption and generating measurements with equal importance which are exactly needed by video soft broadcast. In the proposed scheme, the measurement data are generated by block-wise compressive sensing (BCS), and then the measurement data packets are sent over a highly dense constellation though OFDM channel to achieve a simple encoder. Ideally, with the GOP structure, inter frame has lower sampling rate than intra frame to achieve better compression efficiency. At the decoder side, due to equally-important packets and property of soft broadcast, each user can receive the noise-corrupted measurements matching its channel condition and reconstruct video. The hierarchical GOP structure is presented to explode the correlation and non-local sparsity among video frames during the recover process. Additionally, using non-local sparsity, group based CS reconstruction with adaptive dictionaries is proposed to improve decoding quality. The experimental results show that the proposed scheme provides better performance compared with the traditional SoftCast with up to 8 dB coding gain for some channel conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. European Telecommunications Standards Institute (2009) Digital Video Broadcasting (DVB). ETSI Publishing ETSI official website. http://www.etsi.org/deliver/etsien/300700300799/300744/01.06.01_60/en300744v010601p.pdf. Accessed 2009

  2. IEEE 802.11 Working Group et al. (2007) IEEE 802.11-2007: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications. IEEE 802.11 LAN Standards-2007

  3. Shacham N (1992) Multipoint communication by hierarchically encoded data In: INFOCOM ‘92. Eleventh Annual Joint Conference of the IEEE Computer and Communications Societies, pp 2107–2114 vol.3, Florence

  4. McCanne S Jacobson V, Vetterli M (1996) Receiver-driven layered multicast In: Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, pp 117–130, New York

  5. Wu F, Li S, Zhang YQ (2001) A framework for efficient progressive fine granularity scalable video coding. IEEE Trans Circ Syst Video Technol 11(3):332–344

    Article  Google Scholar 

  6. Schwarz H, Marpe D, Wiegand T (2007) Overview of the scalable video coding extension of the h.264/avc standard. IEEE Trans Circ Syst Video Technol 17(9):1103–1120

    Article  Google Scholar 

  7. Ramchandran K, Ortega A, Uz K, Vetterli M (1992) Multire solution broadcast for digital hdtv using joint source-channel coding In: IEEE international conference on Communications, pp 556–560. vol.1, Chicago

  8. Jakubczak S, Katabi D (2010) SoftCast: one-size-fits-all wireless video. ACM Sigcomm Comput Commun Rev 40(4):449–450

    Article  Google Scholar 

  9. Jakubczak S, Katabi D (2011) A cross-layer design for scalable mobile video In: Proceedings of the 17th annual international conference on Mobile computing and networking, pp 289–300, New York

  10. Aditya S Katti S (2011) FlexCast: graceful wireless video streaming In: Proceedings of the 17th annual international conference on Mobile computing and networking, pp 277–288, New York

  11. Girod B, Aaron AM, Rane S, Rebollo Monedero D (2005) Distributed video coding. Proc IEEE 93(1):71–83

    Article  MATH  Google Scholar 

  12. Fan X, Wu F, Zhao D, Au OC, Gao W (2012) Distributed soft video broadcast (DCAST) with explicit motion In: Data Compression Conference, pp199-208, Snowbird

  13. Fan X, Wu F, Zhao D, Au OC (2013) Distributed wireless visual communication with power distortion optimization. IEEE Trans Circ Syst Video Technol 23(6):1040–1053

    Article  Google Scholar 

  14. Fan X, Xiong R, Wu F, Zhao D (2012) Wavecast: Wavelet based wireless video broadcast using lossy transmission In: IEEE international conference on visual communications and image processing, pp 1–6, San Diego

  15. Taubman D, Zakhor A (1994) Multirate 3-d subband coding of video. IEEE Trans Image Process 3(5):572–588

    Article  Google Scholar 

  16. Secker A, Taubman D (2003) Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression. IEEE Trans Image Process 12(12):1530–1542

    Article  Google Scholar 

  17. Xiong R, Xu J, Wu F, Li S (2007) Barbell-lifting based 3-D wavelet coding scheme. IEEE Trans Circ Syst Video Technol 17(9):1256–1269

    Article  Google Scholar 

  18. Peng X, Xu J, Wu F (2012) Line-cast: Line-based semi-analog broadcasting of satellite images. International Conference on Image Processing, pp2929–2932

  19. Wu F, Peng X, Xu J (2014) LineCast: line-based distributed coding and transmission for broadcasting satellite images. IEEE Trans Image Process 23(3):1015–1027

    Article  MathSciNet  Google Scholar 

  20. Yu L, Li H, Li W (2013) Wireless scalable video coding using a hybrid digital-analog scheme. IEEE Trans Circ Syst Video Technol 24(2):331–345

    Article  Google Scholar 

  21. Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H. 264/AVC video coding standard. IEEE Trans Circ Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  22. Xiong R, Liu H, Ma S, Fan X, Wu F, Gao W (2014) G-CAST: gradient based image SoftCast for perception-friendly wireless visual communication in: data Compression Conference, pp 133–142, Snowbird

  23. Cui H, Luo C, Chen C, Wu F (2014) Robust uncoded video transmission over wireless fast fading channel In: Proceedings of IEEE INFOCOM, pp 73–81, Toronto

  24. Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306

    Article  MathSciNet  MATH  Google Scholar 

  25. Sankaranarayanan AC, Studer C, Baraniuk RG (2012) CS-MUVI: Video compressive sensing for spatial multiplexing cameras In: IEEE International Conference on Computational Photography, pp 1–10, Seattle

  26. Wakin MB, Laska JN, Duarte MF, Baron D, Sarvotham S, Takhar D, Kelly KF, Baraniuk RG (2006) Compressive imaging for video representation and coding In: Proceedings of Picture Coding Symposium, pp 1–6

  27. Chen C, Tramel EW, Fowler JE (2011) Compressed sensing recovery of images and video using multi hypothesis predictions In: Conference on signals, systems and computers, pp 1193–1198, Pacific Grove

  28. Mun S Fowler JE (2011) Residual reconstruction for block-based compressed sensing of video In: Proceedings of the IEEE Data Compression Conference, pp 183–192, Snowbird

  29. Kittle D, Choi K, Wagadarikar A, Brady DJ (2010) Multiframe image estimation for coded aperture snap shot spectral imagers. Appl Opt 49(36):6824–6833

    Article  Google Scholar 

  30. Yang J, Yuan X, Liao X, Llull P, Brady DJ, Sapiro G, Carin L (2014) Video compressive sensing using gaussian mixture models. IEEE Trans Image Process 23(11):4863–4878

    Article  MathSciNet  Google Scholar 

  31. Liu X, Luo C, Hu W, Wu F (2012) Compressive broadcast in mimo systems with receive antenna heterogeneity In: Proceedings of INFOCOM, pp 3011–3015, Orlando

  32. Schenkel MB, Luo C, Wu F, Frossard P (2012) Compressed sensing based video multicast In: Proceedings of SPIE, pp 77441H-1–77441H-9, vol.7744, Huangshan

  33. Xiang S, Cai L (2011) Scalable video coding with compressive sensing for wireless video cast In: Proceedings of the IEEE International Conference on Communications, pp 1–5, Kyoto

  34. Li C, Jiang H, Wilford P, Zhang Y (2011) Video coding using compressive sensing for wireless communications In: Proceedings of the Wireless Communications and Networking Conference, pp 2077–2082, Cancun

  35. Pudlewski S, Prasanna A, Melodia T (2012) Compressed-sensing-enabled video streaming for wireless multimedia sensor networks. IEEE Trans Mob Comput 11(6):1060–1072

    Article  Google Scholar 

  36. Wang A, Zeng B, Chen H (2014) Wireless multicasting of video signals based on distributed compressed sensing. J Signal Process: Image Commun 29(5):599–606

    Google Scholar 

  37. Dong W, Shi G, Li X, Ma Y, Huang F (2014) Compressive sensing via nonlocal Low-rank regularization. IEEE Trans Image Process 23(8):3618–3632

    Article  MathSciNet  Google Scholar 

  38. Mun S, Fowler JE (2009) Block compressed Sensing of Image Using Directional Transforms In: Proceeding of the International Conference on Image Processing, pp 3021–3024, Cairo

  39. Yue H, Sun X, Yang J (2013) Landmark image super-resolution by retrieving web images. IEEE Trans Image Process 22(12):4865–4878

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science Foundation of China (NSFC) under grants 61472101 and 61390513, the Major State Basic Research Development Program of China (973 Program 2015CB351804), and the National High Technology Research and Development Program of China (863 Program 2015AA015903).

Author information

Authors and Affiliations

  1. School of Computer Science & Technology, Harbin Institute of Technology, Harbin, China

    Wenbin Yin, Xiaopeng Fan & Debin Zhao

  2. College of Metropolitan Transportation, Beijing University of Technology, Beijing, China

    Yunhui Shi

  3. Department of EECS, Peking University, Beijing, China

    Ruiqin Xiong

Authors
  1. Wenbin Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaopeng Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunhui Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ruiqin Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Debin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaopeng Fan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yin, W., Fan, X., Shi, Y. et al. Compressive Sensing Based Soft Video Broadcast Using Spatial and Temporal Sparsity. Mobile Netw Appl 21, 1002–1012 (2016). https://doi.org/10.1007/s11036-016-0734-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-016-0734-4

Keywords

Search

Navigation