Skip to main content
SpringerLink
Log in

Handling Tradeoff Between Visual Perception and Compression in Video Codec Using Optimal Intra-Frame Prediction

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Video coding and compression play a key role in efficient transmission and distribution of digital video content with comparatively lower storage and bandwidth requirements. However, the current research effort and evolutionary aspects still expect to develop a better solution that can jointly address the time complexity, quality measures, and data transfer rate problem in digital video transmission and distribution. Considering this, the study introduces an optimal video codec model to handle the tradeoff between visual perception and compression issues in video coding by introducing a novel optimized modeling of the intra-frame prediction method. The method's design and development are extensively carried out from the analytical viewpoint, where it also emphasizes reducing the encoding time to a significant extent. The experimental, numerical analysis shows that the proposed modeling of the optimized estimation of intra-frame prediction outperforms the conventional approach in terms of visual perception evaluated concerning Peak Signal-To-Noise Ratio (PSNR), bit rate and encoding time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Ma, N. (2019). Distributed video coding scheme of multimedia data compression algorithm for wireless sensor networks. Journal on Wireless Communications and Networking, 2019(1), 254.

    Article  Google Scholar 

  2. Sullivan, G. J., & Wiegand, T. (2005). Video compression - from concepts to the H.264/AVC standard. Proceedings of the IEEE, 93(1), 18–31.

    Article  Google Scholar 

  3. Marpe, D., Wiegand, T., & Sullivan, G. J. (2006). The H.264/MPEG4 advanced video coding standard and its applications. IEEE Communications Magazine, 44(8), 134–143.

    Article  Google Scholar 

  4. Haskell, B. G. (1998). Image and video coding-emerging standards and beyond. IEEE Transactions on Circuits and Systems for Video Technology, 8(7), 814–837.

    Article  Google Scholar 

  5. Sanchez, G., Agostini, L., Marcon, C., (2020) 3D-HEVC background. In: Algorithms for efficient and fast 3D-HEVC Depth map encoding. Cham: Springer

  6. Patnaik, Y., Patra, D., (2015). H.264/AVC/MPEG video coding with an emphasis to bidirectional prediction frames. In Annual IEEE India Conference (INDICON) (pp. 1–5). New Delhi.

  7. Zhu, S., Zhang, S., & Ran, C. (2017). An improved inter-frame prediction algorithm for video coding based on fractal and H.264. IEEE Access, 5, 18715–18724.

    Article  Google Scholar 

  8. Jaballah, S., Rouis, K., BelhadjTahar, J., (2015). Clustering-based fast intra prediction mode algorithm for HEVC. In 23rd European Signal Processing Conference (EUSIPCO) (pp. 1850–1854). Nice.

  9. Jiwani, L. K., Krishna, A. S., & Owais, M., (2016). Adaptive energy weighted direction method for intra-prediction video compression. In IEEE Region 10 Conference (TENCON) (pp. 3067–3070). Singapore.

  10. Manjanaik, N., Manjunath, R., (2016). Intra frame coding for Advanced Video Coding Standard H.264 to control PSNR and reduce bit rate using Horizontal mode. In International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT) Chennai, pp. 4326–4331

  11. Qian, D., Wang, W., (2017). A simplify decision algorithm with equivalent mean square error of H.264/AVC intra prediction mode. In 36th Chinese Control Conference (CCC) (pp. 9900–9904). Dalian.

  12. Vyas, Z. M., Lineswala, K., Pathak, K. C. (2015). Error concealment techniques using intra-modes and weighted interpolation in H.264 decoder. In International Conference on Computer, Communication and Control (IC4) (pp. 1–6). Indore.

  13. Elyousfi, A., Hachimi, A. E., & Hamout, H. (2017). Texture complexity based fast and efficient intra block mode decision algorithm for H.264/AVC. Intelligent Systems and Computer Vision (ISCV). https://doi.org/10.1109/ISACV.2017.8054912

    Article  Google Scholar 

  14. Cai, X., & Lim, J. S., (2016). H.264 intra coding with transforms based on prediction inaccuracy modeling. In IEEE International Conference on Image Processing (ICIP) (pp. 2380–2384). Phoenix, AZ.

  15. Hsia, S., Wong, W., & Shih, Y. (2018). Fast-efficient algorithm of high-profile intra prediction for H.264 encoding system. IET Image Processing, 12(3), 329–336.

    Article  Google Scholar 

  16. Díaz-Honrubia, A. J., Martínez, J. L., Cuenca, P & Kalva, H.(2016). A fast splitting algorithm for an H.264/AVC to HEVC intra video transcoder. In Data Compression Conference (DCC) (pp. 588–588). Snowbird, UT.

  17. Orlandic, M., & Svarstad, K. (2015). An MPEG-2 to H.264/AVC intra-frame transcoder architecture with mode decision in transform domain. IEEE Transactions on Consumer Electronics, 61(1), 81–89.

    Article  Google Scholar 

  18. Zhou, J., Zhou, J., & Guo, L. (2018). Angular intra prediction based measurement coding algorithm for compressively sensed image. In IEEE International Conference on Multimedia and Expo Workshops (ICMEW) (pp. 1–6). San Diego, CA.

  19. Kudo, S., Kitahara, M., & Shimizu, A., (2016). Motion vector prediction methods considering prediction continuity in HEVC. In Picture Coding Symposium (PCS) Nuremberg (pp. 1–5).

  20. Corrêa, M., Porto, M., Zatt, B., & Agostini, L., (2015). A low-area and high-throughput intra prediction architecture for a multi-standard HEVC and H.264/AVC video encoder. In 28th Symposium on Integrated Circuits and Systems Design (SBCCI) Salvador (pp. 1–6).

  21. Luhandjula, T., & Ferguson, K.L., (2015). Sampling point path selection for fast intra mode prediction. In Picture Coding Symposium (PCS) (pp. 216–220). Cairns, QLD.

  22. Mamatha R.B., & Keshaveni N. (2016). Gradient based intra prediction in H.264/AVC. In 2016 International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) (pp. 40–46). Bangalore.

  23. Kau, L., & Leng, J. (2015). A gradient intensity-adapted algorithm with adaptive selection strategy for the fast decision of H.264/AVC intra-prediction modes. IEEE Transactions on Circuits and Systems for Video Technology, 25(6), 944–957.

    Article  Google Scholar 

  24. Elyousfi, A., Hamout, H., & Hachimi, A. E., (2016). An efficient intra block size decision for H.264/AVC encoding optimization. In IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA) (pp. 1–5). Agadir.

  25. Jiwani, L. K., (2018). Least square intra-prediction mode prediction based video compression. In Conference on Information and Communication Technology (CICT) (pp. 1–6). Jabalpur, India.

  26. Jiang, W., Chi, Y., Jin, H., Liao, X., Zhang, Y., and Ye, G., (2016). A fine-grained parallel intra prediction for HEVC based on GPU. In IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS) (pp. 778–784). Wuhan.

  27. Duan, K., Liu, P., Feng Z & Jia, K., (2019). Fast PU Intra Mode Decision in Intra HEVC Coding. In Data Compression Conference (DCC) (pp. 570–570). Snowbird, UT, USA.

  28. Wang, T., Men, Y., Zhang, Y & Chao, H., (2017). A fast intra-prediction decision algorithm in inter-frame based on a novel feature of HEVC. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 1532–1536). New Orleans, LA.

  29. Ramezanpour, M., & Zargari, F., (2015). Early termination algorithm for CU size decision in HEVC intra coding. In 9th Iranian Conference on Machine Vision and Image Processing (MVIP) (pp. 45–48). Tehran.

  30. Sanchez, V., (2015). Fast intra-prediction for lossless coding of screen content in HEVC. In IEEE Global Conference on Signal and Information Processing (GlobalSIP) (pp. 1367–1371). Orlando, FL.

  31. Liu, X., Yan, W., Xiang, G., Cheng, L & Yan, Y., (2019). A novel fast mode decision algorithm for AVS2 intra coding. In IEEE 4th International Conference on Signal and Image Processing (ICSIP) (pp. 850–854). Wuxi, China.

  32. Sun, C., Fan, X., & Zhao, D., (2018). A fast intra cu size decision algorithm based on canny operator and SVM classifier. In 25th IEEE International Conference on Image Processing (ICIP) (pp. 1787–1791). Athens.

  33. Patel, D. B., Chauhan, D. M., & Pathak, K. C., (2016). Edges based intra-prediction in high efficiency video coding (HEVC) standard. In IEEE International Conference on Engineering and Technology (ICETECH), (pp. 995–1000). Coimbatore.

  34. Lim, K., Lee, J., Kim, S., & Lee, S. (2015). Fast PU skip and split termination algorithm for HEVC intra prediction. IEEE Transactions on Circuits and Systems for Video Technology, 25(8), 1335–1346.

    Article  Google Scholar 

  35. Song, R., Liu, D., Li, H., & Wu, F. (2017). Neural network-based arithmetic coding of intra prediction modes in HEVC. In 7 IEEE Visual Communications and Image Processing (VCIP) (pp. 1–4). St. Petersburg, FL.

  36. Wang, Y., Cao, J., Wang, J., & Liang, F., (2019). Gradient-based fast intra coding decision algorithm for HEVC. In IEEE 4th International Conference on Signal and Image Processing (ICSIP) (pp. 870–874). Wuxi, China.

  37. Shi, W., Jiang, X., Song, T., & Shimamoto, T., (2015). Spatial locality based supplemental modes for intra prediction of HEVC. In IEEE International Conference on Consumer Electronics - Taiwan, (pp. 298–299). Taipei.

  38. Shang, X., Wang, G., Fan, T., & Li, Y., (2015). Fast CU size decision and PU mode decision algorithm in HEVC intra coding. In IEEE International Conference on Image Processing (ICIP) (pp. 1593–1597). Quebec City, QC.

  39. Zhang, M., Liu, Y., & Liu, Z., (2016). A new fast algorithm based on SATD for HEVC intra prediction. In Visual Communications and Image Processing (VCIP) (pp. 1–4). Chengdu.

  40. Liao, W., Yang, D., & Chen, Z., (2016). A fast mode decision algorithm for HEVC intra prediction. In Visual Communications and Image Processing (VCIP) (pp. 1–4). Chengdu.

  41. Gu, J., Tang, M., Wen, J., & Han, Y. (2018). Adaptive intra candidate selection with early depth decision for fast intra prediction in HEVC. IEEE Signal Processing Letters, 25(2), 159–163.

    Article  Google Scholar 

  42. Zhao, X., Seregin, V., Said, A., Zhang, K., Egilmez, H. E., & Karczewicz, M., (2018). Low-complexity intra prediction refinements for video coding. Picture Coding Symposium (PCS) (pp. 139–143). San Francisco, CA.

  43. Ting, H., Fang, H., & Wang, J. (2019). Complexity reduction on HEVC intra mode decision with modified LeNet-5. In IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) (pp. 20–24). Hsinchu, Taiwan.

  44. Venugopal, G., Merkle, P., Marpe, D., & Wiegand, T., (2017). Fast template matching for intra prediction. In IEEE International Conference on Image Processing (ICIP) (pp. 1692–1696). Beijing.

  45. Yang, W., & Pi, Y., (2016). A Low-complexity intra prediction mode selection algorithm in HEVC. In IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/Cyber SciTech) (pp. 598–603). Auckland.

  46. Zhou, X., Shi, G., & Zhou, W., (2016). Perceptual CU size decision and fast prediction mode decision algorithm for HEVC intra coding. In IEEE International Symposium on Multimedia (ISM) (pp. 375–378). San Jose, CA.

  47. Wei, H., Zhou, B., Chen, J., & Xu, Y., (2018). Confidence-based Fast Intra Prediction Algorithm. In IEEE International Conference on Automation, Electronics and Electrical Engineering (AUTEEE) (pp. 158–161). Shenyang, China

  48. Sabu, S. S., Sandhya, L., & Varier, G. S., (2016). A fast block size decision algorithm for intra prediction in H.264 for video coding in space missions. In 2016 International Conference on Inventive Computation Technologies (ICICT) (pp. 1–6). Coimbatore doi: https://doi.org/10.1109/INVENTIVE.2016.7824806.

  49. Veena, S. K., & Rao, M. K. (2019). Insights on video compression strategies using machine learning. International Journal of Engineering and Advanced Technology (IJEAT). https://doi.org/10.35940/ijeat.A9756.109119

    Article  Google Scholar 

  50. Fernandes, R., Sanchez, G., Cataldo, R., Agostini, L., & Marcon, C., (2018). Least-squares approximation surfaces for high quality intra-frame prediction in future video standards. In 25th IEEE International Conference on Electronics, Circuits and Systems (ICECS) (pp. 205–208). Bordeaux.

  51. Brand, F., Seiler, J., & Kaup, A. (2019). Intra frame prediction for video coding using a conditional autoencoder approach. In Picture Coding Symposium (PCS) (pp. 1–5). Ningbo, China.

  52. Brand, F., Seiler, J., & Kaup, A., (2019). Intra frame prediction for video coding using a conditional autoencoder approach. In Picture Coding Symposium (PCS) (pp. 1-5). Ningbo, China.

  53. Lu, J., & Li, Y. (2019). Fast algorithm for CU partitioning and mode selection in HEVC intra prediction. In 12th International Congress on Image and Signal Pro-cessing, BioMedical Engineering and Informatics (CISP-BMEI) (pp. 1–5). Suzhou, China.

  54. "Media-xiph", https://media.xiph.org/video/derf/, retrieved on 28-Dec-2020

Download references

Acknowledgement

Authors gratefully thank the Maharaja Research foundation and Visvesvaraya Technological University, Jnana Sangama, Belagavi for the support extended to this research work.

Author information

Authors and Affiliations

  1. Department of ECE, MITM, Mysuru, Karnataka, India

    S. K. Veena & Mahesh K. Rao

Authors
  1. S. K. Veena
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahesh K. Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. K. Veena.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Veena, S.K., Rao, M.K. Handling Tradeoff Between Visual Perception and Compression in Video Codec Using Optimal Intra-Frame Prediction. Wireless Pers Commun 119, 1515–1540 (2021). https://doi.org/10.1007/s11277-021-08293-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-021-08293-7

Keywords

Search

Navigation