skip to main content
research-article

Exploiting media stream similarity for energy-efficient decoding and resource prediction

Published:05 April 2012Publication History
Skip Abstract Section

Abstract

This article introduces a novel approach to energy-efficient media stream decoding that is based on the notion of media stream similarity. The key idea is that platform-independent scenarios with similar decoding complexity can be identified within and across media streams. A device that decodes a media stream annotated with scenario information can then adjust its processor clock frequency and voltage level based on these scenarios for lower energy consumption. Our evaluation, done using the H.264 AVC decoder and 12 reference video streams, shows an average energy reduction of 44% while missing less than 0.2% of the frame deadlines using scenario-driven video decoding.

An additional application of scenario-based media stream annotation is to predict required resources (compute power and energy) for consuming a given service on a given device. Resource prediction is extremely useful in a client-server setup in which the client requests a media service from the server or content provider. The content provider (in cooperation with the client) can then determine what service quality to deliver, given the client's available resources. Scenario-aware resource prediction can predict (compute power and energy) consumption with errors less than 4% (and an overall average 1.4% error).

References

  1. Acquaviva, A., Benini, L., and Riccó, B. 2001. An adaptive algorithm for low-power streaming multimedia processing. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE). 273--279. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Brooks, D., Bose, P., Schuster, S. E., Jacobson, H., Kudva, P. N., Buyuktosunoglu, A., Wellman, J.-D., Zyuban, V., Gupta, M., and Cook, P. W. 2000. Power-aware microarchitecture: Design and modeling challenges for next-generation microprocessors. IEEE Micro. 20, 6, 26--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Brooks, D., Tiwari, V., and Martonosi, M. 2000. Wattch: A framework for architectural-level power analysis and optimizations. In Proceedings of the 27th Annual International Symposium on Computer Architecture (ISCA'27). 83--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Burd, T. D., Pering, T. A., Stratakos, A. J., and Brodersen, R. W. 2000. A dynamic voltage scaled microprocessor system. IEEE J. Solid-State Circuits 35, 11, 1571--1580.Google ScholarGoogle ScholarCross RefCross Ref
  5. Burger, D. C. and Austin, T. M. 1997. The SimpleScalar tool set. Computer Architecture News. http://www.simplescalar.com.Google ScholarGoogle Scholar
  6. Choi, K., Dantu, K., Cheng, W.-C., and Pedram, M. 2002. Frame-based dynamic voltage and frequency scaling for a MPEG decoder. In Proceedings of the International Conference on Computer-Aided Design (ICCAD). 732--737. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chung, E.-Y., Benini, L., and De Micheli, G. 2002. Contents provider-assisted dynamic voltage scaling for low energy multimedia applications. In Proceedings of the International Symposium on Low Power Electronic Design (ISLPED). 42--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Gheorghita, S. V., Basten, T., and Corporaal, H. 2005. Intra-task scenario-aware voltage scheduling. In Proceedings of the International Conference on Compilers, Architectures and Synthesis for Embedded Systems (CASES). 177--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Gheorghita, S. V., Stuijk, S., Basten, T., and Corporaal, H. 2005. Automatic scenario detection for improved WCET estimation. In Proceedings of the 42nd Annual Cnference on Design Automation (DAC). 101--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hamers, J. and Eeckhout, L. 2007. Resource prediction for media stream decoding. In Proceedings of the Design, Automation and Test in Europe (DATE). 594--599. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hamers, J., Eeckhout, L., and, De Bosschere, K. 2007. Exploiting video stream similarity for energy-efficient decoding. In Proceedings of the 13th International Multimedia Modeling Conference Part II. 11--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Horowitz, M., Joch, A., Kossentini, F., and Hallapuro, A. 2003. H.264/AVC baseline profile decoder complexity analysis. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 704--716. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Huang, Y., Chakraborty, S., and Wang, Y. 2005. Using offline bitstream analysis for power-aware video decoding in portable devices. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MM). 299--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hughes, C. J., Srinivasan, J., and Adve, S. V. 2001. Saving energy with architectural and frequency adaptations for multimedia applications. In Proceedings of the 34th Annual International Symposium on Microarchitecture (MICRO'34). 250--261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Intel 2004. Intel XScale Core Developer's Manual. Intel. 273473-002.Google ScholarGoogle Scholar
  16. ISO/IEC. 2001. MPEG-4 video verification model version 18.0. ISO/IEC JTC1/SC29/WG11 N3908.Google ScholarGoogle Scholar
  17. ISO/IEC. 2004. Information technology—coding of audio-visual objects—part 14: Mp4 file format. ISO/IEC 14496-14:2003.Google ScholarGoogle Scholar
  18. Johnson, R. A. and Wichern, D. W. 2002. Applied Multivariate Statistical Analysis 5th Ed. Prentice Hall.Google ScholarGoogle Scholar
  19. Lu, Z., Hein, J., Humphrey, M., Stan, M., Lach, J., and Skadron, K. 2002. Control-theoretic dynamic frequency and voltage scaling for multimedia workloads. In Proceedings of the International Conference on Compilers, Architectures and Synthesis for Embedded Systems (CASES). 156--163. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Mattavelli, M. and Brunetton, S. 1998. Implementing real-time video decoding on multimedia processors by complexity prediction techniques. IEEE Trans. Consum. Electron. 44, 3, 760--767. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Mohapatra, S., Cornea, R., Dutt, N., Nicolau, A., and Vakatasubramanian, N. 2003. Integrated power management for video streaming to mobile handheld devices. In Proceedings of the 11th Annual ACM International Conference on Multimedia (MM). 582--591. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ostermann, J., Bormans, J., List, P., Marpe, D., Narroschke, M., Pereira, F., Stockhammer, T., and Wedi, T. 2004. Video coding with H.264/AVC: Tools, performance and complexity. IEEE Circuits Syst. Mag. 4, 1, 7--28.Google ScholarGoogle ScholarCross RefCross Ref
  23. Shin, D., Kim, J., and Lee, S. 2001. Intra-task voltage scheduling for low-energy, hard real-time applications. IEEE Des. Test Comput. 18, 2, 20--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Sühring, K. H.264/AVC reference software. http://iphome.hhi.de/suehring/tml/download/.Google ScholarGoogle Scholar
  25. Transmeta Corporation 2001. LongRun Power Management: Dynamic Power Management for Crusoe Processors. Transmeta Corporation.Google ScholarGoogle Scholar
  26. Yuan, W. and Nahrstedt, K. 2004. Practical voltage scaling for mobile multimedia devices. In Proceedings of the 12th Annual ACM International Conference on Multimedia (MM). 924--931. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exploiting media stream similarity for energy-efficient decoding and resource prediction

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Embedded Computing Systems
        ACM Transactions on Embedded Computing Systems  Volume 11, Issue 1
        March 2012
        248 pages
        ISSN:1539-9087
        EISSN:1558-3465
        DOI:10.1145/2146417
        Issue’s Table of Contents

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 5 April 2012
        • Accepted: 1 March 2008
        • Revised: 1 October 2007
        • Received: 1 June 2007
        Published in tecs Volume 11, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader