Abstract
This article introduces a novel approach to energy-efficient media stream decoding that is based on the notion of media stream similarity. The key idea is that platform-independent scenarios with similar decoding complexity can be identified within and across media streams. A device that decodes a media stream annotated with scenario information can then adjust its processor clock frequency and voltage level based on these scenarios for lower energy consumption. Our evaluation, done using the H.264 AVC decoder and 12 reference video streams, shows an average energy reduction of 44% while missing less than 0.2% of the frame deadlines using scenario-driven video decoding.
An additional application of scenario-based media stream annotation is to predict required resources (compute power and energy) for consuming a given service on a given device. Resource prediction is extremely useful in a client-server setup in which the client requests a media service from the server or content provider. The content provider (in cooperation with the client) can then determine what service quality to deliver, given the client's available resources. Scenario-aware resource prediction can predict (compute power and energy) consumption with errors less than 4% (and an overall average 1.4% error).
- Acquaviva, A., Benini, L., and Riccó, B. 2001. An adaptive algorithm for low-power streaming multimedia processing. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE). 273--279. Google ScholarDigital Library
- Brooks, D., Bose, P., Schuster, S. E., Jacobson, H., Kudva, P. N., Buyuktosunoglu, A., Wellman, J.-D., Zyuban, V., Gupta, M., and Cook, P. W. 2000. Power-aware microarchitecture: Design and modeling challenges for next-generation microprocessors. IEEE Micro. 20, 6, 26--44. Google ScholarDigital Library
- Brooks, D., Tiwari, V., and Martonosi, M. 2000. Wattch: A framework for architectural-level power analysis and optimizations. In Proceedings of the 27th Annual International Symposium on Computer Architecture (ISCA'27). 83--94. Google ScholarDigital Library
- Burd, T. D., Pering, T. A., Stratakos, A. J., and Brodersen, R. W. 2000. A dynamic voltage scaled microprocessor system. IEEE J. Solid-State Circuits 35, 11, 1571--1580.Google ScholarCross Ref
- Burger, D. C. and Austin, T. M. 1997. The SimpleScalar tool set. Computer Architecture News. http://www.simplescalar.com.Google Scholar
- Choi, K., Dantu, K., Cheng, W.-C., and Pedram, M. 2002. Frame-based dynamic voltage and frequency scaling for a MPEG decoder. In Proceedings of the International Conference on Computer-Aided Design (ICCAD). 732--737. Google ScholarDigital Library
- Chung, E.-Y., Benini, L., and De Micheli, G. 2002. Contents provider-assisted dynamic voltage scaling for low energy multimedia applications. In Proceedings of the International Symposium on Low Power Electronic Design (ISLPED). 42--47. Google ScholarDigital Library
- Gheorghita, S. V., Basten, T., and Corporaal, H. 2005. Intra-task scenario-aware voltage scheduling. In Proceedings of the International Conference on Compilers, Architectures and Synthesis for Embedded Systems (CASES). 177--184. Google ScholarDigital Library
- Gheorghita, S. V., Stuijk, S., Basten, T., and Corporaal, H. 2005. Automatic scenario detection for improved WCET estimation. In Proceedings of the 42nd Annual Cnference on Design Automation (DAC). 101--104. Google ScholarDigital Library
- Hamers, J. and Eeckhout, L. 2007. Resource prediction for media stream decoding. In Proceedings of the Design, Automation and Test in Europe (DATE). 594--599. Google ScholarDigital Library
- Hamers, J., Eeckhout, L., and, De Bosschere, K. 2007. Exploiting video stream similarity for energy-efficient decoding. In Proceedings of the 13th International Multimedia Modeling Conference Part II. 11--22. Google ScholarDigital Library
- Horowitz, M., Joch, A., Kossentini, F., and Hallapuro, A. 2003. H.264/AVC baseline profile decoder complexity analysis. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 704--716. Google ScholarDigital Library
- Huang, Y., Chakraborty, S., and Wang, Y. 2005. Using offline bitstream analysis for power-aware video decoding in portable devices. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MM). 299--302. Google ScholarDigital Library
- Hughes, C. J., Srinivasan, J., and Adve, S. V. 2001. Saving energy with architectural and frequency adaptations for multimedia applications. In Proceedings of the 34th Annual International Symposium on Microarchitecture (MICRO'34). 250--261. Google ScholarDigital Library
- Intel 2004. Intel XScale Core Developer's Manual. Intel. 273473-002.Google Scholar
- ISO/IEC. 2001. MPEG-4 video verification model version 18.0. ISO/IEC JTC1/SC29/WG11 N3908.Google Scholar
- ISO/IEC. 2004. Information technology—coding of audio-visual objects—part 14: Mp4 file format. ISO/IEC 14496-14:2003.Google Scholar
- Johnson, R. A. and Wichern, D. W. 2002. Applied Multivariate Statistical Analysis 5th Ed. Prentice Hall.Google Scholar
- Lu, Z., Hein, J., Humphrey, M., Stan, M., Lach, J., and Skadron, K. 2002. Control-theoretic dynamic frequency and voltage scaling for multimedia workloads. In Proceedings of the International Conference on Compilers, Architectures and Synthesis for Embedded Systems (CASES). 156--163. Google ScholarDigital Library
- Mattavelli, M. and Brunetton, S. 1998. Implementing real-time video decoding on multimedia processors by complexity prediction techniques. IEEE Trans. Consum. Electron. 44, 3, 760--767. Google ScholarDigital Library
- Mohapatra, S., Cornea, R., Dutt, N., Nicolau, A., and Vakatasubramanian, N. 2003. Integrated power management for video streaming to mobile handheld devices. In Proceedings of the 11th Annual ACM International Conference on Multimedia (MM). 582--591. Google ScholarDigital Library
- Ostermann, J., Bormans, J., List, P., Marpe, D., Narroschke, M., Pereira, F., Stockhammer, T., and Wedi, T. 2004. Video coding with H.264/AVC: Tools, performance and complexity. IEEE Circuits Syst. Mag. 4, 1, 7--28.Google ScholarCross Ref
- Shin, D., Kim, J., and Lee, S. 2001. Intra-task voltage scheduling for low-energy, hard real-time applications. IEEE Des. Test Comput. 18, 2, 20--30. Google ScholarDigital Library
- Sühring, K. H.264/AVC reference software. http://iphome.hhi.de/suehring/tml/download/.Google Scholar
- Transmeta Corporation 2001. LongRun Power Management: Dynamic Power Management for Crusoe Processors. Transmeta Corporation.Google Scholar
- Yuan, W. and Nahrstedt, K. 2004. Practical voltage scaling for mobile multimedia devices. In Proceedings of the 12th Annual ACM International Conference on Multimedia (MM). 924--931. Google ScholarDigital Library
Index Terms
- Exploiting media stream similarity for energy-efficient decoding and resource prediction
Recommendations
Resource prediction for media stream decoding
DATE '07: Proceedings of the conference on Design, automation and test in EuropeResource prediction refers to predicting required compute power and energy resources for consuming a service on a device. Resource prediction is extremely useful in a client-server setup where the client requests a media service from the server or ...
Exploiting video stream similarity for energy-efficient decoding
MMM'07: Proceedings of the 13th International conference on Multimedia Modeling - Volume Part IIEnergy consumption is a key issue in modern microprocessor system design in general, and in the design of mobile computing devices more in particular. This paper introduces a novel approach to energy-efficient media stream decoding that is based on the ...
Iterative joint source-channel decoding of VLC exploiting source semantics over realistic radio-mobile channels
Joint source-channel decoding of Variable Length Codes (VLC) for image and video transmission over wireless links is a subject of increasing interest. This paper proposes an optimum decoder of VLC sequences which exploits inherent redundancy in source ...
Comments