Abstract
Energy efficiency is a key design principle of the IBM Blue Gene series of supercomputers, and Blue Gene systems have consistently gained top GFlops/Watt rankings on the Green500 list. The Blue Gene hardware and management software provide built-in features to monitor power consumption at all levels of the machine’s power distribution network. This paper presents the Blue Gene/P power measurement infrastructure and discusses the operational aspects of using this infrastructure on Petascale machines. We also describe the integration of Blue Gene power monitoring capabilities into system-level tools like LLview, and highlight some results of analyzing the production workload at Research Center Jülich (FZJ).
Article PDF
Similar content being viewed by others
References
The Top500 list (November 2010). http://www.top500.org/lists/2010/11
The Green500 list (June 2011). http://www.green500.org/lists/2011/06/top/list.php
Kogge P (2009) Energy at exaflops. SC09 exascale panel. http://www.exascale.org/mediawiki/images/6/6e/Sc09-exa-panel-kogge.pdf
Bekas C, Curioni A (2010) A new energy aware performance metric. Comput Sci Res Dev 25:187–195. doi:10.1007/s00450-010-0119-z
Moreira J et al. (2007) The Blue Gene/L supercomputer: a hardware and software story. Int J Parallel Program 35(3):181–206. doi:10.1007/s10766-007-0037-2
Gara A et al. (2005) Overview of the Blue Gene/L system architecture. IBM J Res Dev 49(2/3):195–212. doi:10.1147/rd.492.0195
Coteus P et al. (2005) Packaging the Blue Gene/L supercomputer. IBM J Res Dev 49(2/3):213–248. doi:10.1147/rd.492.0213
Moreira J et al. (2005) Blue Gene/L programming and operating environment. IBM J Res Dev 49(2/3):367–376. doi:10.1147/rd.492.0367
IBM Blue Gene team (2008) Overview of the IBM Blue Gene/P project. IBM J Res Dev 52(1/2):199–220. doi:10.1147/rd.521.0199
Bright A, Ellavsky M, Gara A, Haring R, Kopcsay G, Lembach R, Marcella J, Ohmacht M, Salapura V (2005) Creating the BlueGene/L supercomputer from low-power SoC ASICs. In: Proceedings of IEEE international solid-state circuits conference. doi:10.1109/ISSCC.2005.1493932
Ware M, Rajamani K, Floyd M, Brock B, Rubio J, Rawson F, Carter J (2010) Architecting for power management: the IBM POWER7 approach. In: 2010 IEEE 16th international symposium on high performance computer architecture (HPCA). doi:10.1109/HPCA.2010.5416627
Floyd M, Ware M, Rajamani K, Gloekler T, Brock B, Bose P, Buyuktosunoglu A, Rubio J, Schubert B, Spruth B, Tierno J A, Pesantez L (2011) Adaptive energy-management features of the IBM POWER7 chip. IBM Journal of Research and Development 55(3). doi:10.1147/JRD.2011.2114250
Brochard L, Panda R, Vemuganti S (2010) Optimizing performance and energy of HPC applications on POWER7. Comput Sci Res Dev 25:135–140. doi:10.1007/s00450-010-0123-3
Iyer S, Barth J, Parries P, Norum J, Rice J, Logan L, Hoyniak D (2005) Embedded DRAM: technology platform for the Blue Gene/L chip. IBM J Res Dev 49(2/3):333–350. doi:10.1147/rd.492.0333
Baier H et al. (2010) QPACE: power-efficient parallel architecture based on IBM PowerXCell 8i. Comput Sci Res Dev 25:49–154. doi:10.1007/s00450-010-0122-4
Lakner G (2010) IBM system Blue Gene solution: Blue Gene/P system administration. IBM redbook SG24-7417-03. http://www.redbooks.ibm.com/abstracts/sg247417.html
Hennecke M (2010) Saving block history data in the Blue Gene/P database. IBM techdocs whitepaper WP101678. http://www.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101678
LLview: graphical monitoring of LoadLeveler controlled cluster. http://www.fz-juelich.de/jsc/llview/
Frings W (2007) New features of the batch system monitoring tool LLview. ScicomP13, Garching, 20. July 2007. http://www.spscicomp.org/ScicomP13/Presentations/User/WolfgangFrings-MON.pdf
Nagel W, Weber M, Hoppe H-C, Solchenbach K (1996) VAMPIR: visualization and analysis of MPI resources. Supercomputer 12(1):69–80. http://citeseer.ist.psu.edu/viewdoc/summary?doi=10.1.1.38.1615
Knüpfer A, Brendel R, Brunst H, Mix H, Nagel W (2006) Introducing the open trace format (OTF). In: Computational science (ICCS 2006). Lecture notes in computer science, vol 3992/2006, pp 526–533. http://dx.doi.org/10.1007/11758525_71
Author information
Authors and Affiliations
Corresponding author
Additional information
* IBM, Blue Gene, DB2, POWER and PowerXCell are trademarks of IBM in USA and/or other countries.
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Hennecke, M., Frings, W., Homberg, W. et al. Measuring power consumption on IBM Blue Gene/P. Comput Sci Res Dev 27, 329–336 (2012). https://doi.org/10.1007/s00450-011-0192-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00450-011-0192-y