Abstract
This chapter looks at the different measurement strategies techniques that can be used in practice to derive the values of common metrics, including event-driven, tracing, sampling, and indirect measurement. While most presented techniques are useful for performance metrics, some of them can also be applied generally for other types of metrics. The chapter is wrapped up with an overview of commercial and open-source monitoring tools for performance profiling and call path tracing.
“When you only have a hammer, every problem begins to resemble a nail.”
—Abraham Maslow
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allen, F. E. (1970). Control flow analysis. ACM SIGPLAN Notices, 5(7), 1–19. ACM: New York, NY.
Anderson, E., Hoover, C., Li, X., & Tucek, J. (2009). Efficient tracing and performance analysis for large distributed systems. In Proceedings of the 2009 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS 2009), London, UK (pp. 1–10). IEEE Computer Society: Washington, DC.
Briand, L.C., Labiche, Y., & Leduc, J. (2006). Toward the reverse engineering of UML sequence diagrams for distributed java software. IEEE Transactions on Software Engineering, 32(9), 642–663. IEEE Computer Society: Washington, DC.
Brosig, F., Huber, N., & Kounev, S. (2011). Automated extraction of architecture-level performance models of distributed component-based systems. In Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Oread, Lawrence, Kansas. IEEE Computer Society: Washington, DC.
Ehlers, J., & Hasselbring, W. (2011). Self-adaptive software performance monitoring. In R. Reussner, M. Grund, A. Oberweis, W. Tichy (Eds.), Software Engineering 2011 – Fachtagung des GI-Fachbereichs Softwaretechnik (pp. 51–62). Gesellschaft für Informatik e.V.: Bonn.
Gilly, K., Alcaraz, S., Juiz, C., & Puigjaner, R. (2009). Analysis of burstiness monitoring and detection in an adaptive web system. Computer Networks, 53(5), pp. 668–679. Elsevier North-Holland, Inc.: Amsterdam, The Netherlands.
Grohmann, J., Eismann, S., Elflein, S., Kistowski, J. von, Kounev, S., & Mazkatli, M. (2019). Detecting parametric dependencies for performance models using feature selection techniques. In Proceedings of the 27th IEEE International Symposium on the Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2019), Rennes, France. IEEE Computer Society: Washington, DC.
Israr, T., Woodside, M., & Franks, G. (2007). Interaction tree algorithms to extract effective architecture and layered performance models from traces. Journal of Systems and Software, 80(4), 474–492. Elsevier: Amsterdam.
Kuperberg, M., Krogmann, M., & Reussner, R. (2009). TimerMeter: Quantifying properties of software timers for system analysis. In Proceedings of the 6th International Conference on Quantitative Evaluation of SysTems (QEST 2009), Budapest, Hungary (pp. 85–94 ). IEEE: Piscataway, NJ.
Kuperberg, M., & Reussner, R. (2011). Analysing the fidelity of measurements performed with hardware performance counters. In Proceedings of the 2nd ACM/SPEC International Conference on Performance Engineering (ICPE 2011), Karlsruhe, Germany (pp. 413–414). ACM: New York, NY.
Lilja, D. J. (2000). Measuring computer performance: A practitioner’s guide. Cambridge University Press: Cambridge.
Spinner, S., Casale, G., Brosig, F., & Kounev, S. (2015). Evaluating approaches to resource demand estimation. Performance Evaluation, 92, 51–71. Elsevier Science: Amsterdam, The Netherlands.
van Hoorn, A., Waller, J., & Hasselbring, W. (2012). Kieker: A framework for application performance monitoring and dynamic software analysis. In Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering (ICPE 2012), Boston, Massachusetts, USA (pp. 247–248). ACM: New York, NY.
Walter, J. C. (2018). Automation in software performance engineering based on a declarative specification of concerns. Ph.D. Thesis. Würzburg, Germany: University of Würzburg.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kounev, S., Lange, KD., Kistowski, J.v. (2020). Measurement Techniques. In: Systems Benchmarking. Springer, Cham. https://doi.org/10.1007/978-3-030-41705-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-41705-5_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41704-8
Online ISBN: 978-3-030-41705-5
eBook Packages: Computer ScienceComputer Science (R0)