Abstract
Response time predictions for workload on new server architectures can enhance Service Level Agreement–based resource management. This paper evaluates two performance prediction methods using a distributed enterprise application benchmark. The historical method makes predictions by extrapolating from previously gathered performance data, while the layered queuing method makes predictions by solving layered queuing networks. The methods are evaluated in terms of: the systems that can be modelled; the metrics that can be predicted; the ease with which the models can be created and the level of expertise required; the overheads of recalibrating a model; and the delay when evaluating a prediction. The paper also investigates how a prediction-enhanced resource management algorithm can be tuned so as to compensate for predictive inaccuracy and balance the costs of SLA violations and server usage.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
J. Aman, C. Eilert, D. Emmes, P. Yocom, and D. Dillenberger. Adaptive algorithms for managing a distributed data processing workload. IBM Systems Journal, 36(2):242–283, 1997.
Y. An, T. Kin, T. Lau, and P. Shum. A Scalability Study for WebSphere Application Server and DB2 Universal Database, IBM White paper, 2002. Available at: http://www.ibm.com/developerworks/
Apache JMeter User Manual. Available at: http://jakarta.apache.org/jmeter/index.html
K. Appleby, S. Fakhouri, L. Fong, G. Goldszmidt, M. Kalantar, S. Krishnakumar, D. P. Pazel, J. Pershing, and B. Rochwerger, Oceano-SLA Based Management of a Computing Utility. 7th IFIP/IEEE International Symposium on Integrated Network Management, New York, May 2001.
D. Bacigalupo, S. A. Jarvis, L. He, and G. R. Nudd, An Investigation into the Application of Different Performance Prediction Techniques to e-Commerce Applications, Workshop on Performance Modelling, Evaluation and Optimization of Parallel and Distributed Systems. 18th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2004), New Mexico, USA, April 2004.
Y. Diao, J. Hellerstein, and S. Parekh, Stochastic Modeling of Lotus Notes with a Queueing Model. Computer Measurement Group International Conference (CMG 2001), California, USA, December 2001.
M. Endrel. IBM WebSphere V4.0 Advanced Edition Handbook, IBM International Technical Support Organisation Pub., 2002. Available at: http://www.redbooks.ibm.com/
M. Goldszmidt, D. Palma, and B. Sabata. On the Quantification of e-Business Capacity. ACM Conference on Electronic Commerce (EC 2001), Florida, USA, October 2001.
IBM Websphere Performance Sample: Trade. Available at http://www.ibm.com/software/info/websphere/
T. Liu, S. Kumaran, and J. Chung, Performance Modeling of EJBs. 7th World Multiconference on Systemics, Cybernetics and Informatics (SCI 2003), Florida USA, 2003.
Z. Liu, M. S. Squillante, and J. Wolf. On Maximizing Service-Level-Agreement Profits. ACM Conference on Electronic Commerce (EC 2001), Florida, USA, October 2001.
Z. Liu, C. H. Xia, P. Momcilovic, and L. Zhang, AMBIENCE: Automatic Model Building using IferENCE, IBM Research Report RC22961, November 2003. Available at: www.research.ibm.com
D. Menasce. Two-Level Iterative Queuing Modeling of Software Contention. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS 2002), Texas, USA, October 2002.
J. Rolia, X. Zhu, M. Arlitt, and A. Andrzejak, Statistical Service Assurances for Applications in Utility Grid Environments. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS 2002), Texas, USA, October 2002.
F. Sheikh and M. Woodside. Layered Analytic Performance Modelling of a Distributed Database System. International Conference on Distributed Computing Systems (ICDCS’97), Maryland USA, May 1997.
J. D. Turner, D. A. Bacigalupo, S. A. Jarvis, D. N. Dillenberger, and G. R. Nudd. Application response measurement of distributed web services. International Journal of Computer Resource Measurement, 108:45–55, 2002.
C. M. Woodside, J. E. Neilson, D. C. Petriu, and S. Majumdar. The stochastic rendezvous network model for performance of synchronous client-server-like distributed software. IEEE Trans. On Computer, 44(1):20–34, 1995.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bacigalupo, D.A., Jarvis, S.A., He, L. et al. An Investigation into the Application of Different Performance Prediction Methods to Distributed Enterprise Applications. J Supercomput 34, 93–111 (2005). https://doi.org/10.1007/s11227-005-2335-z
Issue Date:
DOI: https://doi.org/10.1007/s11227-005-2335-z