An Empirical Study of Classification Models Using AUC-ROC Curve for Software Fault Predictions

Authors

  • Mrs. Prachi Sasankar  Department of Computer Science, School of Science, G.H.Raisoni University, Saikheda, Madhya Pradesh, India
  • Dr. Gopal Sakarkar  Department of Computer Science, School of Science, G.H.Raisoni University, Saikheda, Madhya Pradesh, India

DOI:

https://doi.org//10.32628/CSEIT2390143

Keywords:

AUC, ROC, TPR, FPR, KNN

Abstract

Software bug prediction is the process of identifying software modules that are likely to have bugs by using some fundamental project resources before the real testing starts. Due to high cost in correcting the detected bugs, it is advisable to start predicting bugs at the early stage of development instead of at the testing phase. There are many techniques and approaches that can be used to build the prediction models, such as machine learning. We have studied nine different types of datasets and seven types of machine learning techniques have been identified. As for performance measures, both graphical and numerical measures are used to evaluate the performance of models. A few challenges exist when constructing a prediction model. In this study, we have narrowed down to nine different types of datasets and seven types of machine learning techniques have been identified. As for the performance measure, both graphical and numerical measures are used to evaluate the performance of the models. There are a few challenges in constructing the prediction model. Thus, more studies need to be carried out so that a well-formed result is obtained. We also provide a recommendation for future research based on the results we got from this study.

References

  1. P. Sasankar, "Analysis of Test Management, Functional & Load Testing Tools," International Journal of Scientific Research in Computer Science, Engineering and Information Technology, vol. 1, no. 1, 2016.
  2. Z. Rana, M. Mian and S. Shamail, "An FIS for early detection of defect prone modules," in Intelligent computing, 2009.
  3. S. Lessmann, B. Baesens, C. Mues and S. Pietsch, "Benchmarking classification models for software defect prediction: A proposed framework and novel findings," in IEEE Transactions on Software Engineering, 2008.
  4. P. Patchaiammal and R.Thirumalaiselvi, "Software Fault Prediction Exploration using Machine Learning Techniques," International Journal of Recent Technology and Engineering, vol. 7, no. 6S3, 2019.
  5. C.Prabha and N.Shivakumar, "Software Defect Prediction using Machine Learning Techniques," in International Conference on Trends in Electronics and Informatics, 2020.
  6. S.Mishra, "Usage of Machine Learning in Software Testing," Automated Software Engineering: A Deep Learning Based Approach, pp. 39-54, 2020.
  7. N.Anwar and S.Kar, "Review paper on various software testing techniques & strategies.," Global Journal of Computer Science & Technology: Computer Software & Data Engineering, vol. 19, no. 2, 2019.
  8. J. Xiao-Yuan, Y. Shi, L. Jin and W. Shan-Shan, "Dictionary learning based software defect prediction," in Proceedings of the 36th International Conference on Software Engineering, 2014.
  9. J. Zheng, "Cost-sensitive boosting neural networks for software defect prediction," Expert Systems with Applications, vol. 37, no. 6, p. 4537, 2010.
  10. S.Kumar and P.Ranjan, "A Comprehensive Analysis for Software Fault Detection an Prediction using Computational Intelligence Techniques.," International Journal of Computational Intelligence Research, vol. 13, no. 1, pp. 65-78, 2017.
  11. C. H, "A Systematic Study for Learning Based Software Defect Prediction," in IOP conference series: Journal of Physics, 2020.
  12. P. Sasankar, "Cross Project Defect Prediction using Deep Learning Techniques," in International Conference on Artificial Intelligence & Big Data Analytics, 2022.
  13. G. D.Bowes, N.Davey, Y.Sun and B.Christianson, "Furthur thoughts on precision," in 15 Annual Conference on Evaluation & Assesment in Software Engineering, 2011.
  14. G. Choudhary, S. Kumar, K. Kumar and A. Mishra, "Empirical analysis of change metrics for software fault prediction," Computer and Electrical Engineering, vol. 67, pp. 15-24, 2018.
  15. G. Giray, K. Bennin, O. Koksal, O. Babur and B. Tekinerdogan, "On the use of deep learning in software defect prediction," Journal of systems and software, vol. 195, 2023.
  16. S. Pandey, R. Mishra and A. Tripathi, "BPDET: An Effective software bug prediction model using deep representation and ensemble learning technique.," Expert System Application, p. 144, 2020.
  17. P. A and C. R, "A Hybrid Approach for SFP using ANN and Simplified Swarm Optimization," International Journal of Advanced Research in Computer and Communication Engineering, vol. 6, no. 3, 2017.
  18. P. L, B. S, I. C and S. J, "Using Classifiers for software defect detection," in International Conference on Software Engineering and Data Engineering, 2017.
  19. G. B and A. C, "Software Root Cause Prediction using Clustering Techniques," in Global Conference on Communication Technologies, 2015.
  20. Q. O.A and A. M, "Software Fault Prediction using Deep Learning Algorithms," International Journal of Open Source Software and Processes, 2019.
  21. M. S and M. S, "Usage of Machine Learning in Software Testing," Automated Software Engineering: A Deep Learning Based Approach. Learning and Analytics in Inlligent System, 2020.
  22. R. U. Khan, S. Albahli, W. Albattah and M. Khan, "Software Defect Prediction Via Deep Learning," International Journal of Innovative Technology and Exploring Engineering, 2020.

Downloads

Published

2023-02-28

Issue

Section

Research Articles

How to Cite

[1]
Mrs. Prachi Sasankar, Dr. Gopal Sakarkar, " An Empirical Study of Classification Models Using AUC-ROC Curve for Software Fault Predictions, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 1, pp.250-260, January-February-2023. Available at doi : https://doi.org/10.32628/CSEIT2390143