Skip to main content

Advertisement

SpringerLink
Log in

Metaheuristic-based hyperparameter optimization for multi-disease detection and diagnosis in machine learning

  • Special Issue Paper
  • Published:
Service Oriented Computing and Applications Aims and scope Submit manuscript

Abstract

Metaheuristic algorithms with machine learning techniques have become popular because it works so well for problems like regression, classification, rule mining, and clustering in health care. This paper’s primary purpose is to design a multi-disease prediction system using AI-based metaheuristic approaches. Initially, the data is collected in the form of diverse classes, which include Id, gender, date of birth, etc. The data has been preprocessed, normalized, and graphically represented to improve its quality and detect any errors. Later, machine learning models, such as decision tree, extra tree classifier, extreme gradient boosting classifier, light gradient boosting machine classifier, random forest, and artificial neural network, are initially trained without optimizing hyperparameters and then fine-tuned by integrating various hyperparameter optimizers such as grid search CV, random search, hyperband, and genetic search. During experimentation, it is found that optimizing the models using random search optimizer computed the highest accuracy of 100% as compared to the rest of the hyperparameter optimizers. In the context of ‘Service Oriented Computing and Applications,’ our multi-disease prediction system offers valuable innovation. It aligns with the goal of enhancing healthcare services, patient outcomes, and healthcare efficiency. Our pioneering integration of metaheuristic algorithms and machine learning introduces intelligent healthcare solutions, with the study’s focus on hyperparameter optimization and achieving 100% accuracy demonstrates practical significance in SOC and its applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Lauri J, Dutta S, Grassia M, Ajwani D (2020) Learning fine-grained search space pruning and heuristics for combinatorial optimization. https://arxiv.org/abs/2001.01230

  2. Linardatos P, Papastefanopoulos V, Kotsiantis S (2020) Explainable ai: a review of machine learning interpretability methods. Entropy 23(1):18

    Article  Google Scholar 

  3. Gandomi AH, Yang XS, Alavi AH (2013) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Comput 29:17–35

    Article  Google Scholar 

  4. Singh P, Kottath R (2021) An ensemble approach to meta-heuristic algorithms: comparative analysis and its applications. Comput Ind Eng 162:107739

    Article  Google Scholar 

  5. Xu Y, Liu X, Cao X, Huang C, Liu E, Qian S, Zhang J (2021) Artificial intelligence: a powerful paradigm for scientific research. Innov 2(4):100179

    Google Scholar 

  6. Karimi-Mamaghan M, Mohammadi M, Pasdeloup B, Meyer P (2023) Learning to select operators in meta-heuristics: an integration of Q-learning into the iterated greedy algorithm for the permutation flowshop scheduling problem. Eur J Oper Res 304(3):1296–1330

    Article  MathSciNet  Google Scholar 

  7. Kumar Y, Koul A, Sisodia PS, Shafi J, Kavita V, Gheisari M, Davoodi MB (2021) Heart failure detection using quantum-enhanced machine learning and traditional machine learning techniques for internet of artificially intelligent medical things. Wirel Commun Mob Comput 2021:1–16

    Google Scholar 

  8. Sarker IH (2021) Machine learning: algorithms, real-world applications and research directions. SN Comput Sci 2(3):160

    Article  Google Scholar 

  9. Brownlee J (2016) Supervised and unsupervised machine learning algorithms. Mach Learn Mastery 16(03)

  10. Gupta A, Koul A, Kumar Y (2022) Pancreatic cancer detection using machine and deep learning techniques. In: 2022 2nd international conference on innovative practices in technology and management (ICIPTM). IEEE, vol 2, pp 151–155

  11. Sarker IH (2021) Deep learning: a comprehensive overview on techniques, taxonomy, applications and research directions. SN Comput Sci 2(6):420

    Article  Google Scholar 

  12. Kumar Y, Kaul S, Sood K (2019) Effective use of the machine learning approaches on different clouds. In: Proceedings of International Conference on Sustainable Computing in Science, Technology and Management (SUSCOM), Amity University Rajasthan, Jaipur-India

  13. Babu GS, Rao ST, Rao RR (2022) Automated assessment for Alzheimer’s disease diagnosis from MRI images: meta-heuristic assisted deep learning model. Int J Imaging Syst Technol 32(2):544–563

    Article  Google Scholar 

  14. Faris H, Aljarah I, Mirjalili S (2016) Training feedforward neural networks using multi-verse optimizer for binary classification problems. Appl Intell 45:322–332

    Article  Google Scholar 

  15. Aljarah I, Al-Zoubi AM, Faris H, Hassonah MA, Mirjalili S, Saadeh H (2018) Simultaneous feature selection and support vector machine optimization using the grasshopper optimization algorithm. Cogn Comput 10:478–495

    Article  Google Scholar 

  16. Tao Z, Huiling L, Wenwen W, Xia Y (2019) GA-SVM based feature selection and parameter optimization in hospitalization expense modeling. Appl Soft Comput 75:323–332

    Article  Google Scholar 

  17. Faris H, Mirjalili S, Aljarah I (2019) Automatic selection of hidden neurons and weights in neural networks using grey wolf optimizer based on a hybrid encoding scheme. Int J Mach Learn Cybern 10:2901–2920

    Article  Google Scholar 

  18. Mirjalili S (2015) How effective is the Grey Wolf optimizer in training multi-layer perceptrons. Appl Intell 43:150–161

    Article  Google Scholar 

  19. Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A Levy flight-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30:3707–3720

    Article  Google Scholar 

  20. Hu A, Razmjooy N (2021) Brain tumor diagnosis based on metaheuristics and deep learning. Int J Imaging Syst Technol 31(2):657–669

    Article  Google Scholar 

  21. Eshtay M, Faris H, Obeid N (2018) Improving extreme learning machine by competitive swarm optimization and its application for medical diagnosis problems. Expert Syst Appl 104:134–152

    Article  Google Scholar 

  22. Shankar K, Manickam P, Devika G, Ilayaraja M (2018) Optimal feature selection for chronic kidney disease classification using deep learning classifier. In: 2018 IEEE international conference on computational intelligence and computing research (ICCIC). IEEE, pp 1–5

  23. Chitradevi D, Prabha S, Prabhu AD (2021) Diagnosis of Alzheimer disease in MR brain images using optimization techniques. Neural Comput Appl 33:223–237

    Article  Google Scholar 

  24. Canayaz M (2021) MH-COVIDNet: Diagnosis of COVID-19 using deep neural networks and meta-heuristic-based feature selection on X-ray images. Biomed Signal Process Control 64:102257

    Article  Google Scholar 

  25. Roostaee S, Ghaffary HR (2016) Diagnosis of heart disease based on meta heuristic algorithms and clustering methods. J Electr Comput Eng Innov (JECEI) 4(2):105–110

    Google Scholar 

  26. Nadimi-Shahraki MH, Zamani H, Mirjalili S (2022) Enhanced whale optimization algorithm for medical feature selection: a COVID-19 case study. Comput Biol Med 148:105858

    Article  Google Scholar 

  27. Rashid TA, Fattah P, Awla DK (2018) Using accuracy measure for improving the training of LSTM with metaheuristic algorithms. Procedia Comput Sci 140:324–333

    Article  Google Scholar 

  28. Elgamal ZM, Yasin NBM, Tubishat M, Alswaitti M, Mirjalili S (2020) An improved harris hawks optimization algorithm with simulated annealing for feature selection in the medical field. IEEE Access 8:186638–186652

    Article  Google Scholar 

  29. Oyelade ON, Ezugwu AES, Mohamed TI, Abualigah L (2022) Ebola optimization search algorithm: A new nature-inspired metaheuristic optimization algorithm. IEEE Access 10:16150–16177

    Article  Google Scholar 

  30. Karimnahas (2018) Medical data. Kaggle. https://www.kaggle.com/datasets/karimnahas/medicaldata

  31. Chaudhary A, Kolhe S, Kamal R (2016) An improved random forest classifier for multi-class classification. Inf Process Agric 3(4):215–222

    Google Scholar 

  32. Alzubi J, Nayyar A, Kumar A (2018) Machine learning from theory to algorithms: an overview. In: Journal of physics: conference series. IOP Publishing, vol 1142, p 012012

  33. Ilyas H, Ali S, Ponum M, Hasan O, Mahmood MT, Iftikhar M, Malik MH (2021) Chronic kidney disease diagnosis using decision tree algorithms. BMC Nephrol 22(1):1–11

    Article  Google Scholar 

  34. Lu Y, Ye T, Zheng J (2022) Decision tree algorithm in machine learning. In: 2022 IEEE international conference on advances in electrical engineering and computer applications (AEECA). IEEE, pp 1014–1017

  35. Ampomah EK, Qin Z, Nyame G (2020) Evaluation of tree-based ensemble machine learning models in predicting stock price direction of movement. Information 11(6):332

    Article  Google Scholar 

  36. Alfian G, Syafrudin M, Fahrurrozi I, Fitriyani NL, Atmaji FTD, Widodo T, Rhee J (2022) Predicting breast cancer from risk factors using SVM and extra-trees-based feature selection method. Computers 11(9):136

    Article  Google Scholar 

  37. Mienye ID, Sun Y (2022) A survey of ensemble learning: concepts, algorithms, applications, and prospects. IEEE Access 10:99129–99149

    Article  Google Scholar 

  38. Kumar GD, Deepa V, Vineela N, Emmanuel G (2022) Detection of Parkinson’s disease using LightGBM Classifier. In: 2022 6th International conference on computing methodologies and communication (ICCMC). IEEE, pp 1292–1297

  39. Trognon A, Cherifi YI, Habibi I, Demange L, Prudent C (2022) Using machine-learning strategies to solve psychometric problems. Sci Rep 12(1):18922

    Article  Google Scholar 

  40. Micheli-Tzanakou E (2011) Artificial neural networks: an overview. Netw Comput Neural Syst 22(1–4):208–230

    Article  Google Scholar 

  41. Gallo C (2015) Artificial neural networks tutorial. In: Encyclopedia of information science and technology, Third Edition. IGI Global, pp 6369–6378

  42. Liashchynskyi P, Liashchynskyi P (2019) Grid search, random search, genetic algorithm: a big comparison for NAS. https://arxiv.org/abs/1912.06059

  43. Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(2)

  44. Kumar Y, Gupta S (2023) Deep transfer learning approaches to predict glaucoma, cataract, choroidal neovascularization, diabetic macular Edema, DRUSEN and healthy eyes: an experimental review. Arch Computat Methods Eng 30:521–541. https://doi.org/10.1007/s11831-022-09807-7

    Article  Google Scholar 

  45. Wang J, Xu J, Wang X (2018) Combination of hyperband and Bayesian optimization for hyperparameter optimization in deep learning. https://arxiv.org/abs/1801.01596

  46. Sipper M, Fu W, Ahuja K, Moore JH (2018) Investigating the parameter space of evolutionary algorithms. BioData Min 11:1–14

    Article  Google Scholar 

  47. Koul A, Bawa RK, Kumar Y (2022) Artificial intelligence techniques to predict the airway disorders illness: a systematic review. Arch Comput Methods Eng 1–34

  48. Kaur S, Kumar Y, Koul A et al (2022) A systematic review on metaheuristic optimization techniques for feature selections in disease diagnosis: open issues and challenges. Arch Computat Methods Eng. https://doi.org/10.1007/s11831-022-09853-1

    Article  Google Scholar 

  49. Kumar Y, Gupta S, Singla R et al (2022) A systematic review of artificial intelligence techniques in cancer prediction and diagnosis. Arch Computat Methods Eng 29:2043–2070. https://doi.org/10.1007/s11831-021-09648-w

    Article  Google Scholar 

  50. Bhardwaj P, Bhandari G, Kumar Y et al (2022) An investigational approach for the prediction of gastric cancer using artificial intelligence techniques: a systematic review. Arch Computat Methods Eng 29:4379–4400. https://doi.org/10.1007/s11831-022-09737-4

    Article  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of CSE, Chandigarh University, Gharuan, Mohali, India

    Jagandeep Singh & Jasminder Kaur Sandhu

  2. Department of CSE, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India

    Yogesh Kumar

Authors
  1. Jagandeep Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jasminder Kaur Sandhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yogesh Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yogesh Kumar.

Ethics declarations

Conflict of interest

Authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, J., Sandhu, J.K. & Kumar, Y. Metaheuristic-based hyperparameter optimization for multi-disease detection and diagnosis in machine learning. SOCA 18, 163–182 (2024). https://doi.org/10.1007/s11761-023-00382-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11761-023-00382-8

Keywords

Search

Navigation