Skip to main content
SpringerLink
Log in

Optimal Band Selection Using Evolutionary Machine Learning to Improve the Accuracy of Hyper-spectral Images Classification: a Novel Migration-Based Particle Swarm Optimization

  • Published:
Journal of Classification Aims and scope Submit manuscript

Abstract

In the domain of real-world concept learning, feature selection plays a crucial role in accelerating learning processes and enhancing the quality of classification concepts, particularly in remote sensing image classification. Traditional methods often exhibit weaknesses such as instability, sensitivity to noise, and a lack of consideration for feature dependencies when selecting informative spectral features from hyper-spectral (HS) images. Recent studies have recommended the utilization of meta-heuristic algorithms to address these limitations. However, most of these approaches overlook the correlation between spectral bands. To tackle these challenges, we propose a novel migration-based particle swarm optimization (MBPSO) algorithm that surpasses previous methods in terms of exploitation and exploration and considers spectral band correlation to prevent the inclusion of unnecessary bands. The variance-based J1 criteria are employed as the fitness function for MBPSO, while a support vector machine (SVM) is utilized as the classifier. To evaluate the performance of our proposed method against other optimization algorithms, we conducted experiments using four HS datasets, namely Indian Pine, Pavia University, Salinas, and Washington Mall. Numerical evaluations encompassing class accuracy, overall accuracy, kappa coefficient, execution time, stability, Wilcoxon test, and convergence rate were performed. The results indicate that our proposed algorithm achieves superior numerical outcomes compared to other algorithms, while requiring fewer features to attain higher accuracy. The algorithm’s higher speed, reduced computational time, and avoidance of additional features in the solution can be attributed to the presence of the conditional mutation operator within the MBPSO algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  • Afrasyabi, P., Mesgari, M. S., Razban, M., & Kaveh, M. (2022). Multi-modal routing using NSGA-II algorithm considering Covid-19 protocols: A Case Study in Tehran. Earth Observation and Geomatics Engineering.

  • Aghaei, N., Akbarizadeh, G., & Kosarian, A. (2022a). Osdes_net: Oil spill detection based on efficient_shuffle network using synthetic aperture radar imagery. Geocarto International, 37(26), 13539–13560.

    Article  Google Scholar 

  • Aghaei, N., Akbarizadeh, G., & Kosarian, A. (2022b). GreyWolfLSM: An accurate oil spill detection method based on level set method from synthetic aperture radar imagery. European Journal of Remote Sensing, 55(1), 181–198.

    Article  Google Scholar 

  • Aghakhani, S., Larijani, A., Sadeghi, F., Martín, D., & Shahrakht, A. A. (2023). A novel hybrid artificial bee colony-based deep convolutional neural network to improve the detection performance of backscatter communication systems. Electronics, 12(10), 2263.

    Article  Google Scholar 

  • Aghakhani, S., & Rajabi, M. S. (2022). A new hybrid multi-objective scheduling model for hierarchical hub and flexible flow shop problems. AppliedMath, 2(4), 721–737.

    Article  Google Scholar 

  • Aschenbruck, R., Szepannek, G., & Wilhelm, A. F. (2022). Imputation strategies for clustering mixed-type data with missing values. Journal of Classification, 1–23.

  • Baniasadi, S., Rostami, O., Martín, D., & Kaveh, M. (2022). A novel deep supervised learning-based approach for intrusion detection in IoT systems. Sensors, 22(12), 4459.

    Article  Google Scholar 

  • Benesty, J., Chen, J., Huang, Y., & Cohen, I. (2009). Pearson correlation coefficient. In Noise reduction in speech processing, 1–4.

  • Bonah, E., Huang, X., Yi, R., Aheto, J. H., & Yu, S. (2020). Vis-NIR hyperspectral imaging for the classification of bacterial foodborne pathogens based on pixel-wise analysis and a novel CARS-PSO-SVM model. Infrared Physics & Technology, 105, 103220.

    Article  Google Scholar 

  • Chang, C. I. (Ed.). (2007). Hyperspectral data exploitation: theory and applications. John Wiley & Sons.

    Google Scholar 

  • Davari, N., Akbarizadeh, G., & Mashhour, E. (2021). Corona detection and power equipment classification based on GoogleNet-AlexNet: An accurate and intelligent defect detection model based on deep learning for power distribution lines. IEEE Transactions on Power Delivery, 37(4), 2766–2774.

    Article  Google Scholar 

  • Dehghani, F., & Larijani, A. (2023b). Average portfolio optimization using multi-layer neural networks with risk consideration. Available at SSRN https://doi.org/10.2139/ssrn.4436648

  • Dehghani, F., & Larijani, A. (2023a). An algorithm for predicting stock market’s index based on MID algorithm and neural network. Available at SSRN 4448033.

  • Derrac, J., García, S., Molina, D., & Herrera, F. (2011). A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm and Evolutionary Computation, 1(1), 3–18.

    Article  Google Scholar 

  • Fard, S. S., Kaveh, M., Mosavi, M. R., & Ko, S. B. (2022). An efficient modeling attack for breaking the security of XOR-Arbiter PUFs by using the fully connected and long-short term memory. Microprocessors and Microsystems, 94, 104667.

    Article  Google Scholar 

  • Ghara, F. M., Shokouhi, S. B., & Akbarizadeh, G. (2022). A new technique for segmentation of the oil spills from synthetic-aperture radar images using convolutional neural network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 8834–8844.

    Article  Google Scholar 

  • Habib, S., Aghakhani, S., Nejati, M. G., Azimian, M., Jia, Y., & Ahmed, E. M. (2023). Energy management of an intelligent parking lot equipped with hydrogen storage systems and renewable energy sources using the stochastic p-robust optimization approach. Energy, 278, 127844.

    Article  Google Scholar 

  • Kaveh, M., Kaveh, M., Mesgari, M. S., & Paland, R. S. (2020a). Multiple criteria decision-making for hospital location-allocation based on improved genetic algorithm. Applied Geomatics, 1–16.

  • Kaveh, M., & Mesgari, M. S. (2022). Application of meta-heuristic algorithms for training neural networks and deep learning architectures: A Comprehensive Review. Neural Processing Letters, 1–104.

  • Kaveh, M., Mesgari, M. S., Martín, D., & Kaveh, M. (2023a). TDMBBO: A novel three-dimensional migration model of biogeography-based optimization (case study: Facility planning and benchmark problems). The Journal of Supercomputing, 1–56.

  • Kaveh, M., Khishe, M., & Mosavi, M. R. (2019). Design and implementation of a neighborhood search biogeography-based optimization trainer for classifying sonar dataset using multi-layer perceptron neural network. Analog Integrated Circuits and Signal Processing, 100(2), 405–428.

    Article  Google Scholar 

  • Kaveh, M., & Mesgari, M. S. (2019a). Improved biogeography-based optimization using migration process adjustment: An approach for location-allocation of ambulances. Computers & Industrial Engineering, 135, 800–813.

    Article  Google Scholar 

  • Kaveh, M., & Mesgari, M. S. (2019). Hospital site selection using hybrid PSO algorithm-Case study: District 2 of Tehran. Scientific-Research Journal of Geographical Data (SEPEHR), 28(111), 7–22.

    Google Scholar 

  • Kaveh, M., Mesgari, M. S., & Khosravi, A. (2020b). Solving the local positioning problem using a four-layer artificial neural network. Engineering Journal of Geospatial Information Technology, 7(4), 21–40.

    Google Scholar 

  • Kaveh, M., Mesgari, M. S., & Saeidian, B. (2023b). Orchard Algorithm (OA): A new meta-heuristic algorithm for solving discrete and continuous optimization problems. Mathematics and Computers in Simulation, 208, 95–135.

    Article  MathSciNet  MATH  Google Scholar 

  • Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of ICNN'95-International Conference on Neural Networks, 4, 1942–1948.

  • Khajehyar, R., Vahidi, M., & Tripepi, R. (2021). Determining nitrogen foliar nutrition of tissue culture shoots of little-leaf mockorange by using spectral imaging. Supplement to HortScience, ASHS 2021 Annual Conference, 56 (9s), S22-S23.

  • Khishe, M., Mosavi, M. R., & Kaveh, M. (2017). Improved migration models of biogeography-based optimization for sonar dataset classification by using neural network. Applied Acoustics, 118, 15–29.

    Article  Google Scholar 

  • Kianfar, N., Mesgari, M. S., Mollalo, A., & Kaveh, M. (2022). Spatio-temporal modeling of COVID-19 prevalence and mortality using artificial neural network algorithms. Spatial and Spatio-Temporal Epidemiology, 40, 100471.

    Article  Google Scholar 

  • Larijani, A., & Dehghani, F. (2023). Stock price prediction using the combination of firefly (FA) and genetic algorithms. Available at SSRN 4448024.

  • Li, S., Wu, H., Wan, D., & Zhu, J. (2011). An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine. Knowledge-Based Systems, 24(1), 40–48.

    Article  Google Scholar 

  • Liu, H., Wu, C., Li, C., & Zuo, Y. (2022). Fast robust fuzzy clustering based on bipartite graph for hyper-spectral image classification. IET Image Processing, 16(13), 3634–3647.

    Article  Google Scholar 

  • Lotfy, A., Kaveh, M., Mosavi, M. R., & Rahmati, A. R. (2020). An enhanced fuzzy controller based on improved genetic algorithm for speed control of DC motors. Analog Integrated Circuits and Signal Processing, 1–15.

  • Ma, X., Kirby, M., & Peterson, C. (2022). Self-organizing mappings on the flag manifold with applications to hyper-spectral image data analysis. Neural Computing and Applications, 34(1), 39–49.

    Article  Google Scholar 

  • Medjahed, S. A., Saadi, T. A., Benyettou, A., & Ouali, M. (2016). Gray wolf optimizer for hyperspectral band selection. Applied Soft Computing, 40, 178–186.

    Article  Google Scholar 

  • Mohammadi, R., Sahebi, M. R., Omati, M., & Vahidi, M. (2018). Synthetic aperture radar remote sensing classification using the bag of visual words model to land cover studies. International Journal of Geological and Environmental Engineering, 12(9), 588–591.

    Google Scholar 

  • Najafi, F., Kaveh, M., Martín, D., & Reza Mosavi, M. (2021). Deep PUF: A highly reliable DRAM PUF-based authentication for IoT networks using deep convolutional neural networks. Sensors, 21(6), 2009.

    Article  Google Scholar 

  • Qi, C., Zhou, Z., Sun, Y., Song, H., Hu, L., & Wang, Q. (2017). Feature selection and multiple kernel boosting framework based on PSO with mutation mechanism for hyperspectral classification. Neurocomputing, 220, 181–190.

    Article  Google Scholar 

  • Rossbroich, J., Durieux, J., & Wilderjans, T. F. (2022). Model selection strategies for determining the optimal number of overlapping clusters in additive overlapping partitional clustering. Journal of Classification, 39, 264–301.

    Article  MathSciNet  MATH  Google Scholar 

  • Rostami, O., & Kaveh, M. (2021). Optimal feature selection for SAR image classification using biogeography-based optimization (BBO), artificial bee colony (ABC) and support vector machine (SVM): A combined approach of optimization and machine learning. Computational Geosciences, 25(3), 911–930.

    Article  MATH  Google Scholar 

  • Sadeghi, F., Rostami, O., Yi, M. K., & Hwang, S. O. (2023). A deep learning approach for detecting Covid-19 using the chest X-ray images. CMC-Computers Materials & Continua, 74(1), 751–768.

    Article  Google Scholar 

  • Saleh Nezhad, M., Akbarizadeh, G., Seifi Kavian, Y., & Salehi-Moorkani, R. (2023). Automatic interpretation of oil and gas well cement evaluation logs using fuzzy convolutional neural networks. SPE Drilling & Completion, 1–11.

  • Samadi, F., Akbarizadeh, G., & Kaabi, H. (2019). Change detection in SAR images using deep belief network: A new training approach based on morphological images. IET Image Processing, 13(12), 2255–2264.

    Article  Google Scholar 

  • Sawant, S., & Manoharan, P. (2021). A hybrid optimization approach for hyperspectral band selection based on wind driven optimization and modified cuckoo search optimization. Multimedia Tools and Applications, 80(2), 1725–1748.

    Article  Google Scholar 

  • Sawant, S. S., Manoharan, P., & Loganathan, A. (2021). Band selection strategies for hyperspectral image classification based on machine learning and artificial intelligent techniques–Survey. Arabian Journal of Geosciences, 14(7), 1–10.

    Article  Google Scholar 

  • Sharifzadeh, F., Akbarizadeh, G., & Seifi Kavian, Y. (2019). Ship classification in SAR images using a new hybrid CNN–MLP classifier. Journal of the Indian Society of Remote Sensing, 47, 551–562.

    Article  Google Scholar 

  • Shitharth, S., Manoharan, H., Alshareef, A. M., Yafoz, A., Alkhiri, H., & Mirza, O. M. (2022). Hyper spectral image classifications for monitoring harvests in agriculture using fly optimization algorithm. Computers and Electrical Engineering, 103, 108400.

    Article  Google Scholar 

  • Tirandaz, Z., Akbarizadeh, G., & Kaabi, H. (2020). PolSAR image segmentation based on feature extraction and data compression using weighted neighborhood filter bank and hidden Markov random field-expectation maximization. Measurement, 153, 107432.

    Article  Google Scholar 

  • Vahidi, M., Shafian, S., Thomas, S., & Maguire, R. (2022). Bale grazing and sacrificed pastures monitoring using integration of sentinel satellite images and machine learning techniques. In AGU Fall Meeting Abstracts, 2022, B45I-1834.

  • Wang, J., Khishe, M., Kaveh, M., & Mohammadi, H. (2021). Binary chimp optimization algorithm (BChOA): A new binary meta-heuristic for solving optimization problems. Cognitive Computation, 13(5), 1297–1316.

    Article  Google Scholar 

  • Wang, M., Wu, C., Wang, L., Xiang, D., & Huang, X. (2019). A feature selection approach for hyperspectral image based on modified ant lion optimizer. Knowledge-Based Systems, 168, 39–48.

    Article  Google Scholar 

  • Xie, F., Li, F., Lei, C., Yang, J., & Zhang, Y. (2019). Unsupervised band selection based on artificial bee colony algorithm for hyperspectral image classification. Applied Soft Computing, 75, 428–440.

    Article  Google Scholar 

  • Yang, H. C., Zhang, S. B., Deng, K. Z., & Du, P. J. (2007). Research into a feature selection method for hyperspectral imagery using PSO and SVM. Journal of China University of Mining and Technology, 17(4), 473–478.

    Article  Google Scholar 

  • Yong, Z., Chun-lin, H., Xian-fang, S., & Xiao-yan, S. (2021). A multi-strategy integrated multi-objective artificial bee colony for unsupervised band selection of hyperspectral images. Swarm and Evolutionary Computation, 60, 100806.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Plant and Environmental Sciences, Virginia Polytechnic Institute and State University, Blacksburg, VA , 24060, USA

    Milad Vahidi

  2. Department of Industrial and Manufacturing Systems Engineering, Iowa State University, Ames, USA

    Sina Aghakhani

  3. ETSI de Telecomunicación, Universidad Politécnica de Madrid, Av. Complutense 30, 28040, Madrid, Spain

    Diego Martín

  4. Faculty of Geodesy and Geomatics, K. N. Toosi University of Technology, Tehran, 19967-15433, Iran

    Hossein Aminzadeh & Mehrdad Kaveh

Authors
  1. Milad Vahidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sina Aghakhani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Diego Martín
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hossein Aminzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mehrdad Kaveh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Diego Martín or Mehrdad Kaveh.

Ethics declarations

Ethics Approval

This paper does not contain any studies with human participants or animals.

Consent to Participate

Not applicable.

Conflict of Interest

The authors declare no competing interests.

Informed Consent

As this paper does not contain any studies with human participants or animals, the informed consent is not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vahidi, M., Aghakhani, S., Martín, D. et al. Optimal Band Selection Using Evolutionary Machine Learning to Improve the Accuracy of Hyper-spectral Images Classification: a Novel Migration-Based Particle Swarm Optimization. J Classif 40, 552–587 (2023). https://doi.org/10.1007/s00357-023-09448-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00357-023-09448-w

Keywords

Search

Navigation