Skip to main content

Evaluation of Several Artificial Intelligence and Machine Learning Algorithms for Image Classification on Small Datasets

  • Conference paper
  • First Online:
Advances on Smart and Soft Computing

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1188))

  • 1065 Accesses

Abstract

In this paper, a benchmark of machine learning (ML) algorithms for single-label image classification is proposed and evaluated on a small dataset. The dataset is obtained through a mobile application allowing citizens to upload images related to water and electricity distribution infrastructure problems. The collected dataset is preprocessed, organized and used to train and evaluate classical supervised ML algorithms (SVM, NB, DT, KNN and MLP) along with deep learning methods (CNN and transfer learning). Data augmentation and fine-tuning techniques are explored to handle the overfitting problem. Conducted experiment results show the effectiveness of transfer learning with data augmentation and fine-tuning using the VGG16 network as the precision reaches 89%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Szeliski, R.: Computer Vision: Algorithms and Applications. Springer Science and Business Media (2010)

    Google Scholar 

  2. Steger, C., Ulrich, M., Wiedemann, C.: Machine Vision Algorithms and Applications. Wiley, New York (2018)

    Google Scholar 

  3. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006)

    Google Scholar 

  4. Riaz, F., Hassan, A., Nisar, R., Dinis-Ribeiro, M., Coimbra, M.T.: Content-adaptive region-based color texture descriptors for medical images. IEEE J. Biomed. Health Inf. 21(1), 162–171 (2015)

    Article  Google Scholar 

  5. Akbarizadeh, G., Rahmani, M.: Efficient combination of texture and color features in a new spectral clustering method for PolSAR image segmentation. Natl. Acad. Sci. Lett. 40(2), 117–120 (2017)

    Article  MathSciNet  Google Scholar 

  6. Wang, M., Wan, Y., Ye, Z., Lai, X.: Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm. Inf. Sci. 402, 50–68 (2017)

    Article  Google Scholar 

  7. Belgiu, M., Drăguţ, L.: Random forest in remote sensing: a review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 114, 24–31 (2016)

    Article  Google Scholar 

  8. Xia, J., Ghamisi, P., Yokoya, N., Iwasaki, A.: Random forest ensembles and extended multiextinction profiles for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 56(1), 202–216 (2018)

    Article  Google Scholar 

  9. Kaymak, S., Helwan, A., Uzun, D.: Breast cancer image classification using artificial neural networks. Procedia Comput. Sci. 120, 126–131 (2017)

    Article  Google Scholar 

  10. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv, 1409.1556 (2014)

    Google Scholar 

  11. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Rabinovich, A., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)

    Google Scholar 

  12. Liu, S., Tian, G., Xu, Y.: A novel scene classification model combining ResNet based transfer learning and data augmentation with a filter. Neurocomputing 338, 191–206 (2019)

    Article  Google Scholar 

  13. Perez, L., & Wang, J.: The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621 (2017)

    Google Scholar 

  14. Chaib, S., Liu, H., Gu, Y., Yao, H.: Deep feature fusion for VHR remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 55(8), 4775–4784 (2017)

    Article  Google Scholar 

  15. Krizhevsky, A., Sutskever, I., Hinton, G. E.: Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105 (2012)

    Google Scholar 

  16. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)

    Google Scholar 

  17. Wong, S.C., Gatt, A., Stamatescu, V., McDonnell, M.D.: Understanding data augmentation for classification: when to warp? In 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–6. IEEE (2016)

    Google Scholar 

  18. Keras Image Preprocessing. https://keras.io/preprocessing/image/

  19. Cortes, C., Vapnik, V.: Support-vector networks. Machine Learn. 20(3), 273–297 (1995)

    Google Scholar 

  20. Quinlan, J.R.: Induction of decision trees. Machine Learn. 1(1), 81–106 (1986)

    Google Scholar 

  21. Kantardzic, M.: Data mining: concepts, models, methods, and algorithms. Wiley, New York (2011)

    Google Scholar 

  22. Gurney, K.: An Introduction to Neural Networks. CRC Press (2014)

    Google Scholar 

  23. Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Machine Learn. 9(4), 309–347 (1992)

    MATH  Google Scholar 

  24. LeCun, Y., Bengio, Y.: Convolutional Networks for Images, Speech, and Time Series. The Handbook of Brain Theory and Neural Networks 3361(10) (1995)

    Google Scholar 

  25. Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of research on machine learning applications and trends: algorithms, methods, and techniques. IGI Global 242–264 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rim Koulali .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Koulali, R., Zaidani, H., Zaim, M. (2021). Evaluation of Several Artificial Intelligence and Machine Learning Algorithms for Image Classification on Small Datasets. In: Saeed, F., Al-Hadhrami, T., Mohammed, F., Mohammed, E. (eds) Advances on Smart and Soft Computing. Advances in Intelligent Systems and Computing, vol 1188. Springer, Singapore. https://doi.org/10.1007/978-981-15-6048-4_5

Download citation

Publish with us

Policies and ethics