Abstract
In this paper, a benchmark of machine learning (ML) algorithms for single-label image classification is proposed and evaluated on a small dataset. The dataset is obtained through a mobile application allowing citizens to upload images related to water and electricity distribution infrastructure problems. The collected dataset is preprocessed, organized and used to train and evaluate classical supervised ML algorithms (SVM, NB, DT, KNN and MLP) along with deep learning methods (CNN and transfer learning). Data augmentation and fine-tuning techniques are explored to handle the overfitting problem. Conducted experiment results show the effectiveness of transfer learning with data augmentation and fine-tuning using the VGG16 network as the precision reaches 89%.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Szeliski, R.: Computer Vision: Algorithms and Applications. Springer Science and Business Media (2010)
Steger, C., Ulrich, M., Wiedemann, C.: Machine Vision Algorithms and Applications. Wiley, New York (2018)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006)
Riaz, F., Hassan, A., Nisar, R., Dinis-Ribeiro, M., Coimbra, M.T.: Content-adaptive region-based color texture descriptors for medical images. IEEE J. Biomed. Health Inf. 21(1), 162–171 (2015)
Akbarizadeh, G., Rahmani, M.: Efficient combination of texture and color features in a new spectral clustering method for PolSAR image segmentation. Natl. Acad. Sci. Lett. 40(2), 117–120 (2017)
Wang, M., Wan, Y., Ye, Z., Lai, X.: Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm. Inf. Sci. 402, 50–68 (2017)
Belgiu, M., Drăguţ, L.: Random forest in remote sensing: a review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 114, 24–31 (2016)
Xia, J., Ghamisi, P., Yokoya, N., Iwasaki, A.: Random forest ensembles and extended multiextinction profiles for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 56(1), 202–216 (2018)
Kaymak, S., Helwan, A., Uzun, D.: Breast cancer image classification using artificial neural networks. Procedia Comput. Sci. 120, 126–131 (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv, 1409.1556 (2014)
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Rabinovich, A., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Liu, S., Tian, G., Xu, Y.: A novel scene classification model combining ResNet based transfer learning and data augmentation with a filter. Neurocomputing 338, 191–206 (2019)
Perez, L., & Wang, J.: The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621 (2017)
Chaib, S., Liu, H., Gu, Y., Yao, H.: Deep feature fusion for VHR remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 55(8), 4775–4784 (2017)
Krizhevsky, A., Sutskever, I., Hinton, G. E.: Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105 (2012)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Wong, S.C., Gatt, A., Stamatescu, V., McDonnell, M.D.: Understanding data augmentation for classification: when to warp? In 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–6. IEEE (2016)
Keras Image Preprocessing. https://keras.io/preprocessing/image/
Cortes, C., Vapnik, V.: Support-vector networks. Machine Learn. 20(3), 273–297 (1995)
Quinlan, J.R.: Induction of decision trees. Machine Learn. 1(1), 81–106 (1986)
Kantardzic, M.: Data mining: concepts, models, methods, and algorithms. Wiley, New York (2011)
Gurney, K.: An Introduction to Neural Networks. CRC Press (2014)
Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Machine Learn. 9(4), 309–347 (1992)
LeCun, Y., Bengio, Y.: Convolutional Networks for Images, Speech, and Time Series. The Handbook of Brain Theory and Neural Networks 3361(10) (1995)
Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of research on machine learning applications and trends: algorithms, methods, and techniques. IGI Global 242–264 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Koulali, R., Zaidani, H., Zaim, M. (2021). Evaluation of Several Artificial Intelligence and Machine Learning Algorithms for Image Classification on Small Datasets. In: Saeed, F., Al-Hadhrami, T., Mohammed, F., Mohammed, E. (eds) Advances on Smart and Soft Computing. Advances in Intelligent Systems and Computing, vol 1188. Springer, Singapore. https://doi.org/10.1007/978-981-15-6048-4_5
Download citation
DOI: https://doi.org/10.1007/978-981-15-6048-4_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-6047-7
Online ISBN: 978-981-15-6048-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)