Document Type : Technical Paper

Authors

1 Department of Computer Engineering, University of Mazandaran, Babolsar, Iran

2 Department of Biomedical Engineering, Hakim Sabzevari University, Sabzevar, Iran

3 Department of Electrical Engineering, Shahrood University of Technology, Shahrood, Iran

4 Department of Marine Biology, University of Mazandaran, Babolsar, Iran

Abstract

Improving the quality of food industries and the safety and health of the people’s nutrition system is one of the important goals of governments. Fish is an excellent source of protein. Freshness is one of the most important quality criteria for fish that should be selected for consumption. It has been shown that due to improper storage conditions of fish, bacteria, and toxins may cause diseases for human health. The conventional methods of detecting spoilage and disease in fish, i.e. analyzing fish samples in the laboratory, are laborious and time-consuming. In this paper, an automatic method for identifying spoiled fish from fresh fish is proposed. In the proposed method, images of fish eyes are used. Fresh fish are identified by shiny eyes, and poor and stale fish are identified by gray color changes in the eye. In the proposed method, Inception-ResNet-v2 convolutional neural network is used to extract features. To increase the accuracy of the model and prevent overfitting, only some useful features are selected using the mRMR feature selection method. The mRMR reduces the dimensionality of the data and improves the classification accuracy. Then, since the number of samples is low, the k-fold cross-validation method is used. Finally, for classifying the samples, Naïve bayes and Random forest classifiers are used. The proposed method has reached an accuracy of 97% on the fish eye dataset, which is better than previous references.

Keywords

Main Subjects

[1] I. C. Navotas, C. N. V. Santos, E. J. M. Balderrama, F. E. B. Candido, A. J. E. Villacanas, and J. S. Velasco, “Fish identification and freshness classification through image processing using artificial neural network”, ARPN Journal of engineering and Applied Sciences, vol. 13, no. 18, pp. 4912-4922, 2018.
 
[2] A. Carballo-Casla, E. García-Esquinas, J. R.,Banegas, F. Rodríguez-Artalejo, and R. Ortolá, “Fish consumption, omega-3 fatty acid intake, and risk of pain: the Seniors-ENRICA-1 cohort”, Clinical Nutrition, vol. 41, no. 11, pp. 2587-2595, 2022.
 
[3] D. Karageorgou, U. Rova, P. Christakopoulos, P. Katapodis, L. Matsakas, and A. Patel, “Benefits of supplementation with microbial omega-3 fatty acids on human health and the current market scenario for fish-free omega-3 fatty acid”, Trends in Food Science & Technology, 2023.
 
[4] P. C. Pastoral, S. Escobar Jr, and N.J. Lamarca, “Round scad exploration by purse seine in the South China Sea, Area III: Western Philippines”, In Proceedings of the Third Technical Seminar on Marine Fishery Resources Survey in the South China Sea, Area III: Western Philippines, Secretariat, Southeast Asian Fisheries Development Center, pp. 49-64, 2000.
 
[5] A. Banwari, R. C. Joshi, N. Sengar, and M.K. Dutta, “Computer vision technique for freshness estimation from segmented eye of fish image”, Ecological Informatics, 69, 101602, 2022.
 
[6] U. Murdika, M. A. F. Sradeva, S.R. Sulistiyanti, H. Fitriawan, A. U. Drajart, and L., Hakim, “ Detection of The Freshness Level of Goldfish Through Eye Objects Using Fuzzy Logic Method Based on Image Processing”, International Conference on Converging Technology in Electrical and Information Engineering (ICCTEIE), pp. 12-15, 2023.
 
[7] I. Akgül, V. Kaya, and O. Zencir Tanır , “A novel hybrid system for automatic detection of fish quality from eye and gill color characteristics using transfer learning technique”,  Plos one, vol. 18, no. 4, e0284804, 2023.
 
[8] R. Saeed, H. Feng, X. Wang, X. Zhang and Z. Fu, “Fish quality evaluation by sensor and machine learning: A mechanistic review”, Food Control, vol. 137, 108902, 2022.
 
[9] D. Li, Q. Wang, X. Li, M. Niu, H. Wang and C. Liu, “Recent advances of machine vision technology in fish classification”, ICES Journal of Marine Science, vol. 79, no. 2, pp. 263-284, 2022.
 
[10] X. Xu, W. Li and Q. Duan, “Transfer learning and SE-ResNet152 networks-based for small-scale unbalanced fish species identification”, Computers and Electronics in Agriculture, vol. 180, 105878, 2021.
 
[11] M. Nasrolahzadeh, Z. Mohammadpoory and J. Haddadnia, “Higher-order spectral analysis of spontaneous speech signals in Alzheimer’s disease”, Cognitive neurodynamics, vol. 12, pp. 583-596, 2018.
 
[12] M.H. Hassoun, “Fundamentals of artificial neural networks”, MIT press, 1995.
 
[13] S. Wold, K. Esbensen, and P. Geladi, “Principal component analysis”, Chemometrics and intelligent laboratory systems, vol. 2, no. 3, pp. 37-52, 1987.
 
[14] A. Banan, A. Nasiri, and A. Taheri-Garavand, “Deep learning-based appearance features extraction for automated carp species identification”, Aquacultural Engineering, vol. 89, 102053, 2020.
 
[15] A. Nasiri, A. Taheri-Garavand and Y.D. Zhang, “Image-based deep learning automated sorting of date fruit”, Postharvest biology and technology, vol. 153, pp. 133-141, 2019.
 
[16] M. Nasrolahzadeh, Z. Mohammadpoory and J. Haddadnia, “A novel method for distinction heart rate variability during meditation using LSTM recurrent neural networks based on visibility graph”, Biomedical Signal Processing and Control, vol. 90, 105822, 2024.
 
[17] T. Murakoshi, T. Masuda, K. Utsumi, K., Tsubota, and Y. Wada, “Glossiness and perishable food quality: visual freshness judgment of fish eyes based on luminance distribution”, PLoS One, vol. 8, no. 3, e58994, 2013.
 
[18] A. Issac, M.K. Dutta and B. Sarkar, “Computer vision based method for quality and freshness check for fish from segmented gills”, Computers and Electronics in Agriculture, vol. 139, pp. 10-21, 2017.
 
[19] H. M. Lalabadi, M. Sadeghi, and S.A. Mireei, “Fish freshness categorization from eyes and gills color features using multi-class artificial neural network and support vector machines”, Aquacultural Engineering, vol. 90, 102076, 2020.
 
[20] R. Jarmin, L.Y. Khuan, H. Hashim and N. H. A. Rahman, “A comparison on fish freshness determination method”, In 2012 International Conference on System Engineering and Technology (ICSET), pp. 1-6, 2012.
 
[21] L. K. S. Tolentino, J. W. F. Orillo, P. D. Aguacito, E. J. M. Colango, J. R. H. Malit, J. T. G. Marcelino, and A. J. D. Odeza, “Fish freshness determination through support vector machine”, Journal of Telecommunication, Electronic and Computer Engineering (JTEC), vol.  9, no 2-5, pp. 139-143, 2017.
 
[22] E. Prasetyo, R. Purbaningtyas, and R. D. Adityo, “Cosine K-Nearest Neighbor in Milkfish Eye Classification”, International Journal of Intelligent Engineering & Systems, vol. 13, no. 3, 2020.
 
[23] C. Cengizler, “Fish Spoilage Classification Based on Color Distribution Analysis of Eye Images”, Marine Science and Technology Bulletin, vol. 12, no. 1, pp. 63-69, 2023.
 
[24] A. Taheri-Garavand, A. Nasiri, A. Banan and Y.D. Zhang, “Smart deep learning-based approach for non-destructive freshness diagnosis of common carp fish”, Journal of Food Engineering, vol. 278, 109930, 2020.
 
[25] E. Prasetyo,  R. Purbaningtyas, R.D. Adityo, N. Suciati, and C. Fatichah, “Combining MobileNetV1 and Depthwise Separable convolution bottleneck with Expansion for classifying the freshness of fish eyes”, Information Processing in Agriculture, vol. 9, no. 4, pp. 485-496, 2022.
 
[26] M. G. Lanjewar and K. G. Panchbhai, “Enhancing Fish Freshness Prediction using NasNet-LSTM”, Journal of Food Composition and Analysis, 105945, 2023.
 
[27] C. Szegedy, S. Ioffe, V. Vanhoucke, and A. Alemi, “Inception-v4, inception-resnet and the impact of residual connections on learning”, In Proceedings of the AAAI conference on artificial intelligence, Vol. 31, No. 1, 2017.
 
[28] S. Maji and S. Bose, “CBIR using features derived by deep learning”, ACM/IMS Transactions on Data Science (TDS), vol. 2, no. 3, pp. 1-24, 2021.
 
[29] H. Peng, F. Long, and C. Ding, “Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy”, IEEE Transactions on pattern analysis and machine intelligence, vol. 27, no. 8, pp. 1226-1238, 2005.
 
[30] M. Nasrolahzadeh, S. Rahnamayan, and J. Haddadnia, “Alzheimer’s disease diagnosis using genetic programming based on higher order spectra features”, Machine Learning with Applications, vol. 7, 100225, 2022.
 
[31] Z. Mohammadpoory, M. Nasrolahzadeh, and S. A. Amiri, “Classification of healthy and epileptic seizure EEG signals based on different visibility graph algorithms and EEG time series”, Multimedia Tools and Applications, vol. 83, no.1, pp. 2703-2724, 2024. 
 
[32] A. Agustyawan, “Fresh and not fresh fish dataset”, Retrieved on January 29, 2023, from https://www.kaggle.com/datasets/arifagustyawan/fresh-and-not-fresh-fish-dataset.
 
[33] S. Asadi Amiri, Z. Mohammadpoory, and M. Nasrolahzadeh, “A Novel Content-based Image Retrieval System using Fusing Color and Texture Features”, Journal of AI and Data Mining, vol. 10, no. 4, pp. 559-568, 2022.
 
[34] P. Refaeilzadeh, L. Tang, and H. Liu, “Cross-validation”, Encyclopedia of database systems, pp. 532-538, 2009.