Abstract
Aiming at the problems of poor image quality, susceptibility to interference from the external environment and difficulties in recognition due to high similarity between real defects and fruit stalks in citrus surface defect recognition, we proposed a citrus surface defect recognition method based on a combination of PCSA-2D-Otsu and CGWO-DT-SVM. Firstly, a partial differential equations (PDE) based variational model is used to denoise the captured citrus images, which reduces the blurring of the images while retaining the edge details and important texture information. Then, a 2D-Otsu threshold segmentation algorithm optimized by the plant cell swarm algorithm (PCSA) is used to segment the citrus surface defects and extract the image features to separate the citrus from the background, making full use of the relevant information and reducing the influence of complex backgrounds. Finally, the images are input to the chaos gray wolf optimizer (CGWO) algorithm optimized DT-SVM classifier for true defects and fruit stalks to identify the citrus into healthy and defective classes. We selected 2000 collected citrus images for the experiments and the application results showed an overall recognition accuracy of 96.71%. To verify the feasibility and effectiveness of the proposed model, we compared it with advanced deep learning methods and machine learning methods, among others. The experimental results show that the method is more accurate and less time consuming for the recognition of citrus surface defects, and can be effective for the recognition of citrus surface defects. It provides a solution and reference for the application of machine vision methods in the accurate and rapid diagnosis of fruit surface defects.
Similar content being viewed by others
References
Jianrong C, Jiewen Z (2005) Recognition of mature fruit in natural scene using computer vision[J]. Trans CSAM 36(2):61–64
Blasco J, Aleixos N, Gómez J et al (2007) Citrus sorting by identification of the most common defects using multispectral computer vision[J]. J Food Eng 83(3):384–393. https://doi.org/10.1016/j.jfoodeng.2007.03.027
Cubero S, Lee WS, Aleixos N et al (2016) Automated systems based on machine vision for inspecting citrus fruits from the field to postharvest—a review[J]. Food Bioprocess Technol 9(10):1623–1639. https://doi.org/10.1007/s11947-016-1767-1
Li J, Rao X, Wang F et al (2013) Automatic detection of common surface defects on oranges using combined lighting transform and image ratio methods[J]. Postharvest Biol Technol 82:59–69. https://doi.org/10.1016/j.postharvbio.2013.02.016
Khoje SA, Bodhe SK, Adsul A (2013) Automated skin defect identification system for fruit grading based on discrete curvelet transform[J]. Int J Eng Technol 5(4):3251–3256. https://doi.org/10.1016/j.postharvbio.2013.02.016
Lu J, Wu P, Xue J et al (2015) Detecting defects on citrus surface based on circularity threshold segmentation[C]//2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD). IEEE:1543–1547. https://doi.org/10.1109/FSKD.2015.7382174
Huang W, Li J, Wang Q et al (2015) Development of a multispectral imaging system for online detection of bruises on apples[J]. J Food Eng 146:62–71. https://doi.org/10.1016/j.jfoodeng.2014.09.002
Zhang B, Huang W, Gong L et al (2015) Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier[J]. J Food Eng 146:143–151. https://doi.org/10.1016/j.jfoodeng.2014.08.024
Ravi T, Ambalavanan S (2016) Image Analysis for Efficient Surface Defect Detection of Orange Fruits[J]. Proc 3rd Int Conf Adv Comput Network Inform https://doi.org/10.1007/978-81-322-2538-6_17
Thendral R, Suhasini A (2017) Automated skin defect identification system for orange fruit grading based on genetic algorithm[J]. Curr Sci:1704-1711.
Chithra P L, Henila M (2017). Defect identification in the fruit apple using k-means color image segmentation algorithm[J]. Int J Adv Res Comput Sci 8(8). https://doi.org/10.26483/ijarcs.v8i8.4735
Tan A, Zhou G, He M (2021) Surface defect identification of Citrus based on KF-2D-Renyi and ABC-SVM[J]. Multimed Tools Appl 80(6):9109–9136. https://doi.org/10.1007/s11042-020-10036-y
Azizah LM, Umayah S F, Riyadi S, et al. (2017) Deep learning implementation using convolutional neural network in mangosteen surface defect detection[C]//2017 7th IEEE international conference on control system, computing and engineering (ICCSCE). IEEE:242-246. https://doi.org/10.1109/ICCSCE.2017.8284412
Wu A, Zhu J, Ren T (2020) Detection of apple defect using laser-induced light backscattering imaging and convolutional neural network[J]. Comput Electric Eng 81:106454. https://doi.org/10.1016/j.compeleceng.2019.106454
Kukreja V, Dhiman P (2020) A Deep Neural Network based disease detection scheme for Citrus fruits[C]//2020 International Conference on Smart Electronics and Communication (ICOSEC). IEEE:97-101. https://doi.org/10.1109/ICOSEC49089.2020.9215359
Wang C, Xiao Z (2021) Lychee surface defect detection based on deep convolutional neural networks with GAN-based data augmentation[J]. Agronomy 11(8):1500. https://doi.org/10.3390/agronomy11081500
Liu P, Yu H, Cang S (2019) Adaptive neural network tracking control for underactuated systems with matched and mismatched disturbances[J]. Nonlinear Dynamics 98(2):1447–1464. https://doi.org/10.1007/s11071-019-05170-8
Bhargava A, Bansal A (2020) Automatic detection and grading of multiple fruits by machine learning[J]. Food Anal Methods 13(3):751–761. https://doi.org/10.1007/s12161-019-01690-6
Aubert G, Aujol JF (2008) A variational approach to removing multiplicative noise[J]. SIAM J Appl Math 68(4):925–946. https://doi.org/10.1137/060671814
Shen J, Chan TF (2002) Mathematical models for local nontexture inpaintings[J]. SIAM J Appl Math 62(3):1019–1043. https://doi.org/10.1137/S0036139900368844
Al-Amri SS, Kalyankar NV (2010) Image segmentation by using threshold techniques[J]. arXiv preprint arXiv:1005.4020
Rezaei H, Bozorg-Haddad O, Chu X (2018) Grey wolf optimization (GWO) algorithm[M]//Advanced Optimization by Nature-Inspired Algorithms. Springer, Singapore, pp 81–91 https://doi.org/10.1007/978-981-10-5221-7_9
Abdellah H, Ahmed R, Slimane O (2014) Defect detection and identification in textile fabric by SVM method[J]. IOSR J Eng 4(12):69–77
Sivakami K, Saraswathi N (2015) Mining big data: breast cancer prediction using DT-SVM hybrid model[J]. Int J Scientific Eng Appl Sci (IJSEAS) 1(5):418–429
Alom M Z, Taha T M, Yakopcic C, et al. (2018) The history began from alexnet: A comprehensive survey on deep learning approaches[J]. arXiv preprint arXiv:1803.01164
Sengupta A, Ye Y, Wang R et al (2019) Going deeper in spiking neural networks: VGG and residual architectures[J]. Front Neurosci 13:95. https://doi.org/10.3389/fnins.2019.00095
Ballester P, Araujo RM (2016) On the performance of GoogLeNet and AlexNet applied to sketches[C]//Thirtieth AAAI Conference on Artificial Intelligence
Targ S, Almeida D, Lyman K (2016) Resnet in resnet: Generalizing residual architectures[J]. arXiv preprint arXiv:1603.08029
Huang G, Liu Z, Van Der Maaten L, et al. (2017) Densely connected convolutional networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition: 4700-4708
Huang CL, Dun JF (2008) A distributed PSO–SVM hybrid system with feature selection and parameter optimization[J]. Appl Soft Comput 8(4):1381–1391. https://doi.org/10.1016/j.asoc.2007.10.007
Alshamlan HM, Badr GH, Alohali YA (2016) Abc-svm: artificial bee colony and svm method for microarray gene selection and multi class cancer classification[J]. Int J Mach Learn Comput 6(3):184. https://doi.org/10.18178/ijmlc.2016.6.3.596
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The authors declare the following financial interests/personal relationships which may be considered as potential competing interests
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cai, C., Zhou, G. & Lu, C. Citrus surface defect identification based on PCS-2D-Otsu and CGWO-DT-SVM. Multimed Tools Appl 83, 43649–43672 (2024). https://doi.org/10.1007/s11042-023-17341-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17341-2