Skip to main content
SpringerLink
Log in

Deep Learning Techniques in Leaf Image Segmentation and Leaf Species Classification: A Survey

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Plants have elemental importance for all life forms. The research areas in the field of plant sciences for botanists and agriculturists include the identification of plant species, classification of weeds from crops, detection of various diseases that hamper the growth of plant, and monitoring the growth and its semantic interpretation. Trained botanists can easily identify plant species based on the leaf shape, texture, structure or arrangement of leaves, however, the recent trend in smart agriculture demands the use of intelligent systems for the same task. Last decade has seen an enormous rise in the use of deep learning in the field of automatic plant species recognition based on the leaf images. In this work, we have surveyed various state-of-the-art deep learning techniques (Convolutional Neural Networks, Mask RCNN, Recurrent Neural Networks, Generative Adversarial Networks) that have been applied in the field of leaf image segmentation (separation of leaf from the whole image) and classification of leaves into various species. This contribution will help the new researchers in the field to get a foundation on the trends being employed in deep learning for generation of synthetic leaf images, segmentation and classification of leaves into various species. Various difficulties and future scope have also been presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data Availability

The datasets that have been studied by authors mentioned in the manuscript have been cited.

Code Availability

The code used to generate figures can be made available on request.

References

  1. Beikmohammadi, A., Faez, K., & Motallebi, A. (2022). SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN. Expert Systems with Applications, 202, 117470. https://doi.org/10.1016/j.eswa.2022.117470

    Article  Google Scholar 

  2. Bell, J., Dee, H. M. (2019). Leaf segmentation through the classification of edges.

  3. Bhagat, S., Kokare, M., Haswani, V., et al. (2022). Ecological Informatics Eff-UNet ++: A novel architecture for plant leaf segmentation and counting. Ecological Informatics, 68, 101583. https://doi.org/10.1016/j.ecoinf.2022.101583

    Article  Google Scholar 

  4. Cao, L., Li, H., Yu, H., et al. (2021). Plant leaf segmentation and phenotypic analysis based on fully convolutional neural network. Applied Engineering in Agriculture, 37, 929–940. https://doi.org/10.13031/AEA.14495

    Article  Google Scholar 

  5. Cao, L., Li, H., Yu, H., et al. (2021). Plant leaf segmentation and phenotypic analysis based on fully convolutional neural network. Applied Engineering in Agriculture, 37, 929–940. https://doi.org/10.13031/AEA.14495

    Article  Google Scholar 

  6. Carranza-Rojas, J., Gonzalez-Villanueva, R., Jimenez-Morales, K., et al. (2022). Extreme automatic plant identification under constrained resources. In CEUR workshop proceeding (vol. 3180, pp.2014–2024).

  7. Chen, D. H., Zhang, Z. W., Chang, T. R. (2019). Leaf segmentation and 3D reconstruction of ARAFIDOPSIS based on MASK R-CNN. In Proceedings–2019 8th international congress on advanced applied informatics IIAI-AAI (pp. 1073–1074). https://doi.org/10.1109/IIAI-AAI.2019.00232

  8. Dudi, B., & Rajesh, V. (2022). A computer aided plant leaf classification based on optimal feature selection and enhanced recurrent neural network. Journal of Experimental & Theoretical Artificial Intelligence, 35, 1–35. https://doi.org/10.1080/0952813X.2022.2046178

    Article  Google Scholar 

  9. Dudi, B., & Rajesh, V. (2022). Optimized threshold-based convolutional neural network for plant leaf classification: A challenge towards untrained data. Journal of Combinatorial Optimization, 43, 312–349. https://doi.org/10.1007/s10878-021-00770-w

    Article  MathSciNet  Google Scholar 

  10. Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2020). Towards weeds identification assistance through transfer learning. Computers and Electronics in Agriculture, 171, 105306. https://doi.org/10.1016/j.compag.2020.105306

    Article  Google Scholar 

  11. Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2021). Combining generative adversarial networks and agricultural transfer learning for weeds identification. Biosystems Engineering, 204, 79–89. https://doi.org/10.1016/j.biosystemseng.2021.01.014

    Article  CAS  Google Scholar 

  12. Fawakherji, M., Youssef, A., Bloisi, D., et al. (2019). Crop and weeds classification for precision agriculture using context-independent pixel-wise segmentation. In 2019 3rd IEEE international conference on robotic computing (pp. 146–152). https://doi.org/10.1109/IRC.2019.00029

  13. Giselsson, T. M., Jørgensen, R. N., Jensen, P. K., et al. (2017). A public image database for benchmark of plant seedling classification algorithms.

  14. Gogul, I., Kumar, V. S. (2017). Flower species recognition system using convolution neural networks and transfer learning. In 2017 4th international conference on signal processing, communication and networking (ICSCN) (pp. 1–6). https://doi.org/10.1109/ICSCN.2017.8085675

  15. Goodfellow, I., Pouget-Abadie, J., Mirza, M., et al. (2020). Generative adversarial networks. Communications of the ACM, 63, 139–144. https://doi.org/10.1145/3422622

    Article  Google Scholar 

  16. Guldenring, R., Boukas, E., Ravn, O., Nalpantidis, L. (2021). Few-leaf Learning: Weed segmentation in grasslands (pp. 3248–3254). https://doi.org/10.1109/iros51168.2021.9636770

  17. Habiba, S. U., Islam, M. K., Ahsan, S. M. M. (2019). Bangladeshi plant recognition using deep learning based leaf classification. In 5th International conference on computer, communication, chemical, materials and electronic engineering IC4ME2 2019 (pp. 11–12). https://doi.org/10.1109/IC4ME247184.2019.9036515

  18. He, K., Zhang, X., Ren, S., Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition.

  19. Heusel, M., Ramsauer, H., Unterthiner, T., et al. (2017). GANs trained by a two time-scale update rule converge to a local Nash equilibrium. Advances in neural information processing systems, 2017, 6627–6638.

    Google Scholar 

  20. Hu, J., Chen, Z., Yang, M., et al. (2018). A multiscale fusion convolutional neural network for plant leaf recognition. IEEE Signal Processing Letters, 25, 853–857. https://doi.org/10.1109/LSP.2018.2809688

    Article  Google Scholar 

  21. Hu, G., Yang, X., Zhang, Y., & Wan, M. (2019). Identification of tea leaf diseases by using an improved deep convolutional neural network. Sustainable Computing: Informatics and Systems, 24, 100353. https://doi.org/10.1016/j.suscom.2019.100353

    Article  Google Scholar 

  22. Jasitha, P., DIleep, M. R., DIvya, M. (2019). Venation based plant leaves classification using GoogLeNet and VGG. In 2019 4th IEEE international conference on recent trends on electronics, information, communication & technology RTEICT 2019–Proceeding (pp. 715–719). https://doi.org/10.1109/RTEICT46194.2019.9016966

  23. Kan, J., Gu, Z., Ma, C., Wang, Q. (2021). Leaf segmentation algorithm based on improved U-shaped network under complex background. In IMCEC 2021–IEEE 4th advanced information management, communicates, electronic and automation control conference 2021 (pp. 87–92). https://doi.org/10.1109/IMCEC51613.2021.9482382

  24. Kumar, V., Arora, H., Sisodia, J. (2020). ResNet-based approach for detection and classification of plant leaf diseases. In Proceedings international conference on electronics and sustainable communication systems ICESC 2020 (pp. 495–502). https://doi.org/10.1109/ICESC48915.2020.9155585

  25. Kumar, N., Belhumeur, P. N., Biswas, A., et al. (2012) Leafsnap: A Computer vision system for automatic plant species identification BT–computer vision. In ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part II (vol. 7573, pp. 502–516). https://doi.org/10.1007/978-3-642-33709-3_36

  26. Lecun, Y., Aurelio, M., Google, R. (2013). Deep learning tutorial. In ICML.

  27. Lee, S. H., Chan, C. S., Wilkin, P., et al. (2015). Deep-plant: Plant identification with convolutional neural networks (pp. 452–456). Kingston University.

    Google Scholar 

  28. Li, P., Gong, X., Hu, X., et al. (2019). Plant identification based on multi-branch convolutional neural network with attention. Communications in Computer and Information Science, 1043, 472–481. https://doi.org/10.1007/978-981-13-9917-6_45

    Article  Google Scholar 

  29. Li, Y., Wen, W., Miao, T., et al. (2022). Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Computers and Electronics in Agriculture, 193, 106702. https://doi.org/10.1016/j.compag.2022.106702

    Article  Google Scholar 

  30. Litjens, G., Sánchez, C. I., Timofeeva, N., et al. (2016). Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Science and Reports, 6, 1–11. https://doi.org/10.1038/srep26286

    Article  CAS  Google Scholar 

  31. Liu, B., Tan, C., Li, S., et al. (2020). A data augmentation method based on generative adversarial networks for grape leaf disease identification. IEEE Access, 8, 102188–102198. https://doi.org/10.1109/ACCESS.2020.2998839

    Article  Google Scholar 

  32. Madsen, S. L., Dyrmann, M., Jørgensen, R. N., & Karstoft, H. (2019). Generating artificial images of plant seedlings using generative adversarial networks. Biosystems Engineering, 187, 147–159. https://doi.org/10.1016/j.biosystemseng.2019.09.005

    Article  Google Scholar 

  33. Malik, O. A., Ismail, N., Hussein, B. R., & Yahya, U. (2022). Automated real-time identification of medicinal plants species in natural environment using deep learning models—a case study from borneo region. Plants, 11, 1952. https://doi.org/10.3390/plants11151952

    Article  PubMed  PubMed Central  Google Scholar 

  34. Morris, D. (2018). A pyramid CNN for dense-leaves segmentation. In Proceedings–2018 15th conference on computer and robot vision CRV 2018 (pp. 238–245). https://doi.org/10.1109/CRV.2018.00041

  35. Muneer, A., & Fati, S. M. (2020). Efficient and automated herbs classification approach based on shape and texture features using deep learning. IEEE Access, 8, 196747–196764. https://doi.org/10.1109/ACCESS.2020.3034033

    Article  Google Scholar 

  36. Ndikumana, E., Minh, D. H. T., Baghdadi, N., et al. (2018). Deep recurrent neural network for agricultural classification using multitemporal SAR Sentinel-1 for Camargue, France. Remote Sensing, 10, 1–16. https://doi.org/10.3390/rs10081217

    Article  Google Scholar 

  37. Ngugi, L. C., Abelwahab, M., & Abo-Zahhad, M. (2020). Tomato leaf segmentation algorithms for mobile phone applications using deep learning. Computers and Electronics in Agriculture, 178, 105788. https://doi.org/10.1016/j.compag.2020.105788

    Article  Google Scholar 

  38. Nikbakhsh, N., Baleghi, Y., & Agahi, H. (2021). A novel approach for unsupervised image segmentation fusion of plant leaves based on G-mutual information. Machine Vision and Applications, 32, 1–12. https://doi.org/10.1007/s00138-020-01130-0

    Article  Google Scholar 

  39. Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22, 1345–1359. https://doi.org/10.1109/TKDE.2009.191

    Article  Google Scholar 

  40. Praveen Kumar, J., & Dominic, S. (2020). Rosette plant segmentation with leaf count using orthogonal transform and deep convolutional neural network. Machine Vision and Applications, 31, 1–14. https://doi.org/10.1007/s00138-019-01056-2

    Article  Google Scholar 

  41. Praveen Kumar, J., & Domnic, S. (2019). Image based leaf segmentation and counting in rosette plants. Information Processing in Agriculture, 6, 233–246. https://doi.org/10.1016/j.inpa.2018.09.005

    Article  Google Scholar 

  42. Purbaya, M. E., Setiawan, N. A., Adji, T. B. (2018). Leaves image synthesis using generative adversarial networks with regularization improvement. In 2018 International conference on information and communications technology ICOIACT 2018-Janua (pp. 360–365). https://doi.org/10.1109/ICOIACT.2018.8350780

  43. Sachar, S., & Kumar, A. (2021). Survey of feature extraction and classification techniques to identify plant through leaves. Expert Systems with Applications, 167, 114181.

  44. Shi, W., van de Zedde, R., Jiang, H., & Kootstra, G. (2019). Plant-part segmentation using deep learning and multi-view vision. Biosystems Engineering, 187, 81–95. https://doi.org/10.1016/j.biosystemseng.2019.08.014

    Article  Google Scholar 

  45. Söderkvist, O. J. O. (2001). Computer vision classification of leaves from swedish trees (pp. 74).

  46. Sun, J., Zhao, J., Ding, Z. (2021). ULeaf-Net: Leaf segmentation network based on U-shaped symmetric encoder-decoder architecture (pp. 109–113). https://doi.org/10.1109/iscsic54682.2021.00030

  47. Tan, J. W., Chang, S. W., Abdul-Kareem, S., et al. (2020). Deep learning for plant species classification using leaf vein morphometric. IEEE/ACM Trans Comput Biol Bioinforma, 17, 82–90. https://doi.org/10.1109/TCBB.2018.2848653

    Article  Google Scholar 

  48. Tavakoli, H., Alirezazadeh, P., Hedayatipour, A., et al. (2021). Leaf image-based classification of some common bean cultivars using discriminative convolutional neural networks. Computers and Electronics in Agriculture, 181, 105935. https://doi.org/10.1016/j.compag.2020.105935

    Article  Google Scholar 

  49. Triki, A., Bouaziz, B., Gaikwad, J., & Mahdi, W. (2021). Deep eaf: Mask R-CNN based leaf detection and segmentation from digitized herbarium specimen images. Pattern Recognition Letters, 150, 76–83. https://doi.org/10.1016/j.patrec.2021.07.003

    Article  Google Scholar 

  50. Trivedi, M., & Gupta, A. (2021). Automatic monitoring of the growth of plants using deep learning-based leaf segmentation. International Journal of Applied Science and Engineering, 18, 1–9. https://doi.org/10.6703/IJASE.202106_18(2).003

    Article  Google Scholar 

  51. Wäldchen, J., & Mäder, P. (2018). Plant species identification using computer vision techniques: A systematic literature review. Archives of Computational Methods in Engineering, 25, 507–543. https://doi.org/10.1007/s11831-016-9206-z

    Article  MathSciNet  PubMed  Google Scholar 

  52. Wang, B., & Wang, D. (2019). Plant leaves classification: A few-shot learning method based on siamese network. IEEE Access, 7, 151754–151763. https://doi.org/10.1109/ACCESS.2019.2947510

    Article  Google Scholar 

  53. Ward, D., Moghadam, P., Hudson, N. (2019). Deep leaf segmentation using synthetic data.

  54. Weyler, J., Magistri, F., Seitz, P., et al. (2022). In-field phenotyping based on crop leaf and plant instance segmentation (pp. 2725–2734).

  55. Wu, S. G., Bao, F. S., Xu, E. Y., et al. (2007). A leaf recognition algorithm for plant classification using probabilistic neural network. In ISSPIT 2007–IEEE international symposium on signal processing and information technology (pp. 11–16). https://doi.org/10.1109/ISSPIT.2007.4458016

  56. Wu, Q., Chen, Y., & Meng, J. (2020). Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access, 8, 98716–98728. https://doi.org/10.1109/ACCESS.2020.2997001

    Article  Google Scholar 

  57. Xiong, J., Yu, D., Liu, S., et al. (2021). A review of plant phenotypic image recognition technology based on deep learning. Electron, 10, 1–19. https://doi.org/10.3390/electronics10010081

    Article  Google Scholar 

  58. Xu, L., Li, Y., Sun, Y., et al. (2018). Leaf instance segmentation and counting based on deep object detection and segmentation networks. In 2018 Joint 10th international conference on soft computing and intelligent systems (SCIS) and 19th international symposium on advanced intelligent systems SCIS-ISIS (pp. 180–185). https://doi.org/10.1109/SCIS-ISIS.2018.00038

  59. Yang, K., Zhong, W., & Li, F. (2020). Leaf segmentation and classification with a complicated background using deep learning. Agronomy, 10, 1721. https://doi.org/10.3390/agronomy10111721

    Article  Google Scholar 

  60. Zhu, Y., Aoun, M., Krijn, M., & Vanschoren, J. (2018). Data augmentation using conditional generative adversarial networks for leaf counting in arabidopsis plants. BMVC, 2018, 121–125.

    Google Scholar 

  61. Zhu, W., Xie, L., Han, J., & Guo, X. (2020). The application of deep learning in cancer prognosis prediction. Cancers (Basel), 12, 1–19. https://doi.org/10.3390/cancers12030603

    Article  CAS  Google Scholar 

Download references

Funding

The authors declare that no funds or grants were received during the preparation of the manuscript.

Author information

Authors and Affiliations

  1. Department of Computer Science and Applications, Punjab University, Chandigarh, 160014, India

    Anuj Kumar & Silky Sachar

Authors
  1. Anuj Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Silky Sachar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All the authors contributed to the conception and design of the manuscript. The data collection, material preparation and analysis were performed by Anuj Kumar and Silky Sachar. The first draft was prepared was prepared by Silky Sachar and reviewed and edited by Anuj Kumar.

Corresponding author

Correspondence to Silky Sachar.

Ethics declarations

Conflict of interest

The authors have no conflict of interest to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, A., Sachar, S. Deep Learning Techniques in Leaf Image Segmentation and Leaf Species Classification: A Survey. Wireless Pers Commun 133, 2379–2410 (2023). https://doi.org/10.1007/s11277-024-10873-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-024-10873-2

Keywords

Search

Navigation