Skip to main content
SpringerLink
Log in

Fast recognition system forTree images based on dual-task Gabor convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Aiming at the difficult problem of complex extraction for tree image in the existing complex background, we took tree species as the research object and proposed a fast recognition system solution for tree image based on Caffe platform and Dual-Task Gabor Convolutional Neural Network. In the research of deep learning algorithms based on Caffe framework, the improved Dual-Task CNN model (DCNN) is applied to train the image extractor and classifier to accomplish the dual tasks of image cleaning and tree classification. In addition, when compared with the traditional classification methods represented by Support Vector Machine (SVM) and Single-Task CNN model, Dual-Task CNN model demonstrates its superiority in classification performance. Then, for further improvement to the recognition accuracy for similar species, Gabor kernel was introduced to extract the features of frequency domain for images in different scales and directions, so as to enhance the texture features of leaf images and improve the recognition effect. The improved model was tested on the data sets of similar species. As demonstrated by the results, the improved deep Gabor Dual-Task convolutional neural network (GCNN) is advantageous in tree recognition and similar tree classification when compared with the order Dual-Task CNN classification method. Finally, the recognition results of trees can be displayed on the application graphical interface as well. Dual-Task Gabor CNN can be applied to mobile programs based on Ubantu, Android, IOS and other systems. The deep learning model used to identify tree species images can be deployed on the server side, and mobile devices can read and search for tree species images through network connections.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Acnet (2019) Attention based network to exploit complementary features for rgbd semantic segmentation. 2019 IEEE International Conference on Image Processing (ICIP). IEEE

  2. Angiosperm Phylogeny Group (2009) An update of the angiosperm phylogeny group classification for the orders and families of flowering plants: APG III. Bot J Linn Soc 161(2):105–121

    Article  Google Scholar 

  3. Bhattacharya R, Sabik A (n.d.) Fine-Tuning Caffe-Net for Pill Recognition

  4. Calderón A, Roa S, Victorino J (2003) Handwritten digit recognition using convolutional neural networks and gabor filters. Proc Int Congr Comput Intell

  5. Collobert R, Weston J (2008) A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th international conference on Machine learning, pp 160–167

  6. Cronquist A, and Takhtadzhian AL (1981) An integrated system of classification of flowering plants. Columbia University Press

  7. David E, Ungureanu P, Goras L (2006) On the feature extraction performances of CNN gabor-type filters in texture recognition applications. 2006 10th International Workshop on Cellular Neural Networks and Their Applications. IEEE, pp.1–6

  8. Dinuls R, Erins G, Lorencs A, Mednieks I, Sinica-Sinavskis J (2012) Tree species identification in mixed Baltic forest using LiDAR and multispectral data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5(2):594–603

    Article  Google Scholar 

  9. Du JX, Wang XF, Zhang GJ (2007) Leaf shape based plant species recognition. Appl Math Comput 185(2):883–893

    MATH  Google Scholar 

  10. Guo M, et al (2018) Dynamic task prioritization for multitask learning. Proceedings of the European Conference on Computer Vision (ECCV), pp.270–287

  11. Han S, Pool J, Tran J, Dally W (2015) Learning both weights and connections for efficient neural network. Advances in neural information processing systems, 28

  12. Hou T, Yao L, Qi J (2009) Research on plant identification based on leaf shape characteristics. Hunan Agricultural Sciences 39(4):123–125

    Google Scholar 

  13. Ii A (2003) An update of the angiosperm phylogeny group classification for the orders and families of flowering plants: APG II. Bot J Linn Soc 141(4):399–436

    Article  Google Scholar 

  14. Kang L, Ye P, Li Y, Doermann D (2015) Simultaneous estimation of image quality and distortion via multi-task convolutional neural networks. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 2791–2795

  15. Korpusik M, Glass J (2018) Convolutional neural networks and multitask strategies for semantic mapping of natural language input to a structured database. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp.6174–6178

  16. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25

  17. Lee SH, Chan CS, Wilkin P, Remagnino P (2015) Deep-plant: Plant identification with convolutional neural networks. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 452–456

  18. Chang L, Deng XM, Zhou MQ, Wu ZK, Yuan Y, Yang S, Wang HA (2016) Convolutional neural networks in image understanding. Acta Automatica Sinica 42(9):1300–1312

    MATH  Google Scholar 

  19. Lindenmayer DB, Margules CR, Botkin DB (2000) Indicators of biodiversity for ecologically sustainable forest management. Conserv Biol 14(4):941–950

    Article  Google Scholar 

  20. Liu J, Zhang S, Deng S (2009) A method of plant classification based on wavelet transforms and support vector machines. In: International Conference on Intelligent Computing. Springer, Berlin, Heidelberg, pp 253–260

  21. Liu W, Wang Z, Liu X, Zeng N, Liu Y, Alsaadi FE (2017) A survey of deep neural network architectures and their applications. Neurocomputing 234:11–26

    Article  Google Scholar 

  22. Liu X, Fang Z, Liu X, Zhang X, Gu J, Xu Q (2017) Driver fatigue detection using multitask cascaded convolutional networks. In: International Conference on Intelligence Science. Springer, Cham, pp 143–152

  23. Ning X, Li W, Liu W (2017) A fast single image haze removal method based on human retina property. IEICE Trans Inf Sys 100(1):211–214

    Article  Google Scholar 

  24. Ning X, Duan P, Li W, Zhang S (2020) Real-time 3D face alignment using an encoder-decoder network with an efficient deconvolution layer. IEEE Signal Proc Lett 27:1944–1948

    Article  Google Scholar 

  25. Panchapagesan S, Sun M, Khare A, Matsoukas S, Mandal A, Hoffmeister B, Vitaladevuni S (2016) Multi-task learning and weighted cross-entropy for DNN-based keyword spotting. In Interspeech 9:760–764

  26. Priya CA, Balasaravanan T, Thanamani AS (2012) An efficient leaf recognition algorithm for plant classification using support vector machine. In International conference on pattern recognition, informatics and medical engineering (PRIME-2012). IEEE, pp. 428–432

  27. Reyes AK, Caicedo JC, Camargo JE (2015) Fine-tuning deep convolutional networks for plant recognition. CLEF (Working Notes) 1391:467–475

    Google Scholar 

  28. Sarwar SS, Panda P, Roy K (2017) Gabor filter assisted energy efficient fast learning convolutional neural networks. In: 2017 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED). IEEE, pp 1–6

  29. Schmidhuber J (2015) Deep learning in neural networks: An overview. Neural Netw 61:85–117

    Article  Google Scholar 

  30. Sindagi VA, Patel VM (2017) Cnn-based cascaded multi-task learning of high-level prior and density estimation for crowd counting. In: 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–6

  31. Sladojevic S, Arsenovic M, Anderla A, Culibrk D, Stefanovic D (2016) Deep neural networks based recognition of plant diseases by leaf image classification. Computational intelligence and neuroscience, 2016

  32. Tyrväinen L, Pauleit S, Seeland K, Vries SD (2005) Benefits and uses of urban forests and trees. In: Urban forests and trees. Springer, Berlin, Heidelberg, pp 81–114

  33. Wu SG, Bao FS, Xu EY, Wang YX, Chang YF, Xiang QL (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. In: 2007 IEEE international symposium on signal processing and information technology. IEEE, pp 11–16

  34. John CP (1998) Sequential minimal optimization: a fast algorithm for training support vector machines. MSRTR: Microsoft Research 3(1):88–95

  35. Yang X, Chen A, Zhou G, Wang J, Chen W, Gao Y, Jiang R (2020) Instance segmentation and classification method for plant leaf images based on ISC-MRCNN and APS-DCCNN. IEEE Access 8:151555–151573

  36. Yao H, Chuyi L, Dan H, Weiyu Y (2016) Gabor feature based convolutional neural network for object recognition in natural scene. In: 2016 3rd International Conference on Information Science and Control Engineering (ICISCE). IEEE, pp 386–390

  37. Yu Z (2018) Urban garden planning and design and ornamental plant protection. J Landsc Res 10(4):159–162

    Google Scholar 

  38. Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision. Springer, Cham, pp 818–833

  39. Zhou H, Huang H, Yang X, Zhang L, Qi L (2017) Faster R-CNN for marine organism detection and recognition using data augmentation. In Proceedings of the International Conference on Video and Image Processing, pp 56–62

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation in China (Grant Nos. 61703441).

Author information

Authors and Affiliations

  1. College of Computer & Information Engineering, Central South University of Forestry andTechnology, Changsha, 410004, China

    Mingxuan Li, Guoxiong Zhou & Zongchen Li

Authors
  1. Mingxuan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guoxiong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zongchen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guoxiong Zhou.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, M., Zhou, G. & Li, Z. Fast recognition system forTree images based on dual-task Gabor convolutional neural network. Multimed Tools Appl 81, 28607–28631 (2022). https://doi.org/10.1007/s11042-022-12963-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12963-4

Keywords

Search

Navigation