Abstract
Agriculture is progressively getting access to scientific and technological breakthroughs in the digital era. In order to achieve smart agriculture, huge farms must be monitored and managed using advanced technologies. Anticipating and grading ripe fruit at harvest may aid in lowering storage costs and capturing market demand. Monitoring the ripening phase of the fruit also helps in the management of input and output criteria, which has practical implications in the harvesting process such as calculating the proper amount of water and nutrients at the end of the harvest, reducing traditional labor force, resulting in financial and human resource savings. In this research, we present a technique for identifying and classifying the ripening stage of mangosteen in agricultural fields. The study employs a two-stage approach based on a Faster R-CNN, a deep neural network which uses Region Proposal Network to extract the image region containing the item for the classification and identification of the mangosteen’s location, and an improved RoI (Region of Interest) Pooling algorithm by adding a RoI Align layer to optimize feature data during training. We enhanced both of the speed and accuracy while processing huge and complicated data sets using the suggested methodology. When employing a dataset of 10,000 photos of ripe mangosteen, our model outperforms the one-stage approach in terms of accuracy while maintaining real-time speed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. Int. J. Comput. Vis. 104, 154–171 (2013). https://doi.org/10.1007/s11263-013-0620-5
Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 1440–1448 (2015)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN towards real-time object detection with region proposal networks. In: Proceedings of the IEEE International Conference on Computer Vision, Santiago, pp. 1440–1448 (2016)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once unified, real-time object detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, pp. 779–788 (2016). https://doi.org/10.48550/arXiv.1506.02640
Song, Y., Glasbey, C.A., Horgan, G.W., Polder, G., Dieleman, J.A., Heijden, G.V.D.: Tomatic fruit recognition and counting from multiple images. Biosyst. Eng. 118, 203–215 (2014). https://doi.org/10.1016/j.biosystemseng.2013.12.008
Sa, I., Ge, Z.Y., Dayoub, F., Upcroft, B., Perez, T., McCool, C.: Deep fruits: a fruit detection system using deep neural networks. Sensors 16, 1222, 1–23 (2016). Autonomous Sweet Pepper Harvester Project. https://doi.org/10.3390/s16081222
Kim, B., Han, Y.K., Park, J.H., Lee, J.: Improved vision-based detection of strawberry diseases using a deep neural network. Front. Plant Sci. 11, 559172 (2021). https://doi.org/10.3389/fpls.2020.559172
Rojas-Aranda, J.L., Nunez-Varela, J.I., Cuevas-Tello, J.C., Rangel-Ramirez, G.: Fruit classification for retail stores using deep learning. In: Figueroa Mora, K.M., Anzurez Marín, J., Cerda, J., Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Olvera-López, J.A. (eds.) MCPR 2020. LNCS, vol. 12088, pp. 3–13. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49076-8_1
Cao, C., Wang, B., Zhang, W.: An improved faster R-CNN for small object detection (2019). INSPEC accession number: 18897667. Electronic ISSN: 2169-3536. https://doi.org/10.1109/ACCESS.2019.2932731
Tang, Y., Chen, M., Wang, C., Luo, L., Li, J., Lian, G., et al.: Recognition and localization methods for vision-based fruit picking robots: a review. Front. Plant Sci. 11, 510 (2020). https://doi.org/10.3389/fpls.2020.00510
Muresan, H., Oltean, M.: Fruit recognition from images using deep learning. Acta Univ. Sapientiae Inform. 10, 26–42 (2018). https://doi.org/10.2478/ausi-2018-0002
Rajeshwari, P., Abhishek, P., Srikanth, P., Vinod, T.: Object detection: an overview. Int. J. Trend Sci. Res. Dev. (IJTSRD) 3, 1663–1665 (2019)
Zhang, Y., Sohn, K., Villegas, R., Pan, G., Lee, H.: Improving object detection with deep convolutional networks via Bayesian optimization and structured prediction. In: Computer Vision and Pattern Recognition (2016). arXiv:1504.03293 [cs.CV]
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Computer Vision and Pattern Recognition, pp. 1–14 (2015). arXiv:1409.1556v6
Erhan, D., Szegedy, Ch., Toshev, A., Anguelov, D.: Scalable object detection using deep neural networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2147–2154 (2014)
Lu, Y., Javidi, T., Lazebnik, S.: Adaptive object detection using adjacency and zoom prediction. In: Computer Vision and Pattern Recognition (2016). arXiv:1512.07711 [cs.CV]
Zhao, Z.Q., Zheng, P., Xu, S., Wu, X.: Object detection with deep learning: a review. IEEE Trans. Neural Netw. Learn. Syst. Publ. (2019). arXiv:1807.05511 [cs.CV]
Munera, S., Amigo, L.M., Blasco, J., Cubero, S., Talens, P., Alexios, N.: Ripeness monitoring of two cultivars of nectarine using VIS-NIR hyperspectral reflectance imaging. J. Food Eng. 214(3), 29–39 (2017)
Kim, S., Ji, Y., Lee, K.: An effective sign language learning with object detection based ROI segmentation. In: Second IEEE International Conference on Robotic Computing (IRC), Laguna Hills, CA, pp. 330–333 (2018)
Nguyen, H.H.C., Nguyen, D.H., Nguyen, V.L., Nguyen, T.T.: Smart solution to detect images in limited visibility conditions based convolutional neural networks. In: Hernes, M., Wojtkiewicz, K., Szczerbicki, E. (eds.) ICCCI 2020. CCIS, vol. 1287, pp. 641–650. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63119-2_52
Nguyen, H.H.C., Luong, A.T., Trinh, T.H., Ho, P.H., Meesad, P., Nguyen, T.T.: Intelligent fruit recognition system using deep learning. In: Meesad, P., Sodsee, D.S., Jitsakul, W., Tangwannawit, S. (eds.) IC2IT 2021. LNNS, vol. 251, pp. 13–22. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-79757-7_2
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Trinh, T.H., Bui, X.T., Tran, T.H., Nguyen, H.H.C., Ninh, K.D. (2022). Mangosteen Fruit Detection Using Improved Faster R-CNN. In: Nguyen, NT., Dao, NN., Pham, QD., Le, H.A. (eds) Intelligence of Things: Technologies and Applications . ICIT 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 148. Springer, Cham. https://doi.org/10.1007/978-3-031-15063-0_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-15063-0_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15062-3
Online ISBN: 978-3-031-15063-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)