Skip to main content
Log in

Volumetric estimation using 3D reconstruction method for grading of fruits

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Grading of the fruits is one of the important post harvest tasks that the fruit processing agro-industries do. Although the internal quality of the fruit is important, the external quality of the fruit influences the consumers and the market price significantly. External quality of the fruit is based on the features such as color, maturity, shape, texture and size of the fruit. Apart from being expensive and time consuming, the manual grading process may face challenges such as subjectivity in grading, inconsistency and non-availability of the experts during peak seasons. On the other hand, computer vision based fruit grading systems using 2D techniques do not consider self occluding surface of the fruit and fail to determine the percentage of the matured region accurately. The grading systems which approximate the shape of the fruit to a known geometrical shape fail to compute the volume of the fruits with arbitrary shapes accurately. This paper presents a nondestructive and accurate fruit grading system based on the volume and maturity feature implemented using Fuzzy Rule Based Classifier (FRBC). The system estimates the volume of the fruit using volumetric 3D reconstruction method in multiple-camera environment and computes the percentage of the matured region of the fruit with high accuracy. The experimental results show that the accuracy of the proposed grading system in volume estimation and fruit grading is 98.5%. The ability of the proposed 3D reconstruction method to reconstruct the fruits with arbitrary shapes makes the grading system more robust and dynamic.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abdullah MZ, Guan LC, Mohamed A, Noor MA (2002) Color vision system for ripeness inspection of oil palm elaeis guineensis. J Food Process Preserv 26(3):213–235

    Article  Google Scholar 

  2. Abdullah MZ, Mohamad-Saleh J et al (2006) Discrimination and classification of fresh-cut starfruits (averrhoa carambola L.) using automated machine vision system. J Food Eng 76(4):506–523

    Article  Google Scholar 

  3. Bao Y et al (2013) Dense object reconstruction with semantic priors. Proc. of IEEE Conf on computer vision and. Pattern Recogn:1264–1271

  4. Blasco J, Aleixos N, Gómez-Sanchis J, Moltó E (2009) Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosyst Eng 103(2):137–145

    Article  Google Scholar 

  5. Bouguet JY (2006) Camera Calibration Toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc. Accessed 21 Feb 2013

  6. Chen Y et al (2008) Nonlocal prior Bayesian tomographic reconstruction. J Math Imaging Vis 30(2):133–146

    Article  Google Scholar 

  7. Forbes KA, Tattersfield GM (1999) Volumetric determination of apples using machine vision techniques. Elektron J South African Inst Elect Eng 16(3):14–17

    Google Scholar 

  8. Gallo A, Muzzupappa M, Bruno F (2014) 3D reconstruction of small sized objects from a sequence of multi-focused images. J Cult Herit 2:173–182

    Article  Google Scholar 

  9. Garrido-Novell C, Pérez-Marin D, Amigo JM et al (2012) Grading and color evolution of apples using RGB and hyper spectral imaging vision cameras. J Food Eng 113(2):281–288

    Article  Google Scholar 

  10. Gejima Y, Zhang H, Nagata M (2003) Judgment on level of maturity for tomato quality using L* a* b* color image processing. Proc IEEE/ASME Int Conf Advanced Intell Mechatron 2:1355–1359

    Google Scholar 

  11. Goel N, Sehgal P (2015) Fuzzy classification of pre-harvest tomatoes for ripeness estimation–an approach based on automatic rule learning using decision tree. Appl Soft Comput 36:45–56

    Article  Google Scholar 

  12. Hartley R et al (2003) Multiple-view geometry in computer vision, 2nd edn. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  13. Imou K, Kaizu Y, Morita M, Yokoyama S (2006) Three-dimensional shape measurement of strawberries by volume intersection method. Trans ASABE 49(2):449–456

    Article  Google Scholar 

  14. Iqbal SM, Gopal A, Sarma AS (2005) Volume estimation of apple fruits using image processing. Proc of IEEE Int Conf on Image Inf Process, India, p 1–6

  15. Jadhav T, Singh K, Abhyankar A (2017) A review and comparison of multi-view 3D reconstruction methods. J Eng Res 5(3):50–72

    Google Scholar 

  16. Jadhav T et al (2018) Volumetric 3D reconstruction of real objects using voxel mapping approach in multiple-camera environment. Turk J Elec Eng Comp Sci 26:755–767

    Article  Google Scholar 

  17. Jiménez AR, Ceres R, Pons JL (2000) A vision system based on a laser range-finder applied to robotic fruit harvesting. Mach Vis Appl 11(6):321–329

    Article  Google Scholar 

  18. Jin L et al (2016) 3D feature constrained reconstruction for low dose CT imaging. IEEE Trans Circuits Syst Video Technol 99:1–1

    Article  Google Scholar 

  19. Kamila NK (2015) Handbook of Research on Emerging Perspectives in Intelligent Pattern Recognition, Analysis, and Image Processing. IGI Global, p 367–382

  20. Kandi SG (2010) Automatic defect detection and grading of single-color fruits using HSV (hue, saturation, value) color space. J Life Sci 4(7):39–45

    Google Scholar 

  21. Lee DJ, Lane RM, Chang GH (2001) Three-dimensional reconstruction for high-speed volume measurement. SPIE Machine Vision and Three-Dimensional Imaging Systems for Inspection and Metrology 4189:258–267

    Article  Google Scholar 

  22. Lee DJ, Archibald JK, Xiong G (2011) Rapid color grading for fruit quality evaluation using direct color mapping. IEEE Trans Autom Sci Eng 8(2):292–302

    Article  Google Scholar 

  23. Mamdani E, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7(1):1–13

    Article  Google Scholar 

  24. May Z, Amaran MH (2011) Automated oil palm fruit grading system using artificial intelligence. Int J Eng Sci 11:30–35

    Google Scholar 

  25. Mendoza F, Dejmek P, Aguilera JM (2006) Calibrated color measurements of agricultural foods using image analysis. Postharvest Biol Technol 41(3):285–295

    Article  Google Scholar 

  26. Milella A et al (2006) Computer vision technology for agricultural robotics. Sens Rev 26(4):290–230

    Article  Google Scholar 

  27. Mizushima A, Lu R (2013) An image segmentation method for apple sorting and grading using support vector machine and Otsu’s method. Comput Electron Agric 94:29–37

    Article  Google Scholar 

  28. Moreda GP, Ortiz-Cañavate J, García-Ramos FJ, Ruiz-Altisent M (2009) Non-destructive technologies for fruit and vegetable size determination–a review. J Food Eng 92(2):119–136

    Article  Google Scholar 

  29. Nandi CS, Tudu B, Koley C (2014) A machine vision-based maturity prediction system for sorting of harvested mangoes. IEEE Trans Instrum Meas 63(7):1722–1730

    Article  Google Scholar 

  30. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66

    Article  Google Scholar 

  31. Radojević RL, Petrović DV, Pavlović VB, Nikolić ZM, Uroscaron MP (2011) Digital parameterization of apple fruit size, shape and surface spottiness. Afr J Agric Res 6(13):3131–3142

    Google Scholar 

  32. Semary NA, Tharwat A, Elhariri E, Hassanien AE (2015) Fruit-based tomato grading system using features fusion and support vector machine. Proc IEEE Int Conf Intell Systems:401–410

  33. Siswantoro J et al (2016) A new framework for measuring volume of axisymmetric food products using computer vision based on cubic spline interpolation. Proc of Int Conf on Sci and Inf Technol Indonesia p 74–78

  34. Sun C, Berman M, Coward D, Osborne B (2007) Thickness measurement and crease detection of wheat grains using stereo vision. Pattern Recogn Lett 28(12):1501–1508

    Article  Google Scholar 

  35. Tsai RY (1981) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lens. IEEE J of Robot Autom 24(6):381–395

    Google Scholar 

  36. Xu L, Feng Y, Fan Z, Yun D (2014) Research into the grading method of kiwi fruit based on volume estimation and surface defect. INMATEH-Agric Eng 44(3):93–102

    Google Scholar 

  37. Yang C et al (2016) Curve like structure extraction using minimal path propagation with backtracking. IEEE Trans Image Process 25(2):988–1003

    Article  MathSciNet  Google Scholar 

  38. Yang C et al (2016) Structure-adaptive fuzzy estimation for random-valued impulse noise suppression. IEEE Trans Circuits Syst Video Technol 99:1–1

    Google Scholar 

  39. Yang W et al (2017) Improving low-dose CT image using residual convolutional network. IEEE Access 5:24698–24705

    Article  Google Scholar 

  40. Yimyam P et al (2005) Physical properties analysis of mango using computer vision. Proc of ICCAS, Korea

  41. Zhang B, Huang W, Li J, Zhao C, Fan S, Wu J, Liu C (2014) Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review. Food Res Int 62:326–343

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tushar Jadhav.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jadhav, T., Singh, K. & Abhyankar, A. Volumetric estimation using 3D reconstruction method for grading of fruits. Multimed Tools Appl 78, 1613–1634 (2019). https://doi.org/10.1007/s11042-018-6271-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6271-3

Keywords

Navigation