Abstract
This paper aims to develop a background subtraction algorithm based on Gaussian Mixture Model (GMM) using Probability Density Function (PDF) to identify the location of moving objects over a belt conveyor for pick and place operations using an industrial robot. In the present work, a stationary webcam is placed above the conveyor system to capture images of the objects that are coming into the view field. The objects of interest are identified by subtracting the background image (reference frame) from the current image frame based on the probability density function of respective pixels over time. The subtracted image frame is processed to extract the attributes such as location, colour, and shape of the objects. The extracted information, in turn, helps the robot to pick the desired object of interest. The results indicated that the GMM based background subtraction is more precisely extracting the features of the object than the direct subtraction technique for robotic applications. The algorithm is developed using MATLAB software.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Benezeth, Y., Jodoin, P.-M., Emile, B., Laurent, H., Rosenberger, C.: Comparative study of background subtraction algorithms. J Electron Imaging SPIE and IS & T (2010). https://doi.org/10.1117/1.3456695. inria-00545478
Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. European conference on computer vision, pp. 751–767. Springer, Berlin (2000)
Goyal, K., Singhai, J.: Review of background subtraction methods using gaussian mixture model for video surveillance systems. Artif. Intell. Rev. 50(2), 241–259 (2018). https://doi.org/10.1007/s10462-017-9542-x
John F, Hipiny I, Ujir H, Sunar MS.: Assessing performance of aerobic routines using background subtraction and intersected image region. arXiv preprint arXiv:1810.01564 (2018)
Kim, K., Chalidabhongse, T. H., Harwood, D., Davis, L.: Background modeling and subtraction by codebook construction. In 2004 International Conference on Image Processing, 2004, vol. 5. ICIP '04, Singapore, pp. 3061–3064. https://doi.org/10.1109/ICIP.2004.1421759
Liu, D., Cong, M., Du, Y., et al.: Visual attention servo control for task-specific robotic applications. Int. J. Control Autom. Syst. 11, 1241–1252 (2013). https://doi.org/10.1007/s12555-012-9505-6
Mandellos, N.A., Keramitsoglou, I., Kiranoudis, C.T.: A background subtraction algorithm for detecting and tracking vehicles. Expert Syst Appl 38(3), 1619–1631 (2011). https://doi.org/10.1016/j.eswa.2010.07.083. ISSN 0957-4174
Oliver, N.M., Rosario, B., Pentland, A.P.: A Bayesian computer vision system for modeling human interactions. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 831–843 (2000)
Piccardi, M: Background subtraction techniques: a review. In 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No. 04CH37583), The Hague, vol. 4. pp. 3099–3104 (2004). https://doi.org/10.1109/ICSMC.2004.1400815
Digital Image Processing Using MATLAB 2nd Ed.by Gonzalez, Woods, and Eddins 2009
Pulgarin-Giraldo J.D., Alvarez-Meza A., Insuasti-Ceballos D., Bouwmans T., Castellanos-Dominguez G. (2017) GMM Background Modeling Using Divergence-Based Weight Updating. In: Beltrán-Castañón C., Nyström I., Famili F. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2016. Lecture Notes in Computer Science, vol 10125. Springer, Cham https://doi.org/10.1007/978-3-319-52277-7_35
Santoyo-Morales, J.E., Hasimoto-Beltran, R.: Video background subtraction in complex environments. J Appl Res Technol 12(3), 527–537 (2014). https://doi.org/10.1016/S1665-6423(14)71632-3
Sen-ching, S.C., Chandrika, K.: Robust techniques for background subtraction in urban traffic video, Proc. SPIE 5308. Visual Commun Image Process (2004). https://doi.org/10.1117/12526886
Sobral, A., Vacavant, A.: A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Understand 122, 4–21 (2014). https://doi.org/10.1016/j.cviu.2013.12.005. ISSN 1077-3142
Stauffer, C., Grimson, W. E. L. (1999) Adaptive background mixture models for real-time tracking. In Proceedings 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), vol. 2, Fort Collins, CO, USA (1999), pp. 246–252
Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 747–757 (2000). https://doi.org/10.1109/34.868677
Thierry, B., Garcia-Garcia. B.: Background subtraction in real applications: challenges, current models and future directions. arXiv:1901.03577 (2019).
Thotapalli, P.K., Kumar, C.R.V., Reddy, B.C.: Feature extraction of moving an object over a belt conveyor using background subtraction technique. ISBN 978–93–80689–28–9
Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 780–785 (1997). https://doi.org/10.1109/34.598236
Zhou, D., Zhang, H.: Modified GMM background modeling and optical flow for detection of moving objects, vol. 3. In 2005 IEEE international conference on systems, man and cybernetics, waikoloa, HI, 2005, pp. 2224–2229
Acknowledgments
The project is funded by AICTE, New Delhi, Government of India, under the Research Promotion Scheme.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Thotapalli, P.K., Vikram Kumar, C.R. & Chandra Mohana Reddy, B. Feature extraction of moving objects using background subtraction technique for robotic applications. Int J Intell Robot Appl 5, 65–78 (2021). https://doi.org/10.1007/s41315-020-00145-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41315-020-00145-0