Skip to main content
Log in

Tracking video objects with feature points based particle filtering

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

For intelligent video surveillance, the adaptive tracking of multiple moving objects is still an open issue. In this paper, a new multi-object tracking method based on video frames is proposed. A type of particle filtering combined with the SIFT (Scale Invariant Feature Transform) is proposed for motion tracking, where SIFT key points are treated as parts of particles to improve the sample distribution. Then, a queue chain method is adopted to record data associations among different objects, which could improve the detection accuracy and reduce the computational complexity. By actual road tests and comparisons, the system tracks multi-objects with better performance, e.g., real time implementation and robust against mutual occlusions, indicating that it is effective for intelligent video surveillance systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. All sequences can be download form http://www.umiacs.umd.edu/~knkim/UMD-BGS/index.html#Download

  2. All sequences can be download form http://www.cvg.cs.rdg.ac.uk/cgi-bin/PETSMETRICS/page.cgi?dataset.

  3. All sequences can be download form http://i2lwww.ira.uka.de/image_sequences

References

  1. Arulampalam S, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for on-line nonlinear/nongaussian bayesian tracking. IEEE Trans Signal Process 50(2):174–188

    Article  Google Scholar 

  2. Ba HX, Zhao ZG, Yang F, Cao L (2004) JPDA in multisensor multitarget tracking. J Syst Simul 16(7):1563–1566

    Google Scholar 

  3. Babu RV, Perez P, Bouthemy P (2007) Robust tracking with motion estimation and local kernel-based color modeling. Image Vis Comput 25(8):1205–1216

    Article  Google Scholar 

  4. Belcher C, Du Y (2009) Region-based SIFT approach to iris recognition. Opt Lasers Eng 47(1):139–147

    Article  Google Scholar 

  5. Betke M, Haritaoglu E, Davis LS (2000) Real-time multiple object detection and tracking from a moving object. Machine Vision and Applications 2(2):69–83

    Article  Google Scholar 

  6. Breitenstein MD, Reichlin F, Leibe B, Koller-Meier E, Gool LV (2009) Robust tracking-by-detection using a detector confidence particle filter. In: Proceedings of IEEE International Conference on Computer Vision, Kyoto, Japan, 1515–1522

  7. Cai YZ, Freitas N, Little J (2006) Robust visual tracking for multiple targets. In: Proc. the 9th European Conference on Computer Vision (ECCV), Graz, Austria, vol.4, pp. 107–118

  8. Comaniciu D, Meer P (2002) Mean Shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  Google Scholar 

  9. Comaniciu D, Ramesh V (2000) Mean shift and optimal prediction for efficient object tracking. In: Proc. IEEE inter-national conference on image processing, Vancouver, Canada, vol.3, pp.70–73

  10. Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577

    Article  Google Scholar 

  11. Cox IJ, Hingorani SL (1996) An efficient implementation of reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans Pattern Anal Mach Intell 18(2):138–150

    Article  Google Scholar 

  12. Dahlkamp H, Nagel H-H, Ottlik A, Reuter P (2007) A framework for model-based tracking experiments in image sequences. Int J Comput Vision 73(2):139–157

    Article  Google Scholar 

  13. Fazli S, Pour HM, Bouzari H (2009) “Particle Filter Based Object Tracking with Sift and Color Feature,” Second International Conference on Machine Vision, pp. 89–93

  14. Gao T, Liu ZH, Zhang J (2009) Feature particles tracking for the moving object. Studies in computational intelligence: opportunities and challenges for next-generation applied intelligence, vol.214, pp. 39–44

  15. Gao T, Liu ZG, Zhang J (2009) Redundant discrete wavelet transforms based moving object recognition and tracking. J Syst Eng Electron 20(5):1115–1123

    Google Scholar 

  16. Gao T, Liu ZH, Yue SH, Zhang J, Mei JQ, Gao WC (2010) Robust background subtraction in traffic video sequence. J Cent S Univ Technol 17(1):187–195

    Article  Google Scholar 

  17. Guan YP, Gu WK (2006) Automatic and robust shadow segmentation from two-dimensional scenes. Acta Electronica Sin 34(4):624–627

    Google Scholar 

  18. Gupte S, Masoud O, Martin RFK, Papanikolopoulos NP (2002) IEEE Transactions on Intelligent Transportation Systems 3(1):37–47

    Article  Google Scholar 

  19. Hue C, Le Cadre J-P, Perez P (2002) Tracking multiple objects with particle filtering. IEEE Trans Aerosp Electron Syst 38(3):791–812

    Article  Google Scholar 

  20. Jin YG, Mokhtarian F (2007) Variational particle filter for multi-object tracking. In: Proc. IEEE 11th International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil, pp.1–8

  21. Kilger M (1992) A shadow handler in a video-based real-time traffic monitoring system. In: Proceedings of IEEE workshop on applications of computer vision, Palm Springs, California, USA, pp.11–18

  22. Lee DS (2005) Effective Gaussian mixture learning for video background subtraction. IEEE Trans Pattern Anal Mach Intell 27(5):827–832

    Article  Google Scholar 

  23. Lei BJ, Xu LQ (2006) Real-time out-door video surveillance with robust foreground extraction and object tracking via multi-state transition management. Pattern Recognit Lett 27(15):1816–1825

    Article  Google Scholar 

  24. Lin MX, Xu XH (2006) Multiple object visual tracking from a moving object. In: Proc. the sixth international conference on intelligent systems design and applications, Jinan, China, vol.2, pp. 373–378

  25. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91–110

    Article  Google Scholar 

  26. Niu CF, Liu YS (2008) Improved mean-shift object tracking method. Opto Electron Eng 35(3):26–29

    Google Scholar 

  27. Okuma K, Taleghani A, Freitas N, Little J, Lowe D (2004) A boosted particle filter: multitarget detection and tracking. In: Proc. the 8th European conference on computer vision (ECCV), Prague, Czech Republic, vol.1, pp. 28–39

  28. Ottlik A, Nagel H-H (2008) Initialization of model-based vehicle tracking in video sequences. Int J Comput Vision 80(2):211–225

    Article  Google Scholar 

  29. Pinkiewicz T, Williams R, Purser J (2008) Application of the particle filter to tracking of fish in aquaculture research. In: Proc. Digital Image Computing: Techniques and Applications (DICTA), Canberra, pp. 457–464.

  30. Reckleitis I (2003) A particle filter tutorial for mobile robot localization. In: Proc. the international conference on robotics and automation, vol. 42, pp.1–36

  31. Ross D, Lim J, Yang MH (2004) Adaptive probabilistic visual tracking with incremental subspace update. In: Proc. the 8th European Conference on Computer Vision (ECCV), Prague, Czech Republic, vol.2, pp.470–482

  32. Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vision 77(1–3):125–141

    Article  Google Scholar 

  33. Rowe D, Reid I, Gonzàlez J, Villanueva JJ (2006) Unconstrained multiple-people tracking. In: Proc. the 28th DAGM symposium, Berlin, Germany, pp 505–514

  34. M. Shehata, M. Pervez, T. Burr, J. Cai, W. Badawy, A. Radmanesh (2006) On eliminating static shadow false alarms in automatic incident detection systems. In: Proceedings of the IEEE Intelligent Transportation Systems Conference, Toronto, 2006, pp.759–764.

  35. Sidenbladh H (2003) Multi-target particle filtering for the probability hypothesis density. In: Proc. The sixth international conference on information fusion, pp.1110–1117

  36. Song X, Wang LP, Wang P, Shen ZK (2007) IR target tracking based on improved mean shift method. J Infrared Millimeter Waves 26(6):429–432

    Google Scholar 

  37. Stauer C, Grimson W (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal Mach Intell 22(8):747–757

    Article  Google Scholar 

  38. Stauffer C, Grimson WEL (1999). Adaptive background mixture models for real time tracking. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Colorado, USA, no.2, pp. 246–252.

  39. Sun ZH, Zhu SA (2008) Real-time segmentation and tracking technique of multiple moving objects in video sequence. J Zhejiang Univ Eng Sci 42(9):1631–1635

    Google Scholar 

  40. Wang FS, Zhao QJ (2008) A new particle filter for nonlinear filtering problems. Chin J Comput 31(2):346–352

    Article  Google Scholar 

  41. Wu P, Kong LF, Zhao F, Li X (2008). Particle filter tracking based on color and SIFT features. In: Proceedings of international conference on audio, language and image processing, pp. 932–937

  42. Yang J, Zhao ZM (2007) Shadow processing method based on normalized RGB color model. Opto Electron Eng 34(12):92–96

    Google Scholar 

  43. Yang CL, Yu YL, Liu GS (2000) Data association algorithm in multi-target tracking. J Syst Eng Electron 22(3):11–15

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Gao.

Additional information

This work is supported by the National Science Foundation of China under Grant No. 70773008, Program for New Century Excellent Talents in University under Grant No. NCET-10-0048, Fok Ying Tung Education Foundation under Grant No. 121079, and the Science Foundations of Tianjin under Grant No. 10ZCKFSF01100.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gao, T., Li, G., Lian, S. et al. Tracking video objects with feature points based particle filtering. Multimed Tools Appl 58, 1–21 (2012). https://doi.org/10.1007/s11042-010-0676-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0676-y

Keywords

Navigation