Skip to main content
SpringerLink
Log in

Motion analysis for event detection and tracking with a mobile omnidirectional camera

  • Sp.lss. on Video Surveillance
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract.

A mobile platform mounted with omnidirectional vision sensor (ODVS) can be used to monitor large areas and detect interesting events such as independently moving persons and vehicles. To avoid false alarms due to extraneous features, the image motion induced by the moving platform should be compensated. This paper describes a formulation and application of parametric egomotion compensation for an ODVS. Omni images give 360\(^\circ\) view of surroundings but undergo considerable image distortion. To account for these distortions, the parametric planar motion model is integrated with the transformations into omni image space. Prior knowledge of approximate camera calibration and camera speed is integrated with the estimation process using a Bayesian approach. Iterative, coarse-to-fine, gradient-based estimation is used to correct the motion parameters for vibrations and other inaccuracies in prior knowledge. Experiments with a camera mounted on various types of mobile platforms demonstrate successful detection of moving persons and vehicles.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Achler O, Trivedi MM (2002) Real-time traffic flow analysis using omnidirectional video network and flatplane transformation. In: Workshop on Intelligent Transportation Systems, Chicago, IL, 2002

  2. Bar-Shalom Y, Li XR, Kirubarajan T (2001) Estimation with applications to tracking and navigation. Wiley, New York

  3. Benosman R, Kang SB (2001) Panoramic vision: sensors, theory, and applications. Springer, Berlin Heidelberg New York

    Google Scholar 

  4. Black MJ, Anandan P (1996) The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. Comput Vision Image Understand 63(1):75-104

    Article  Google Scholar 

  5. Boult T, Erkin A, Lewis P, Michaels R, Power C, Qian C, Yin W (1998) Frame-rate multi-body tracking for surveillance. In: Proc. DARPA Image Understanding workshop

  6. Carlsson S, Eklundh JO (1990) Object detection using model-based prediction and motion parallax. In: European conference on computer vision, April 1990, pp 297-306

  7. Chang P, Herbert M (2000) Omni-directional structure from motion. In: IEEE workshop on omnidirectional vision, Hilton Head Island, SC, June 2000. IEEE Press, pp 127-133

  8. Cielniak G, Miladinovic M, Hammarin D, Goranson L, Lilienthal A, Duckett T (2003) Appearance-based tracking of persons with an omnidirectional vision sensor. In: Proc. IEEE workshop on omnidirectional vision

  9. Daniilidis K, Makadia A, Bulow T (2002) Image processing in catadioptric planes: Spatiotemporal derivatives and optical flow computation. In: Proc. IEEE workshop on omnidirectional vision, June 2002, pp 3-12

  10. Danuser G, Stricker M (1998) Parametric model fitting: From inlier characterization to outlier detection. IEEE Trans Pattern Anal Mach Intell 20(2):263-280

    Article  Google Scholar 

  11. Dean KL (2003) Smartcams take aim at terrorists. Wired News, June 2003. http://cvrr.ucsd.edu/press/ articles/Wired News Smartcams.html

  12. Faugeras O (1993) Three-dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge, MA

  13. Gandhi T, Devadiga S, Kasturi R, Camps O (2000) Detection of obstacles using ego-motion compensation and tracking of significant features. Image Vision Comput 18(10):805-815

    Article  Google Scholar 

  14. Gandhi T, Kasturi R (2000) Application of planar motion segmentation for scene text extraction. In: Proc. international conference on pattern recognition, 1:445-449

  15. Gandhi T, Trivedi MM (20040) Motion based vehicle surround analysis using omni-directional camera. In: Proc. IEEE symposium on intelligent vehicles (in press)

  16. Gandhi T, Trivedi MM (2003) Motion analysis of omni-directional video streams for a mobile sentry. In: 1st ACM international workshop on video surveillance, Berkeley, CA, November 2003, pp 49-58

  17. Gandhi T, Yang MT, Kasturi R, Camps O, Coraor L, McCandless J (2003) Detection of obstacles in the flight path of an aircraft. IEEE Trans Aerospace Electron Syst 39(1):176-191

    Article  Google Scholar 

  18. Gluckman J, Nayar S (1998) Ego-motion and omnidirectional cameras. In: Proc. international conference on computer vision, pp 999-1005

  19. Hall TB, Trivedi MM (2002) A novel interactivity environment for integrated intelligent transportation and telematic systems. In: 5th international IEEE conference on intelligent transportation systems, Singapore, September 2002

  20. Haritaoglu, Harwood D, Davis LS (2000) W4: Real-time surveillance of people and their activities. IEEE Trans Pattern Anal Mach Intell 22(8):809-830

    Article  Google Scholar 

  21. Horn B, Schunck B (1981) Determining optical flow. In: DARPA Image Understanding workshop, pp 144-156

  22. Huang KC, Trivedi MM (2003) Video arrays for real-time tracking of persons, head and face in an intelligent room. Mach Vision Appl 14(2):103-111

    Google Scholar 

  23. Huang K, Trivedi MM, Gandhi T (2003) Driver’s view and vehicle surround estimation using omnidirectional video stream. In: IEEE symposium on intelligent vehicles, Columbus, OH, June 2003

  24. Irani M, Anandan P (1998) A unified approach to moving object detection in 2D and 3D scenes. IEEE Trans Pattern Anal Mach Intell 20(6):577-589

    Article  Google Scholar 

  25. Jähne B, Haußecker H, Geißler P (1999) Handbook of computer vision and applications, vol 2. Academic, San Diego, pp 397-422

  26. Jogan M, Leonardis A (2000) Robust localization using panoramic view-based recognition. In: Proc. international conference on pattern recognition, pp 136-139

  27. Kanatani K (1993) Geometric computation for machine vision. Oxford University Press, Oxford

  28. Ke Q, Kanade T (2003) Transforming camera geometry to a virtual downward-looking camera: robust ego-motion estimation and ground-layer detection. In: Proc. IEEE conference on computer vision and pattern recognition, June 2003, pp I:390-397

  29. Kruger W (1999) Robust real time ground plane motion compensation from a moving vehicle. Mach Vision Appl 11:203-212

    Article  Google Scholar 

  30. Lawson S (2002) Yes, you are being watched. PC World, 27 December 2002. http://www.pcworld.com/news/ article/0,aid,108121,00.asp

  31. Lucas B, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: International joint conference on artificial intelligence, pp 674-679

  32. Odobez JM, Bouthemy P (1998) Direct incremental model-based image motion segmentation for video analysis. Signal Process 66:143-145

    Article  MATH  Google Scholar 

  33. Ramsey D (2003) Researchers work with public agencies to enhance super bowl security, 15 February 2003. http://www.calit2.net/news/2003/2-4\_superbowl.html.

  34. Saptharishi M, Hampshire JB, Khosla PK (2000) Agent-based moving object correspondence using differential discriminative diagnosis. In: Proc. IEEE conference on computer vision and pattern recognition, June 2000, 2:652-658

  35. Shakernia O, Vidal R, Sastry S (2003) Omnidirectional egomotion estimation from back-projection flow. In: Proc. IEEE workshop on omnidirectional vision, June 2003

  36. Shi J, Tomasi C (1994) Good features to track. In: Proc. IEEE conference on computer vision and pattern recognition, pp 593-600

  37. Simoncelli EP (1993) Coarse-to-fine estimation of visual motion. In: Proc. 8th workshop on image and multidimensional signal processing, Cannes, France, pp 128-129

  38. Sogo T, Ishiguro H, Trivedi M (2001) N-ocular stereo for real-time human tracking. In: Benosman R, Kang RS (eds) Panoramic vision: sensors, theory, and applications. Springer, Berlin Heidelberg New York, pp 309-396

  39. Stauffer C, Grimson WEL (1999) Adaptive background mixture model for real-time tracking. In: Proc. IEEE international conference on computer vision and pattern recognition, pp 246-252

  40. Trucco E, Verri A (1998) Computer vision and applications: a guide for students and practitioners. Prentice-Hall, Englewood Cliffs, NJ

    Google Scholar 

  41. Vassallo RF, Santos-Victor J, Schneebeli HJ (2002) A general approach for egomotion estimation with omnidirectional images. In: Proc. IEEE workshop on omnidirectional vision, June 2002, pp 97-103

  42. Winters N, Gaspar J, Lacey G, Santos-Victor J (2002) Omni-directional vision for robot navigation. In: Proc. IEEE workshop on omnidirectional vision, pp 21-28

  43. Zhu Z, Karuppiah D, Riseman E, Hanson A (2003) Omni-directional vision for robot navigation. Robot Automat Mag (in press)

Download references

Author information

Authors and Affiliations

  1. Computer Vision and Robotics Research Laboratory, University of California, San Diego, USA

    Tarak Gandhi & Mohan M. Trivedi

Authors
  1. Tarak Gandhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohan M. Trivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tarak Gandhi.

Additional information

Published online: 11 October 2004

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gandhi, T., Trivedi, M.M. Motion analysis for event detection and tracking with a mobile omnidirectional camera. Multimedia Systems 10, 131–143 (2004). https://doi.org/10.1007/s00530-004-0146-3

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-004-0146-3

Keywords:

Search

Navigation