Abstract
This paper presents a general framework for image-based analysis of 3D repeating motions that addresses two limitations in the state of the art. First, the assumption that a motion be perfectly even from one cycle to the next is relaxed. Real repeating motions tend not to be perfectly even, i.e., the length of a cycle varies through time because of physically important changes in the scene. A generalization of period is defined for repeating motions that makes this temporal variation explicit. This representation, called the period trace, is compact and purely temporal, describing the evolution of an object or scene without reference to spatial quantities such as position or velocity. Second, the requirement that the observer be stationary is removed. Observer motion complicates image analysis because an object that undergoes a 3D repeating motion will generally not produce a repeating sequence of images. Using principles of affine invariance, we derive necessary and sufficient conditions for an image sequence to be the projection of a 3D repeating motion, accounting for changes in viewpoint and other camera parameters. Unlike previous work in visual invariance, however, our approach is applicable to objects and scenes whose motion is highly non-rigid. Experiments on real image sequences demonstrate how the approach may be used to detect several types of purely temporal motion features, relating to motion trends and irregularities. Applications to athletic and medical motion analysis are discussed.
Similar content being viewed by others
References
Allmen, M. and Dyer, C. R. 1990. Cyclic motion detection using spatiotemporal surfaces and curves. In Proc. 10th Int. Conf. on Pattern Recognition, pp. 365-370.
Baker, H. H. and Bolles, R. C. 1989. Generalizing epipolar-plane image analysis on the spatiotemporal surface. Int. Journal of Computer Vision, 3(1):33-49.
Baumberg, A. M. and Hogg, D. C. 1994. An efficient method for contour tracking using active shape models. In Proc. Workshop on Motion of Non-Rigid and Articulated Objects, pp. 194-199.
Bobick, A. F. and Wilson, A. D. 1995. A state-based technique for the summarization and recognition of gesture. In Proc. Fifth International Conference on Computer Vision, pp. 382-388.
Cedras, C. and Shah, M. 1995. Motion-based recognition: A survey. Image and Vision Computing, 13(2):129-155.
Darrell, T. and Pentland, A. 1993. Space-time gestures. In Proc. Computer Vision and Pattern Recognition Conf., pp. 335-340.
Davis, J. W. and Shah, M. 1994. Visual gesture recognition. IEE Proc. Vision, Image and Signal Processing, 141(2):101-106.
Essa, I. A. and Pentland, A. 1994. A vision system for observing and extracting facial action parameters. In Proc. Computer Vision and Pattern Recognition Conf., pp. 76-83.
Goddard, N. H. 1989. The interpretation of visual motion: Recognizing moving light displays. In Proc. IEEE Workshop on Visual Motion, pp. 212-220.
Gould, K. and Shah, M. 1989. The trajectory primal sketch: A multi-scale scheme for representing motion characteristics. In Proc. Computer Vision and Pattern Recognition Conf., pp. 79-85.
Hogg, D. 1983. Model-based vision: A program to see a walking person. Image and Vision Computing, 1(1):5-20.
Huttenlocher, D. P., Klanderman, G. A., and Rucklidge, W. J. 1993. Comparing images using the Hausdorff distance. IEEE Trans. Pattern Analysis and Machine Intell., 15(9):850-863.
Johansson, G. 1973. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14(2):201- 211.
Kass, M., Witkin, A., and Terzopoulos, D. 1988. Snakes: Active contour models. Int. Journal of Computer Vision, 1(4):321-331.
Koenderink, J. J. and van Doorn, A. J. 1991. Affine structure from motion. J. Opt. Soc. Am. A, 8:377-385.
McReynolds, D. P. and Lowe, D. G. 1995. Rigidity checking of 3D point correspondences under perspective projection. In Proc. Fifth Int. Conf. on Computer Vision, pp. 945-950.
Mundy, J. L. and Zisserman, A. 1992. Geometric Invariance in Computer Vision. MIT Press: Cambridge, MA.
Perry, T. S. 1990. Biomechanically engineered athletes. IEEE Spectrum, pp. 43-44.
Polana, R. and Nelson, R. 1992. Recognition of motion from temporal texture. In Proc. Computer Vision and Pattern Recognition Conf., pp. 129-134.
Polana, R. and Nelson, R. 1993. Detecting activities. In Proc. Computer Vision and Pattern Recognition Conf., pp. 2-7.
Press, W. H., Flannery, B. P., Teukolsky, S. A., and Vetterling, W. T. 1988. Numerical Recipes in C. Cambridge University Press: Cambridge, MA.
Rohr, K. 1993. Incremental recognition of pedestrians from image sequences. In Proc. Computer Vision and Pattern Recognition Conf., pp. 8-13.
Seitz, S. M. and Dyer, C. R. 1994a. Affine invariant detection of periodic motion. In Proc. Computer Vision and Pattern Recognition Conf., pp. 970-975.
Seitz, S. M. and Dyer, C. R. 1994b. Detecting irregularities in cyclic motion. In Proc. Workshop on Motion of Non-Rigid and Articulated Objects, pp. 178-185.
Seitz, S. M. and Dyer, C. R. 1997. Cyclic motion analysis using the period trace. In Motion-Based Recognition, M. Shah and R. Jain (Eds.), Kluwer Academic Publishers: Boston, MA, pp. 61-85.
Shah, M. and Jain, R. 1997. Motion-Based Recognition. Kluwer Academic Publishers: Boston, MA.
Shapiro, L., Zisserman, A., and Brady, M. 1994. Motion from point matches using affine epipolar geometry. In Proc. Third European Conference on Computer Vision, pp. 73-84.
Soatto, S. and Perona, P. 1994. Three dimensional transparent structure segmentation and multiple 3Dmotion estimation from monocular perspective image sequences. In Proc. Workshop on Motion of Non-Rigid and Articulated Objects, pp. 228-235.
Stewart, G. W. 1973. Introduction to Matrix Computations. Academic Press: New York, NY.
Terzopoulos, D., Witkin, A., and Kass, M. 1988. Constraints on deformable models: Recovering 3D shape and nonrigid motion. In Proc. AAAI Conf., pp. 91-122.
Tomasi, C. and Kanade, T. 1992. Shape and motion from image streams under orthography: A factorization method. Int. Journal of Computer Vision, 9(2):137-154.
Tsai, P. S., Shah, M., Keiter, K., and Kasparis, T. 1994. Cyclic motion detection for motion based recognition. Pattern Recognition, 27(12):1591-1603.
Williams, D. J. and Shah, M. 1992. A fast algorithm for active contours and curvature information. CVGIP: Image Understanding, 16(55):14-26.
Yacoob, Y. and Davis, L. 1994. Computing spatio-temporal representations of human faces. In Proc. Computer Vision and Pattern Recognition Conf., pp. 70-75.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Seitz, S.M., Dyer, C.R. View-Invariant Analysis of Cyclic Motion. International Journal of Computer Vision 25, 231–251 (1997). https://doi.org/10.1023/A:1007928103394
Issue Date:
DOI: https://doi.org/10.1023/A:1007928103394