Abstract
In this study a new approach is presented for the recognition of human actions of everyday life with a fixed camera. The originality of the presented method consists in characterizing sequences by a temporal succession of semi-global features, which are extracted from “space-time micro-volumes”. The advantage of this approach lies in the use of robust features (estimated on several frames) associated with the ability to manage actions with variable durations and easily segment the sequences with algorithms that are specific to time-varying data. Each action is actually characterized by a temporal sequence that constitutes the input of a Hidden Markov Model system for the recognition. Results presented of 1,614 sequences performed by several persons validate the proposed approach.
Similar content being viewed by others
References
Bigorgne, E., Achard, C., Devars, J.: Local zernike moments vector for content based queries in image database. In: Machine Vision and Applications, Tokyo, Japan, pp. 327–330 (2000)
Bobick A.F. and Davis J.W. (2001). The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach Intell. 23: 257–267
Cupillard, F., Avanzi, A., Brémond, F., Thonnat, M.: Video understanding for metro surveillance. In: IEEE International Conference on Networking, Sensing and Control, Taipei, Taiwan (2004)
Gavrila D.M. (1999). The visual analysis of human movement : a survey. Comput. Vis. Image Underst. 73: 82–98
Hu W., Tan T., Wang L. and Maybank S. (2004). A survey on visual surveillance of object motion and behaviors. IEEE Trans. Syst. Man Cybern. 34: 334–352
Ke, Y., Sukthankar, R., Hebert, M.: Efficient visual event detection using volumetric features. In: IEEE International Conference on Computer Vision, Beijing, China (2005)
Laptev I. (2005). On space time interest points. Int. J. Comput. Vis. 64(2/3): 107–123
Martin, J., Crowley, J.L.: An appearance based approach to gesture recognition. In: International Conference on Image Analysis and Processing, Florence, Italy (1997)
Pierobon, M., Marcon, M., Sarti, A., Tubaro, S.: Clustering of human actions using invariant body shape descriptor and dynamic time warping. In: IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS), Como, Italy (2005)
Porikli, F., Tuzel, O.: Human body tracking by adaptive background models and mean-shift analysis. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, Nice, France (2003)
Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition, Readings in speech recognition, Morgan Kaufmann Publishers Inc, pp. 267–296 (1990)
Shechtman, E., Irani, M.: Space-time behavior based correlation. In: IEEE International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, pp. 405–412 (2005)
Starner T., Weaver J. and Pentland A. (1998). Real time American sign language recognition from video using HMMs. IEEE Trans. Pattern Anal. Mach. Intell. 12: 1371–1375
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: IEEE International Conference on Computer Vision and Pattern Recognition, Ft. Collins, CO, USA, pp. 246–252 (1999)
Syeda-Mahmood, T.: Retrieving actions embedded in video. In: ACM International Conference on multimedia, Juan les Pins, France, pp. 513–522 (2002)
Yamato, J., Ohya, J., Ishii, K.: Recognizing human action in time-sequential images using Hidden Markov Models. In: IEEE International Conference on Computer Vision and Pattern Recognition, Los Alamitos, pp. 379–385 (1992)
Yilmaz, A., Shah, M.: Actions sketch: a novel action representation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Achard, C., Qu, X., Mokhber, A. et al. A novel approach for recognition of human actions with semi-global features. Machine Vision and Applications 19, 27–34 (2008). https://doi.org/10.1007/s00138-007-0074-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-007-0074-2