Abstract
Real-time, static and dynamic hand gesture learning and recognition makes it possible to have computers recognize hand gestures naturally. This creates endless possibilities in the way humans can interact with computers, allowing a human hand to be a peripheral by itself. The software framework developed provides a lightweight, robust, and practical application programming interface that helps further research in the area of human-computer interaction. Approaches that have proven in analogous areas such as speech and handwriting recognition were applied to static and dynamic hand gestures. A semi-supervised Fuzzy ARTMAP neural network was used for incremental online learning and recognition of static gestures; and, Hidden Markov models for online recognition of dynamic gestures. A simple anticipatory method was implemented for determining when to update key frames allowing the framework to work with dynamic backgrounds.
Chapter PDF
Similar content being viewed by others
Keywords
References
Vogler, C., Metaxas, D.: A framework for recognizing the simultaneous aspects of american sign language. Computer Vision and Image Understanding 81, 358–384 (2001)
Fang, G., Gao, W., Ma, J.: Signer-independent sign language recognition based on SOFM/HMM, Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 2001. In: Proceedings of the IEEE ICCV Workshop on RATFG in RTS, p. 90 (2001)
von Hardenberg, C., Berard, F.: Bare-hand human-computer interaction. In: Proceedings of the 2001 workshop on Perceptive user interfaces, pp. 1–8 (2001)
Rainer, J.M.: Fast hand gesture recognition for real-time teleconferencing applications. In: International Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, pp. 133–140 (2001)
McAllister, G., McKenna, S.J., Ricketts, I.W.: Hand tracking for behaviour understanding. Image Vision Computing 20, 827–840 (2002)
Keskin, C., Erkan, A., Akarun, L.: Real time hand tracking and 3d gesture recognition for interactive interfaces using hmm. In: Kaynak, O., Alpaydın, E., Oja, E., Xu, L. (eds.) ICANN 2003 and ICONIP 2003. LNCS, vol. 2714. Springer, Heidelberg (2003)
Breuer, P., Eckes, C., Muller, S.: Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera—A Pilot Study. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2007. LNCS, vol. 4418, pp. 247–260. Springer, Heidelberg (2007)
Lyons, K., Brashear, H., Westeyn, T., Kim, J., Starner, T.: GART: The gesture and activity recognition toolkit. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 718–727. Springer, Heidelberg (2007)
Westeyn, T., Brashear, H., Atrash, A., Starner, T.: Georgia tech gesture toolkit: supporting experiments in gesture recognition. In: Proceedings of the 5th international Conference on Multimodal interfaces. ICMI 2003, pp. 85–92. ACM, New York (2003)
Hejlsberg, A., Wiltamuth, S., Golde, P.: C# Language Specifcation. Addison-Wesley Longman Publishing Co., Inc., Boston (2003)
Microsoft DirectShow, http://msdn.microsoft.com/en-us/library/ms783323VS.85.aspx
DirectShow.net Library, http://directshownet.sourceforge.net/
Alkaabi, S., Deravi, F.: Candidate pruning for fast corner detection. Electronics Letters 40, 18–19 (2004)
Angel, E., Morrison, D.: Speeding up bresenham’s algorithm. IEEE Computer Graphics and Applications 11, 16–17 (1991)
Jerde, T., Soechting, J., Flanders, M.: Biological constraints simplify the recognition of hand shapes. IEEE Transactions on Biomedical Engineering 50, 265–269 (2003)
Grossberg, S.: Adaptive pattern classification and universal recoding, II: feedback, expectation, olfaction and illusions. Biological Cybernetics 23, 187–202 (1976)
Anagnostopoulos, G., Georgiopoulos, M., Verzi, S., Heileman, G.: Reducing generalization error and category proliferation in ellipsoid ARTMAP via tunable misclassification error tolerance: Boosted ellipsoid ARTMAP. In: Proc. IEEE-INNS-ENNS Int’l Joint Conf. Neural Networks (IJCNN 2002), vol. 3, pp. 2650–2655 (2002)
Anagnostopoulos, G., Bharadwaj, M., Georgiopoulos, M., Verzi, S., Heileman, G.: Exemplar-based pattern recognition via semi-supervised learning. In: Proceedings of the International Joint Conference on Neural Networks, vol. 4, pp. 2782–2787 (2003)
Makhoul, J., Starner, T., Schwartz, R., Chou, G.: On-line cursive handwriting recognition using hidden Markov models and statistical grammars. In: Proceedings of the Workshop on Human Language Technology, Human Language Technology Conference, Plainsboro, NJ, March 08 - 11, 1994, pp. 432–436. Association for Computational Linguistics, Morristown (1994)
Zen, H., Tokuda, K., Kitamura, T.: A viterbi algorithm for trajectory model derived from HMM with explicity relationship between static and dynamic features. In: Proceedings of ICASSP 2004, pp. 837–840 (2004)
Cavalin, P., Sabourin, R., Suen, C., Britto, A.: Evaluation of incremental learning algorithms for HMM in the recognition of alphanumeric characters. Pattern Recognition (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alexander, T.C., Ahmed, H.S., Anagnostopoulos, G.C. (2009). An Open Source Framework for Real-Time, Incremental, Static and Dynamic Hand Gesture Learning and Recognition. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)