Abstract
Aiming at the high demand of the background environment and the user, this paper designs a real-time human static gesture recognition algorithm based on the depth information of Kinect. The localization of the joint points of the hand is realized by using the Kinect skeleton. The depth image is acquired by the depth sensor, and the joint points of the hand are tracked continuously; After locating the position of the hand, the region of interest is intercepted, and the depth threshold is set up to segment the hand from the depth image; The segmentation image is processed by morphology, and the circular rate, filling rate, perimeter rate, convex hull, convex defect, Hu moments of the hand contour are 9 kinds of features; Six kinds (0 to 5) of gesture are recognized using SVM method. Recognition rate and robustness of gesture recognition experiments are conducted in static and dynamic environment respectively. The experimental results show that the proposed algorithm can achieve better recognition result in a variety of environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yang, B., Sun, X.N., Fang, Z.Q.: Gesture Recognition in Complex Background Based on Distribution Features of Hand. Journal of Computer-Aided Design & Computer Graphics 22, 1841–1848 (2010)
Sungil, K., Annah, R., Hyunki, H.: Using depth and skin color for hand gesture classification. In: IEEE International Conference, Las Vegas, pp. 155–156 (2011)
He, J.G., Shao, L., Xiao, D., Jamie, S.: Enhanced Computer Vision with Microsoft Kinect Sensor: A Review. IEEE Transactions on Cybernetics 43(5) (2013)
Jamie, S., Andrew, F., Mat, C.: Real-time human pose recognition in parts from single depth images. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, pp. 1297–1304 (2011)
Georg, H., Rod, M., Wolfgang, B.: Lightweight palm and finger tracking for real-time 3D gesture control. In: IEEE Virtual Reality, Singapore, pp. 19–23 (2011)
Guo, J.Y., Zhang, Y.W.: Face Recognition Based on Moment Invariants and Neural Networks. Computer Engineering and Applications 7(2008)
Teague, M.R.: Image analysis via the general theory of moments. Optical Society of America. 70(8), 920–930 (2010)
Li, Y., Tong, X.L., Liang, C.Q.: Hand Gesture Recognition Based on Fourier Descriptors with Complex Backgrounds. Computer Simulation 22(12), 158–161 (2005)
Song, C.D., Ali, M.S.: Face recognition using complex wavelet moments. Optics and Laser Technology 47 (2013)
Chung, W., Wu, X., Xu, Y.: A real-time hand gesture recognition based on Haar wavelet representation. In: Proc. IEEE Int. Conf. Robot. Biomimetics, pp. 336–341 (2009)
Fang, Y., Wang, K., Cheng, J., Lu, H.: A real-time hand gesture recognition method. In: Proc. IEEE Int. Conf. Multimedia Expo, pp. 995–998(2007)
Yun, L., Peng, Z.: An automatic hand gesture recognition system based on viola-Jones method and SVMs. In: Proc. 2nd Int. Workshop Comput. Sci. Eng, pp. 72–76(2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Sang, H., Li, W. (2015). Gesture Detection and Recognition Fused with Multi-feature Based on Kinect. In: Yang, J., Yang, J., Sun, Z., Shan, S., Zheng, W., Feng, J. (eds) Biometric Recognition. CCBR 2015. Lecture Notes in Computer Science(), vol 9428. Springer, Cham. https://doi.org/10.1007/978-3-319-25417-3_70
Download citation
DOI: https://doi.org/10.1007/978-3-319-25417-3_70
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25416-6
Online ISBN: 978-3-319-25417-3
eBook Packages: Computer ScienceComputer Science (R0)