Abstract
Aimed at the present situation that dynamic hand gestures recognition rate is low and the effect is not ideal, this paper uses Sobel operator to detect the edges in gesture image sequences, enhancing the edge features in dynamic gesture image. In order to prevent the information loss of gesture image after edge detection, the paper will fuse the HOG, HOG2 feature of gesture image sequences after edge detection with that of the original gesture image sequences to enhance edge features without losing other information. In the experiments, Nearest Neighbor Interpolation (NNI) is used to normalize the image sequences to the same length with all gesture video from CVRR-HANDS 3D database, then Sobel operator is used to detect the edges in all gesture image sequences (including RGB data and the Depth data) for subsequent processing, we called edge detection image sequences for Sobel CVRR-HANDS 3D database, the original data for NonSobel CVRR-HANDS 3D database. Next we extract the HOG and HOG2 features from NonSobel CVRR-HANDS 3D database and Sobel CVRR-HANDS 3D database, and incorporating these features. Finally, we respectively use Support Vector Machine (SVM) of the linear Kernel (LIN) and Histogram intersection Kernel (HIK) to recognize dynamic hand gestures. The experimental results show that the recognition rate from our method improves more than two percentage points compared with the traditional method on LIN and HIK kernel of SVM.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Premaratne, P.: Human Computer Interaction using Hand Gestures. Springer International Publisher, Singapore (2014)
Wang, Q., Xu, Y.R., Bai, X., et al.: Dynamic gesture recognition using 3D trajectory. In: 2014 4th IEEE International Conference on Information Science and Technology (ICIST), pp. 598–601. IEEE (2014)
Stern, H., Shmueli, M., Berman, S.: Most discriminating segment–longest common subsequence (MDSLCS) algorithm for dynamic hand gesture classification. Pattern Recognit. Lett. 34(15), 1980–1989 (2013)
Pang, H., Ding, Y.: Dynamic hand gesture recognition using kinematic features based on hidden markov model. In: Yang, Y., Ma, M. (eds.) (GCN 2012): Volume 5. LNEE, vol. 227, pp. 255–262. Springer, Heidelberg (2013). doi:10.1007/978-3-642-35398-7_32
Duc-Hoang, V., Huynh, H.H., Nguyen, T.N.: Modeling dynamic hand gesture based on geometric features. In: 2014 International Conference on Advanced Technologies for Communications (ATC), pp. 471–476. IEEE (2014)
Cheng, J., Chen, X., Liu, A., et al.: A novel phonology-and radical-coded chinese sign language recognition framework using accelerometer and surface electromyography sensors. Sensors 15(9), 23303–23324 (2015)
Dekate, A., Kamal, A., Surekha, K.S.: Magic glove-wireless hand gesture hardware controller. In: 2014 International Conference on Electronics and Communication Systems (ICECS), pp. 1–4. IEEE (2014)
Ohn-Bar, E., Trivedi, M.: Joint angles similarities and HOG2 for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 465–470 (2013)
Klaser, A., Marszałek, M., Schmid, C.: A spatio-temporal descriptor based on 3D-gradients. In: BMVC 2008–19th British Machine Vision Conference, vol. 275, pp. 1–10. British Machine Vision Association (2008)
Wang, H., Kläser, A., Schmid, C., et al.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vis. 103(1), 60–79 (2013)
Cheng, S.Y., Trivedi, M.M.: Vision-based infotainment user determination by hand recognition for driver assistance. IEEE Trans. Intell. Transp. Syst. 11(3), 759–764 (2010)
Ohn-Bar, E., Tran, C., Trivedi, M.: Hand gesture-based visual user interface for infotainment. In: Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 111–115. ACM (2012)
Ohn-Bar, E., Trivedi, M.M.: Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations. IEEE Trans. Intell. Transp. Syst. 15(6), 2368–2377 (2014)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)
Doliotis, P., Stefan, A., McMurrough, C., et al.: Comparing gesture recognition accuracy using color and depth information. In: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments, p. 20. ACM (2011)
Keskin, C., Cemgil, A.T., Akarun, L.: DTW based clustering to improve hand gesture recognition. In: Salah, A.A., Lepri, B. (eds.) HBU 2011. LNCS, vol. 7065, pp. 72–81. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25446-8_8
Ren, Z., Meng, J., Yuan, J.: Depth camera based hand gesture recognition and its applications in human-computer-interaction. In: 2011 8th International Conference on Information, Communications and Signal Processing (ICICS), pp. 1–5. IEEE (2011)
Premaratne, P., Yang, S., Vial, P., Ifthikar, Z.: Dynamic hand gesture recognition using centroid tracking. In: Huang, D.-S., Bevilacqua, V., Prashan, P. (eds.) ICIC 2015. LNCS, vol. 9225, pp. 623–629. Springer, Cham (2015). doi:10.1007/978-3-319-22180-9_62
Kanopoulos, N., Vasanthavada, N., Baker, R.L.: Design of an image edge detection filter using the Sobel operator. IEEE J. Solid-state Circ. 23(2), 358–367 (1988)
Pathak, B., Jalal, A.S., Agrawal. S.C., et al.: A framework for dynamic hand gesture recognition using key frames extraction. In: 2015 Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pp. 1–4. IEEE (2015)
Suk, H.I., Sin, B.K., Lee, S.W.: Hand gesture recognition based on dynamic Bayesian network framework. Pattern Recognit. 43(9), 3059–3072 (2010)
Morguet, P., Lang, M.: Spotting dynamic hand gestures in video image sequences using hidden Markov models. In: 1998 International Conference on Image Processing, ICIP 1998 Proceedings, pp. 193–197. IEEE (1998)
Abid, M.R., Meszaros, P.E., d Silva, R.F., et al.: Dynamic hand gesture recognition for human-robot and inter-robot communication. In: 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 12–17. IEEE (2014)
Wang, X., Xia, M., Cai, H., et al.: Hidden-markov-models-based dynamic hand gesture recognition. Math. Probl. Eng. 2012 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Zhang, M., Wang, B., Zhou, S., Pan, Z. (2017). Dynamic Gesture Recognition Based on Edge Feature Enhancement Using Sobel Operator. In: Tian, F., Gatzidis, C., El Rhalibi, A., Tang, W., Charles, F. (eds) E-Learning and Games. Edutainment 2017. Lecture Notes in Computer Science(), vol 10345. Springer, Cham. https://doi.org/10.1007/978-3-319-65849-0_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-65849-0_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-65848-3
Online ISBN: 978-3-319-65849-0
eBook Packages: Computer ScienceComputer Science (R0)