Skip to main content

Dynamic Gesture Recognition Based on Edge Feature Enhancement Using Sobel Operator

  • Conference paper
  • First Online:
Book cover E-Learning and Games (Edutainment 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10345))

Abstract

Aimed at the present situation that dynamic hand gestures recognition rate is low and the effect is not ideal, this paper uses Sobel operator to detect the edges in gesture image sequences, enhancing the edge features in dynamic gesture image. In order to prevent the information loss of gesture image after edge detection, the paper will fuse the HOG, HOG2 feature of gesture image sequences after edge detection with that of the original gesture image sequences to enhance edge features without losing other information. In the experiments, Nearest Neighbor Interpolation (NNI) is used to normalize the image sequences to the same length with all gesture video from CVRR-HANDS 3D database, then Sobel operator is used to detect the edges in all gesture image sequences (including RGB data and the Depth data) for subsequent processing, we called edge detection image sequences for Sobel CVRR-HANDS 3D database, the original data for NonSobel CVRR-HANDS 3D database. Next we extract the HOG and HOG2 features from NonSobel CVRR-HANDS 3D database and Sobel CVRR-HANDS 3D database, and incorporating these features. Finally, we respectively use Support Vector Machine (SVM) of the linear Kernel (LIN) and Histogram intersection Kernel (HIK) to recognize dynamic hand gestures. The experimental results show that the recognition rate from our method improves more than two percentage points compared with the traditional method on LIN and HIK kernel of SVM.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Premaratne, P.: Human Computer Interaction using Hand Gestures. Springer International Publisher, Singapore (2014)

    Book  Google Scholar 

  2. Wang, Q., Xu, Y.R., Bai, X., et al.: Dynamic gesture recognition using 3D trajectory. In: 2014 4th IEEE International Conference on Information Science and Technology (ICIST), pp. 598–601. IEEE (2014)

    Google Scholar 

  3. Stern, H., Shmueli, M., Berman, S.: Most discriminating segment–longest common subsequence (MDSLCS) algorithm for dynamic hand gesture classification. Pattern Recognit. Lett. 34(15), 1980–1989 (2013)

    Article  Google Scholar 

  4. Pang, H., Ding, Y.: Dynamic hand gesture recognition using kinematic features based on hidden markov model. In: Yang, Y., Ma, M. (eds.) (GCN 2012): Volume 5. LNEE, vol. 227, pp. 255–262. Springer, Heidelberg (2013). doi:10.1007/978-3-642-35398-7_32

    Google Scholar 

  5. Duc-Hoang, V., Huynh, H.H., Nguyen, T.N.: Modeling dynamic hand gesture based on geometric features. In: 2014 International Conference on Advanced Technologies for Communications (ATC), pp. 471–476. IEEE (2014)

    Google Scholar 

  6. Cheng, J., Chen, X., Liu, A., et al.: A novel phonology-and radical-coded chinese sign language recognition framework using accelerometer and surface electromyography sensors. Sensors 15(9), 23303–23324 (2015)

    Article  Google Scholar 

  7. Dekate, A., Kamal, A., Surekha, K.S.: Magic glove-wireless hand gesture hardware controller. In: 2014 International Conference on Electronics and Communication Systems (ICECS), pp. 1–4. IEEE (2014)

    Google Scholar 

  8. Ohn-Bar, E., Trivedi, M.: Joint angles similarities and HOG2 for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 465–470 (2013)

    Google Scholar 

  9. Klaser, A., Marszałek, M., Schmid, C.: A spatio-temporal descriptor based on 3D-gradients. In: BMVC 2008–19th British Machine Vision Conference, vol. 275, pp. 1–10. British Machine Vision Association (2008)

    Google Scholar 

  10. Wang, H., Kläser, A., Schmid, C., et al.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vis. 103(1), 60–79 (2013)

    Article  MathSciNet  Google Scholar 

  11. Cheng, S.Y., Trivedi, M.M.: Vision-based infotainment user determination by hand recognition for driver assistance. IEEE Trans. Intell. Transp. Syst. 11(3), 759–764 (2010)

    Article  Google Scholar 

  12. Ohn-Bar, E., Tran, C., Trivedi, M.: Hand gesture-based visual user interface for infotainment. In: Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 111–115. ACM (2012)

    Google Scholar 

  13. Ohn-Bar, E., Trivedi, M.M.: Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations. IEEE Trans. Intell. Transp. Syst. 15(6), 2368–2377 (2014)

    Article  Google Scholar 

  14. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)

    Google Scholar 

  15. Doliotis, P., Stefan, A., McMurrough, C., et al.: Comparing gesture recognition accuracy using color and depth information. In: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments, p. 20. ACM (2011)

    Google Scholar 

  16. Keskin, C., Cemgil, A.T., Akarun, L.: DTW based clustering to improve hand gesture recognition. In: Salah, A.A., Lepri, B. (eds.) HBU 2011. LNCS, vol. 7065, pp. 72–81. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25446-8_8

    Google Scholar 

  17. Ren, Z., Meng, J., Yuan, J.: Depth camera based hand gesture recognition and its applications in human-computer-interaction. In: 2011 8th International Conference on Information, Communications and Signal Processing (ICICS), pp. 1–5. IEEE (2011)

    Google Scholar 

  18. Premaratne, P., Yang, S., Vial, P., Ifthikar, Z.: Dynamic hand gesture recognition using centroid tracking. In: Huang, D.-S., Bevilacqua, V., Prashan, P. (eds.) ICIC 2015. LNCS, vol. 9225, pp. 623–629. Springer, Cham (2015). doi:10.1007/978-3-319-22180-9_62

    Chapter  Google Scholar 

  19. Kanopoulos, N., Vasanthavada, N., Baker, R.L.: Design of an image edge detection filter using the Sobel operator. IEEE J. Solid-state Circ. 23(2), 358–367 (1988)

    Article  Google Scholar 

  20. Pathak, B., Jalal, A.S., Agrawal. S.C., et al.: A framework for dynamic hand gesture recognition using key frames extraction. In: 2015 Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pp. 1–4. IEEE (2015)

    Google Scholar 

  21. Suk, H.I., Sin, B.K., Lee, S.W.: Hand gesture recognition based on dynamic Bayesian network framework. Pattern Recognit. 43(9), 3059–3072 (2010)

    Article  MATH  Google Scholar 

  22. Morguet, P., Lang, M.: Spotting dynamic hand gestures in video image sequences using hidden Markov models. In: 1998 International Conference on Image Processing, ICIP 1998 Proceedings, pp. 193–197. IEEE (1998)

    Google Scholar 

  23. Abid, M.R., Meszaros, P.E., d Silva, R.F., et al.: Dynamic hand gesture recognition for human-robot and inter-robot communication. In: 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 12–17. IEEE (2014)

    Google Scholar 

  24. Wang, X., Xia, M., Cai, H., et al.: Hidden-markov-models-based dynamic hand gesture recognition. Math. Probl. Eng. 2012 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhigeng Pan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Zhang, M., Wang, B., Zhou, S., Pan, Z. (2017). Dynamic Gesture Recognition Based on Edge Feature Enhancement Using Sobel Operator. In: Tian, F., Gatzidis, C., El Rhalibi, A., Tang, W., Charles, F. (eds) E-Learning and Games. Edutainment 2017. Lecture Notes in Computer Science(), vol 10345. Springer, Cham. https://doi.org/10.1007/978-3-319-65849-0_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65849-0_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65848-3

  • Online ISBN: 978-3-319-65849-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics