Abstract
More and more digital experiences, such as Serious Games, rely on gesture control as a means of natural human communication. Therefore we investigated the suitability of the Senso Glove: DK2 data glove and a Support Vector Machine for recognizing static hand gestures of the popular game Rock-Paper-Scissors in a previous work. Building on this, we now want to increase the scope of training and testing data and evaluate different kinds of Machine-Learning classifiers in addition to the Support Vector Machine. For this purpose, we ingested two different datasets, optimized them using grid search, and evaluated all user data in such a way that each user dataset was used individually for testing (leave-one-out) in order to obtain the most possible representative and user-independent result. Our results show that for a small number of gestures, Logistic Regression has the highest accuracy (97.6%) in predicting the results quickly. For a larger dataset, Random Forest achieves the highest accuracy (82.4%). Random Forest and Logistic Regression give very good results on both datasets (average 89.7%, both), but Logistic Regression is significantly faster overall. If the training and test data are not separated by user and are thus user-dependent, the results for both data sets improve to 99.2% and 99.5% with Support Vector Machine, respectively, and again Random Forest performs very well, with Logistic Regression showing small weaknesses here. In addition, we investigated how the accuracy of the classifiers performed when we gradually reduced the number of gestures from 25 to three in a dataset with 25 gestures and found that up to 11 gestures, a high accuracy of more than 94% could be achieved.
The data recorded in the course of this work are public available in https://github.com/serious-games-darmstadt/dataglove_senso-glove-dk2_rps-gestures (Last visited on 30 April 2022).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://www.half-life.com/en/alyx/ (Last visited on 26 April 2022).
- 2.
https://www.umop.com/rps.htm (Last visited on 29 April 2022).
- 3.
https://senso.me (Last visited on 15 April 2022).
- 4.
http://www.dg-tech.it/vhand3/products.html (Last visited on 15 April 2022).
- 5.
https://senso.me (Last visited on 28 April 2022).
- 6.
https://www.apple.com/macbook-pro-14-and-16/specs/ (Last visited on 30 April 2022).
- 7.
https://scikit-learn.org/stable/ (Last visited on 30 April 2022).
References
Achenbach, P., Müller, P., Wach, T., Tregel, T., Göbel, S.: Rock beats Scissor: SVM based gesture recognition with data gloves. In: 2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), pp. 617–622 (2021)
Berrar, D.: Bayes’ theorem and naive Bayes classifier. Encyclopedia of Bioinformatics and Computational Biology: ABC of Bioinformatics 403 (2018)
Bhuiyan, R.A., Tushar, A.K., Ashiquzzaman, A., Shin, J., Islam, M.R.: Reduction of gesture feature dimension for improving the hand gesture recognition performance of numerical sign language. In: 2017 20th International Conference of Computer and Information Technology (ICCIT), pp. 1–6. IEEE (2017)
Billiet, L., Oramas Mogrovejo, J.A., Hoffmann, M., Meert, W., Antanas, L.: Rule-based hand posture recognition using qualitative finger configurations acquired with the kinect. In: Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods, pp. 1–4 (2013)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Fix, E., Hodges, J.L.: Nonparametric discrimination: consistency properties. Randolph Field, Texas, Project, pp. 21–49 (1951)
Kumar, P., Saini, R., Roy, P.P., Dogra, D.P.: A position and rotation invariant framework for sign language recognition (SLR) using Kinect. Multimed. Tools Appl. 77(7), 8823–8846 (2017). https://doi.org/10.1007/s11042-017-4776-9
LaValley, M.P.: Logistic regression. Circulation 117(18), 2395–2399 (2008)
Lovelace, D.C.: Rock-Paper-Scissors Variants (2003). https://www.umop.com/rps.htm
Ma, W., Hu, J., Liao, J., Fan, Z., Wu, J., Liu, L.: Finger gesture recognition based on 3D-accelerometer and 3D-gyroscope. In: Douligeris, C., Karagiannis, D., Apostolou, D. (eds.) KSEM 2019. LNCS (LNAI), vol. 11775, pp. 406–413. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29551-6_36
de Melo, P.M.P.: Gesture recognition for human-robot collaborative assembly (2018)
Mittal, A., Kumar, P., Roy, P.P., Balasubramanian, R., Chaudhuri, B.B.: A modified LSTM model for continuous sign language recognition using leap motion. IEEE Sens. J. 19(16), 7056–7063 (2019)
Pezzuoli, F., Corona, D., Corradini, M.L.: Recognition and classification of dynamic hand gestures by a wearable data-glove. SN Comput. Sci. 2(1), 1–9 (2020). https://doi.org/10.1007/s42979-020-00396-5
Plawiak, P., Sośnicki, T., Niedźwiecki, M., Tabor, Z., Rzecki, K.: Hand body language gesture recognition based on signals from specialized glove and machine learning algorithms. IEEE Trans. Industr. Inform. 12(3), 1104–1113 (2016)
Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(6), 386 (1958)
Saggio, G., Cavallo, P., Ricci, M., Errico, V., Zea, J., Benalcázar, M.E.: Sign language recognition using wearable electronics: implementing k-nearest neighbors with dynamic time warping and convolutional neural network algorithms. Sensors 20(14), 3879 (2020)
Shukor, A.Z., et al.: A new data glove approach for Malaysian sign language detection. Procedia Comput. Sci. 76, 60–67 (2015)
Stokoe, W.: Sign Language Structure. Linstok Press, Silver Spring, MD (1960)
Stokoe, W.C., Casterline, D.C., Croneberg, C.G.: A dictionary of American Sign Language on linguistic principles. Linstok Press (1976)
Swain, P.H., Hauska, H.: The decision tree classifier: design and potential. IEEE Trans. Geosci. Electron. 15(3), 142–147 (1977)
Vapnik, V., Chervonenkis, A.: On a class of algorithms of learning pattern recognition. Autom. Remote. Control. 25, 937–945 (1964)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Achenbach, P., Purdack, D., Wolf, S., Müller, P.N., Tregel, T., Göbel, S. (2022). Paper Beats Rock: Elaborating the Best Machine Learning Classifier for Hand Gesture Recognition. In: Söbke, H., Spangenberger, P., Müller, P., Göbel, S. (eds) Serious Games. JCSG 2022. Lecture Notes in Computer Science, vol 13476. Springer, Cham. https://doi.org/10.1007/978-3-031-15325-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-15325-9_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15324-2
Online ISBN: 978-3-031-15325-9
eBook Packages: Computer ScienceComputer Science (R0)