Abstract
In this paper, we present a novel approach of recognizing hand number gestures using the recognized hand parts in a depth image. Our proposed approach is divided into two stages: (i) hand parts recognition by random forests (RFs) and (ii) rule-based hand number gestures recognition. In the first stage, we create a database (DB) of synthetic hand depth silhouettes and their corresponding hand parts-labeled maps and then train RFs with the DB. Via the trained RFs, we recognize or label the hand parts in a depth silhouette. In the second stage, based on the information of the recognized or labeled hand parts, hand number gestures are recognized according to our derived rules. In our experiments, we quantitatively and qualitatively evaluated our hand parts recognition system with synthetic and real data. Then, we tested our hand number gesture recognition system with real data. Our results show the average recognition rate of 97.80 % over the ten hand number gestures from five different subjects.
Similar content being viewed by others
References
Autodesk 3Ds MAX (2012)
Barkoky A, Charkari NM (2011) Static hand gesture recognition of Persian sign numbers using thinning method. In: Proceedings of international conference on multimedia technology (ICMT), pp 6548–6551
Breiman L (2001) Random forests. ML J 45 (1):5–32
Bui TD, Nguyen LT (2007) Recognizing postures in Vietnamese sign language with MEMS accelerometers. IEEE Sens J 7(5):707–712
Cabrera ME, Bogado JM, Fermin L, Acuna R, Ralev D (2012) Glove-based gesture recognition system. In: Proceedings of international conference on climbing and walking robots and the support technologies for mobile machines, pp 747–753
Dipietro L, Sabatini AM, Dario P (2008) A survey of glove-based systems and their applications. IEEE Trans Syst Man Cybern-Part C Appl Rev 38(4):461–482
Dominio F, Donadeo M, Marin G, Zanuttigh P, Cortelazzo GM (2013) Hand gesture recognition with depth data. In: Proceedings of ACM/IEEE international workshop on analysis and retrieval of tracked events and motion in imagery stream, pp 9–16
Elmezain M, Al-Hamadi A, Pathan SS, Michaelis B (2009) Spatio-temporal feature extraction-based hand gesture recognition for isolated American Sign Language and Arabic numbers. In: Proceedings of international symposium on image and signal processing and analysis, pp 254–259
Hasan H, Abdul-Kareem S (2013) Human-computer interaction using vision-based hand gesture recognition system: a survey. Neural Comput Appl 25(2):251–261
Hastie T, Tibshirani R, Friedman J (2008) The elements of statistical learning, 2nd edn. Springer, New York
Lamberti L, Camastra F (2012) Handy: a real-time three color glove-based gesture recognizer with learning vector quantization. Expert Syst Appl 39(12):10489–10494
Lepetit V, Lagger P, Fua P (2005) Randomized trees for real-time keypoint recognition. IEEE Comput Soc Conf Comput Vis Pattern Recognit 2:775–781
Liu X, Fujimura K (2004) Hand gesture recognition using depth data. In: Proceedings of IEEE international conference on automatic face and gesture recognition, pp 529–534
Murthy GRS, Jadon RS (2009) A review of vision based hand gestures recognition. Int J Inf Technol Knowl Manag 2(2):405–410
Oh JK, Cho SJ, Bang WC, Chang W, Choi ES, Yang J, Cho JK, Kim DY (2004) Inertial sensor based recognition of 3-D character gestures with an ensemble classifiers. In: Proceedings of the 9th international workshop on frontiers in handwriting recognition, pp 112–117
Otiniano-Rodríguez KC, Cámara-Chávez G, Menotti D (2012) Hu and Zernike moments for sign language recognition. In: Proceedings of international conference on image processing, computer vision, and pattern recognition, pp 1–5
Priyal S P, Bora P K (2010) A study on static hand gesture recognition using moments. In: Proceedings of international conference on signal processing and communications (SPCOM), pp 1–5
Priyal SP, Bora PK (2013) A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments. Pattern Recognit 46(8):2202–2219
Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using Kinect sensor. IEEE Trans. Trans Multimed 15(5):1110–1120
Shimada A, Yamashita T, Taniguchi RI (2013) Hand gesture based TV control system-towards both user- and machine-friendly gesture applications. In: Proceedings of 19th Korea-Japan joint workshop on frontiers of computer vision (FCV), pp 121–126
Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R (2013) Real-time human pose recognition in parts from single depth images. Commun ACM 56(1):116–124
Suarez J, Murphy RR (2012) Hand gesture recognition with depth images: a review. In: Proceedins of the 21st IEEE international symposium on robot and human interactive communication, pp 411–417
Swapna B, Pravin F, Rajiv VD (2011) Hand gesture recognition system for numbers using thresholding. Commun Comput Inf Sci 250:782–786
Tabata Y, Kuroda T, Okamoto K (2012) Development of a glove-type input device with the minimum number of sensors for Japanese finger spelling. In: Proceedings of international conference disability, virtual reality and associated technologies, pp 305–310
Vieriu RL, Goras B, Goras L (2011) On HMM static hand gesture recognition. In: Proceedings of 10th international symposium on signals, circuits and systems (ISSCS), pp 1–4
Wu CH, Lin CH (2013) Depth-based hand gesture recognition for home appliance control. In: Proceedings of IEEE 17th international symposium on consumer electronics, pp 279–280
Acknowledgments
This research was supported by the MSIP (Ministry of Science, ICT & Future Planning), Korea, under the ITRC (Information Technology Research Center) support program supervised by the NIPA (National IT Industry Promotion Agency (NIPA-2013-(H0301-13-2001)). This work was also supported by the Industrial Strategic Technology Development Program (10035348, Development of a Cognitive Planning and Learning Model for Mobile Platforms) funded by the Ministry of Knowledge Economy(MKE, Korea) and the Industrial Core Technology Development Program (10049079, Development of Mining core technology exploiting personal big data) funded by the Ministry of Trade, Industry and Energy (MOTIE, Korea)”
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Dinh, DL., Lee, S. & Kim, TS. Hand number gesture recognition using recognized hand parts in depth images. Multimed Tools Appl 75, 1333–1348 (2016). https://doi.org/10.1007/s11042-014-2370-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2370-y