Abstract
The recent innovation in the technology and introduction of new gesture control based devices, like leap motion controller, have revolutionized computing. Technology that can track finger and hand gestures accurately at very low cost can reshape the gesture control industry. Leap motion controller, a little USB device, has an ability to obtain accurate description of the hand and figures pose that can be used for Recognition of Pakistan Sign Language. Sign Language is very crucial to facilitate deaf and mute children to communicate with the society. This paper proposes a gesture based recognition system for Pakistan Sign Language using leap motion device. Our proposed system compromises of two modules training module and communication module. In training module motion data received from leap motion controller is used to train the system for Pakistan Sign Language. Than in communication module motion data is acquired through leap motion controller and fed into correlation algorithm to detect and recognize the sign and then convert it into text form. The proposed system provides an efficient and cost effective solution to communication problem of deaf and mute children.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Akram, Bushra, and Rukhsana Bashir. “Special Education and Deaf Children in Pakistan: An Overview.” Journal of Elementary Education 22.2 (2012): 33-44.
Husain, Z. (2003). A study of self-image of deaf community in Lahore. Unpublished Master’s Thesis: Department of special education; University of Punjab, Lahore.
Khatoon, A. (2003). A historical and evaluative study of special. Doctoral Thesis: Special Education Department, University of Karachi, Karachi.
Majeed, Z., & Saeed, A. (1998). Evaluation of the audiological services available in special schools in Pakistan: Journal of Special Education, 1 (1), 33-40.
G. Marin, F. Dominio and P. Zanuttigh, “Hand gesture recognition with leap motion and kinect devices,” 2014 IEEE International Conference on Image Processing (ICIP), Paris, (2014), pp. 1565-1569. doi: 10.1109/ICIP.2014.7025313
Chai, Xiujuan, et al. “Sign language recognition and translation with kinect.” IEEE Conf. on AFGR. (2013).
Raees, Muhammad, Sehat Ullah, Sami Ur Rahman, and Ihsan Rabbi. “Image based recognition of Pakistan sign language.” Journal of Engineering Research 4, no. 1 (2016).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Raziq, N., Latif, S. (2017). Pakistan Sign Language Recognition and Translation System using Leap Motion Device. In: Xhafa, F., Barolli, L., Amato, F. (eds) Advances on P2P, Parallel, Grid, Cloud and Internet Computing. 3PGCIC 2016. Lecture Notes on Data Engineering and Communications Technologies, vol 1. Springer, Cham. https://doi.org/10.1007/978-3-319-49109-7_87
Download citation
DOI: https://doi.org/10.1007/978-3-319-49109-7_87
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49108-0
Online ISBN: 978-3-319-49109-7
eBook Packages: EngineeringEngineering (R0)