Abstract
Communication between the speaking and the non-speaking community has always been a difficult task. Millions of people in India suffer from the hearing or speaking impairment. This project provides a solution for these people to communicate with everybody else without any problem. It is an IoT based project, which converts hand gestures into synthesized textual format. The device consists of a glove with flex sensors all over the fingers to understand the orientation of the hand. When hands and fingers moved, words and numbers detected according to the movement. A bluetooth speaker attached to a Raspberry Pi that converts this text to speech. The device needs to be tested on a number of subjects for standardization of gestures. In current work only one hand is used for a gesture to speech conversion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Lokhande, P., Prajapati, R., Pansare, S.: Data gloves for sign language recognition system. IJCA (1), 11–14 (2015). Proceedings on National Conference on Emerging Trends in Advanced Communication Technologies NCETACT 2015
Sandler, W., Lillo-Martin, D.: Sign Language and Linguistic Universals. Cambridge University Press, Cambridge (2006)
Social Statistics Division: Disabled persons in india: a statistical profile. Government of India (2016). http://mospi.nic.in/sites/default/files/publication_reports/Disabled_persons_in_India_2016.pdf. Accessed 29 Jan 2019
Hearing Impairment, Rehab Council (2000). http://www.rehabcouncil.nic.in/writereaddata/HI-2-2000.pdf
Abraham, A., Article, R.V.: Real time conversion of sign language to speech and prediction of gestures using Artificial Neural Network. Procedia Comput. Sci. 143, 587–594 (2018)
Starner, T., Weaver, J., Pentland, A.: Real-time American sign language recognition using desk and wearable computer based video. IEEE Trans. Pattern Anal. Mach. Intell. 20(12), 1371–1375 (1998)
Bauer, B., Hienz, H., Kraiss, K.: Video-based continuous sign language recognition using statistical methods. In: Proceedings of the 15th International Conference on Pattern Recognition, ICPR-2000, pp. 463–466 (2000)
Bharath Academy. https://www.bharathacademy.org/2018/04/03/indian-sign-language/. Accessed 29 Jan 2019
Components101. https://components101.com/sensors/flex-sensor-working-circuit-datasheet. Accessed 20 Dec 2019
Electronicwings. https://www.electronicwings.com/sensors-modules/mpu6050-gyroscope-accelerometer-temperature-sensor-module. Accessed 25 Dec 2019
Teach me micro. https://www.teachmemicro.com/use-flex-sensor/. Accessed 20 Jan 2020
Electronicshub. https://www.electronicshub.org/interfacing-flex-sensor-with-arduino/. Accessed 31 Jan 2020
Inven sense document number: PS-MPU-6000A-00 revision: 3.4, 19 August 2013
Datasheet Raspberry Pi 4 model B, 26 June 2019
Arduino Pro mini 328-5 V/16Mhz datasheet (2019)
El-Naggar, A., Reichardt, D.: Analyzing hand therapy success in a web-based therapy system. In: Mensch & Computer Workshopband (2016)
Snippet from the video “Learn Indian Sign Language - BASIC 25 Words Part - 1”, Bumperclapent (2019)
Snippet from the video “Alphabets in Indian Sign Language”. Digital Arts Academy for the Deaf LLP (2019)
Acknowledgement
We would like to thank Mr. Anand for providing infrastructure and devices to do this project in VSigma IT Labs Pvt. Ltd, Madhapur, Hyderabad. We would also like to thank Mr. Sai P Sukumar for participating throughout the project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Koppuravuri, S., Pondari, S.S., Seth, D. (2020). Sign Language to Speech Converter Using Raspberry-Pi. In: Duffy, V. (eds) Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Communication, Organization and Work. HCII 2020. Lecture Notes in Computer Science(), vol 12199. Springer, Cham. https://doi.org/10.1007/978-3-030-49907-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-49907-5_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49906-8
Online ISBN: 978-3-030-49907-5
eBook Packages: Computer ScienceComputer Science (R0)