Abstract
This paper proposes an effective and wearable mobility aid aimed at improving the quality of life of people suffering for visual disabilities by enabling autonomous and safe navigation in unknown environments. Our system relies on dense and accurate depth maps, provided in real-time by a compact stereo vision system mapped into an FPGA, in order to detect obstacles in front of the user and to provide accordingly vibration feedbacks as well as audio information by means of a bone-conductive speakers. Compared to most approaches with similar purposes, even in the current prototype arrangement deployed for testing, our system is extremely compact, lightweight and energy efficient thus enabling hours of safe and autonomous navigation with standard batteries avoiding the need to carry cumbersome devices. Moreover, by conceiving the 3D sensing device as a replacement of standard glasses typically worn by visually impaired people and by using intuitive feedbacks provided by means of lightweight actuators, our system provides an ergonomic and comfortable user interface with a fast learning curve for its effective deployment. This fact has been extensively verified on the field by means of an experimental evaluation, in indoor as well as in outdoor environments, with different users simulating visual impairment including a blind person.
Chapter PDF
Similar content being viewed by others
References
Loomis, J.M., Golledge, R.G., Klatzky, R.L.: Navigation system for the blind - auditory display modes and guidance. Presence 7(2), 193–203 (1998)
Ran, L., Helal, S., Moore, S.: Drishti: an integrated indoor/outdoor blind navigation system and service. In: Proc. of the Second IEEE Annual Conference on Pervasive Computing and Communications (2004)
Helal, A.S., Moore, S.E., Ramachandran, B.: Drishti: An Integrated Navigation System for Visually Impaired and Disabled. In: ISWC 2001: Proceedings of the 5th IEEE International Symposium on Wearable Computers (2001)
Ceipidor, B.U., Medaglia, C.M., Rizzo, F., Serbanati, A.: RadioVirgilio/Sesamonet:an RFID-based navigation system for visually impaired. In: MobileGuide (2006). http://mobileguide06.di.unito.it/programma.html
Bourbakis, N.G., Kavraki, D.: An intelligent assistant for navigation of visually impaired people. In: Proceedings of the 2nd IEEE International Symposium on Bioinformatics and Bioengineering (2001)
Shah, C., Bouzit, M., Youssef, M., Vasquez, L.: Evaluation of ru-netra - tactile feedback navigation system for the visually impaired. In: 2006 International Workshop on Virtual Rehabilitation, pp. 72–77 (2006)
Ito, K., Okamoto, M., Akita, J., Ono, T., Gyobu, I., Takagi, T., Hoshi, T., Mishima, Y.: Cyarm: an alternative aid device for blind persons. In: CHI 2005 (2005)
Cardin, S., Thalmann, D., Vexo, F.: Wearable system for mobility improvement of visually impaired people. In: In Visual Computer journal (2006)
Ni, D., Wang, L., Ding, Y., Zhang, J., Song, A., Wu, J.: The design and implementation of a walking assistant system with vibrotactile indication and voice prompt for the visually impaired. In: ROBIO (2013)
Arcara, P., Di Stefano, L., Mattoccia, S., Melchiorri, C., Vassura, G.: Perception of depth information by means of a wire-actuated haptic interface. In: In IEEE Int. Conf. on Robotics and Automation (2000)
Zelek, J., Audette, R., Balthazaar, J., Dunk, C.: A stereo-vision system for the visually impaired. University of Waterloo, Technical report (2000)
Balakrishnan, G., Sainarayanan, G., Nagarajan, R., Yaacob, S.: Wearable real-time stereo vision for the visually impaired
Sanz, P.R., Mezcua, B.R., Pena, J.M.S., Walker, B.N., Tipton, S.J., White II, D.J., Sershon, C., Choi, Y.B., Yu, F., Zhang, J., et al.: 1 evaluation of the sonification protocol of an artificial vision system for the visually impaired. Evaluation (2014)
Hub, A., Diepstraten, J., Ertl, T.: Augmented indoor modeling for navigation support for the blind. In: Conference Proceedings: CPSN 2005 - The International Conference on Computers for People with Special Needs, Las Vegas (2005)
Rodríguez, A., Bergasa, L., Alcantarilla, P., Yebes, J., Cela, A.: Obstacle avoidance system for assisting visually impaired people. In: IEEE Intelligent Vehicles Symposium, Proceedings of Workshop Perception in Robotics (2012)
Dakopoulos, D., Boddhu, S.K., Bourbakis, N.G.: A 2d vibration array as an assistive device for visually impaired. In: BIBE (2007)
Fernandes, H., Costa, P., Filipe, V., Hadjileontiadis, L., Barroso, J.F.: Stereo vision in blind navigation assistance. In: 2010 World Automation Congress, WAC 2010 (2010)
Szeliski, R.: Computer Vision: Algorithms and Applications, 1st edn. Springer-Verlag New York Inc., New York, NY, USA (2010)
Velázquez, R.: Wearable Assistive Devices for the Blind. Issues and Characterization, Wearable and Autonomous Biomedical Devices and Systems for Smart Environment (2010)
Kaczmarek, K.A., Webster, J.G., Bach-y Rita, P., Tompkins, W.J.: Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering (1991)
Meers, S., Ward, K.: A vision system for providing 3d perception of the environment via transcutaneous electro-neural stimulation. In: IV (2004)
Johnson, L.A., Higgins, C.M.: A navigation aid for the blind using tactile-visual sensory substitution. Conf Proc IEEE Eng Med Biol Soc (2006)
Huang, B., Liu, N.: Mobile navigation guide for the visually disabled. Journal of the Transportation Research Board 2004, 28–34 (1885)
Hard-Kernel: Odroid u3. http://hardkernel.com/main/main.php
Arduino: Arduino due. http://www.arduino.cc
Mattoccia, S.: Stereo vision algorithms for fpgas. In: The 9th IEEE Embedded Vision Workshop, CVPR 2013 Workshop (2013)
Mattoccia, S., Marchio, I., Casadio, M.: A compact 3d camera suited for mobile and embedded vision applications. In: The Fourth IEEE Workshop on Mobile Vision, CVPR 2014 Workshop (2014)
Zabih, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: Proceedings of the Third European Conference-Volume II on Computer Vision - Volume II, pp. 151–158. ECCV 1994 (1994)
Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)
Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(6), 381–395 (1981)
Labayrade, R., Aubert, D.: In-vehicle obstacles detection and characterization by stereovision. In: Proceedings the 1st International Workshop on In-Vehicle Cognitive Computer Vision Systems, pp. 13–19 (2003)
Raguram, R., Chum, O., Pollefeys, M., Matas, J., Frahm, J.M.: Usac: A universal framework for random sample consensus. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 2022–2038 (2013)
Matas, J., Chum, O.: Randomized ransac with td, d test. Image Vision Comput. 22(10), 837–842 (2004)
Torr, P.H.S., Zisserman, A.: Mlesac: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78, 2000 (2000)
Choi, S., Kim, T., Yu, W.: Performance evaluation of ransac family. In: BMVC (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Mattoccia, S., Macrı’, P. (2015). 3D Glasses as Mobility Aid for Visually Impaired People. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8927. Springer, Cham. https://doi.org/10.1007/978-3-319-16199-0_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-16199-0_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16198-3
Online ISBN: 978-3-319-16199-0
eBook Packages: Computer ScienceComputer Science (R0)