Wilko Heuten
Daniel Wichmann
Susanne Boll
ABSTRACT
Blind or visually impaired people usually do not leave their homes without any assistance, in order to visit unknown cities or places. One reason for this dilemma is, that it is hardly possible for them to gain a non-visual overview about the new place, its landmarks and geographic entities already at home. Sighted people can use a printed or digital map to perform this task. Existing haptic and acoustic approaches today do not provide an economic way to mediate the understanding of a map and relations between objects like distance, direction, and object size. We are providing an interactive three-dimensional sonification interface to explore city maps. A blind person can build a mental model of an area's structure by virtually exploring an auditory map at home. Geographic objects and landmarks are presented by sound areas, which are placed within a sound room. Each type of object is associated with a different sound and can therefore be identified. By investigating the auditory map, the user perceives an idea of the various objects, their directions and relative distances. First user tests show, that users are able to reproduce a sonified city map, which comes close to the original visual city map. With our approach exploring a map with non-speech sound areas provide a new user interface metaphor that offers its potential not only for blind and visually impaired persons but also to applications for sighted persons.
- FMOD audio engine. http://www.fmod.org {Online; accessed 01-September-2006}.Google Scholar
- C. Adams. An investigation of navigation processes in human locomotion behavior. Master's thesis, Polytechnic Institute and State University Virgina, 1997.Google Scholar
- E. Brazil and M. Fernström. Investigating concurrent auditory icon recognition. In Proceedings of the 12th International Conference on Auditory Display, pages 51--58, 2006.Google Scholar
- B. Gallagher and W. Frasch. Tactile acoustic computer interaction system (TACIS): A new type of graphic access for the blind. Proc. of the 3rd TIDE Congress, 1998.Google Scholar
- Sendero Group. Sendero group - inventor of the blue-note gps, 2006. http://www.senderogroup.com {Online; accessed 01-September-2006}.Google Scholar
- G. Harrasser. Design eines für Blinde und Sehbehinderte geeigneten Navigationssystem mit taktiler Ausgabe. Diploma thesis, Technische Universität München Fakultät für Informatik, 2003. in German.Google Scholar
- N. Henze, W. Heuten, and S. Boll. Non-intrusive soma-tosensory navigation support for blind pedestrians. In EuroHaptics 2006, pages 459--464, 2006.Google Scholar
- S. Holland and Morse D. R. Audio GPS: Spatial Audio in a minimal attention interface. In 3rd International Workshop on HCI with Mobile Devices, 2001.Google Scholar
- M. Horstmann, W. Heuten, A. Miene, and S. Boll. Automatic annotation of geographic maps. In Computers Helping People with Special Needs, volume 4061/2006, pages 69--76. 10th International Conference, ICCHP 2006, Linz, Austria, July 11--13, 2006. Proceedings, Springer, 2006. Google ScholarDigital Library
- G. Kramer, B. Walker, T. Bonebright, P. Cook, J. Flowers, and N. Miner. The sonification report: Status of the field and research agenda, report prepared for the national science foundation by members of the international community for auditory display, 1999.Google Scholar
- T. Lokki and M. Gröhn. Navigation with auditory cues in a virtual environment. IEEE MultiMedia, 12(2):80--86, 2005. Google ScholarDigital Library
- D. K. McGookin and S. A. Brewser. Advantages and issues with concurrent audio presentation as part of an auditory display. In Proceedings of the 12th International Conference of Auditory Display, pages 44--50, 2006.Google Scholar
- The Grab Project Members. Grab, 2003. http://www.grab-eu.com/index.htm {Online; accessed 01-September-2006}.Google Scholar
- H. Petrie, V. Johnson, T. Strothotte, A. Raab, S. Fritz, and R. Michel. Mobic: Designing a travel aid for blind and elderly people. Journal of Navigation, Royal Institute of Navigation, 49(1):45--52, 1996.Google ScholarCross Ref
- K. Rassmus-Gröhn and C. Sjöström. Using a force feedback device to present graphical information to people with visual disabilities. In Second Swedish Symposium on Multimodal Communication, Lund, Sweden, 1998.Google Scholar
- D. A. Ross and B. B. Blasch. Wearable interfaces for orientation and wayfinding. ASSETS'00, pages 193--200, 2000. Google ScholarDigital Library
- K. Tsukada and M. Yasumura. Activebelt: Belt-type wearable tactile display for directional navigation. Lecture Notes in Computer Science, 3205:384--399, 2004.Google ScholarCross Ref
- B. N. Walker and J. Lindsay. Navigation performance with a virtual auditory display: Effects of beacon sound, capture radius, and practice. In Human Factors, volume 48(2), pages 265--278, 2006.Google Scholar
- Z. Wang and J. Ben-Arie. Conveying visual information with spatial auditory patterns. IEEE Transactions on Speech and Audio Processing, 4(6):446--455, 1996.Google ScholarCross Ref
- H. Zhao. Interactive sonification of geo-referenced data. In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1134--1135, New York, NY, USA, 2005. ACM Press. Google ScholarDigital Library
- H. Zhao, B. K. Smith, K. Norman, C. Plaisant, and B. Shneiderman. Interactive sonification of choropleth maps. IEEE MultiMedia, 12(2):26--35, 2005. Google ScholarDigital Library
Index Terms
- Interactive 3D sonification for the exploration of city maps
Recommendations
Interactive exploration of city maps with auditory torches
CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing SystemsCity maps are an important means to get an impression of the structure of cities. They represent visual abstraction of urban areas with different geographic entities, their locations, and spatial relations. However, this information is not sufficiently ...
Tangible user interface for the exploration of auditory city maps
HAID'07: Proceedings of the 2nd international conference on Haptic and audio interaction designBefore venturing out into unfamiliar areas, most people scope out a map. But for the blind or visually impaired traditional maps are not accessible. In our previous work, we developed the "Auditory Map" which conveys the location of geographic objects ...
Tangible User Interface for the Exploration of Auditory City Maps
Haptic and Audio Interaction DesignAbstractBefore venturing out into unfamiliar areas, most people scope out a map. But for the blind or visually impaired traditional maps are not accessible. In our previous work, we developed the “Auditory Map” which conveys the location of geographic ...
Comments