Abstract
This paper introduces the development of a multimodal data visualisation system and its evaluations. This system is designed to improve blind and visually impaired people’s access to graphs and tables. Force feedback, synthesized speech and non-speech audio are utilised to present graphical data to blind people. Through the combination of haptic and audio representations, users can explore virtual graphs rendered by a computer. Various types of graphs and tables have been implemented, and a three-stage evaluation has been conducted. The experimental results have proven the usability of the system and the benefits of the multimodal approach. The paper presents the details of the development and experimental findings, as well as the changes of role of haptics in the evaluation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Dimigen G, Roy AWN, Taylor M (1996) The entitlement, expertise and availability of information technology to visually impared students and graduates in Great Britain. In: INSERM, Paris, pp 18–20
Dimigen G, Scott F, Thackeray F, Pimm M, Roy AWN (1992) Do visually impaired school-leavers have different expectations from those of their sighted age mates? New Beacon 76:293
Dimigen G, Scott F, Thackeray F, Pimm M, Roy AWN (1993) Career expectations of British visually impaired students who are of school-leaving age. J Vis Impairment Blindness 87:209–210
Edman, PK (1991) Tactile graphics. American Foundation for the Blind, New York
Lee S, Wiker SF, Vanderheiden GC (1993) Interactive haptic interface: two-dimensional form perception for blind access to computers. In: Proceedings of the 5th international conference on human computer interaction, Orlando, Fla., 8–13 August 1993
Blenkhorn P, Evans DG (1998) Using speech and touch to enable blind people to access schematic diagrams. J Network Comput Appl 21:17–29
Roth P, Richoz D, Petrucci L, Pun T (2001) An audio-haptic tool for non-visual image representation. In: Proceedings of the sixth international symposium on signal processing and its applications, vol 1, Kuala Lumpur, Malaysia, 13–16 August 2001
Ramstein C, Martial O, Dufresne A, Carignan M, Chasse P, Mabilleau P (1996) Touching and hearing GUI’s: design issues for the PC-access system. In: Proceedings of the second annual ACM conference on assistive technologies. ACM Press, New York
Colwell C, Petrie H, Kornbrot D, Hardwick A, Furner S (1998) Haptic virtual reality for blind computer users. In: Proceedings of the third international ACM conference on assistive technologies. ACM Press, New York
Grabowski NA, Barner KE (1998) Data visualisation methods for the blind using force feedback and sonification. Proc SPIE 3524:131–139
Fritz JP, Barner KE (1999) Design of a haptic data visualisation system for people with visual impairments. IEEE Trans Rehabil Eng 7(3):372–384
Van Scoy F, Kawai T, Darrah M, Rash C (2000) Haptic display of mathematical functions for teaching mathematics to students with vision disabilities: design and proof of concept. In: Haptic human–computer interaction. Lecture notes in computer science, vol 2058. Springer, Berlin Heidelberg New York
Wies EF, Gardner JA, Sile O’Modhrain M, Hasser CJ, Bulatov VL (2001) Web-based touch display for accessible science education. In: Haptic human–computer interaction. Lecture notes in computer science, vol 2058. Springer, Berlin Heidelberg New York
Ramloll R, Yu W, Riedel B, Brewster SA (2001) Using non-speech sounds to improve access to 2D tabular numerical information for visually impaired users. In: Proceedings of BCS IHM-HCI 2001, Lille, France, 10–14 September 2001. Springer, Berlin Heidelberg New York
Brewster SA, Pengelly H (1998) Visual impairment, virtual reality and visualisation. In: First international workshop on usability evaluation for virtual environments, Leicester, UK, 17 December 1998
Yu W, Ramloll R, Brewster SA (2000) Haptic graphs for blind computer users. In: Haptic human–computer interaction. Lecture notes in computer science, vol 2058. Springer, Berlin Heidelberg New York
Hart SG, Wicken SC (1990) Workload assessment and predication. In: MANPRINT, an approach to systems integration. Van Nostrand Reinhold, New York
Pengelly HL (1998) Investigating the use of force-feedback devices in human–computer interaction. Masters dissertation, Department of Computing Science, University of Glasgow
Riedel B, Burton AM (2001) Perception of gradient in haptic graphs: a comparison of virtual and physical stimuli. In: Eurohaptics 2001 conference proceedings, Birmingham, UK, 1–4 July 2001
Hospital activity statistics. Department of Health. http://www.doh.gov.uk/hospitalactivity/index.htm. Cited 2 Febuary 2003
Challis BP, Edwards ADN (2001) Design principle for tactile interaction. In: Haptic human–computer interaction. Lecture notes in computer science, vol 2058. Springer, Berlin Heidelberg New York
National Centre for Tactile Diagrams, University of Hertfordshire, College Lane, Hatfield, Herts, AL10 9AB, UK
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Yu , W., Brewster , S. Evaluation of multimodal graphs for blind people. UAIS 2, 105–124 (2003). https://doi.org/10.1007/s10209-002-0042-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-002-0042-6