Francis Quek
ABSTRACT
Students who are blind are typically one to three years behind their seeing counterparts in mathematics and science. We posit that a key reason for this resides in the inability of such students to access multimodal embodied communicative behavior of mathematics instructors. This impedes the ability of blind students and their teachers to maintain situated communication. In this paper, we set forth the relevant phenomenological analyses to support this claim. We show that mathematical communication and instruction are inherent embodied; that the blind are able to conceptualize visuo-spatial information; and argue that uptake of embodied behavior is critical to receiving relevant mathematical information. Based on this analysis, we advance an approach to provide students who are blind with awareness of their teachers' deictic gestural activity via a set of haptic output devices. We lay forth a set of open research question that researcher in multimodal interfaces may address.
- Williams, J. M., Nationwide shortage of teachers for blind students must be corrected. National Federation of the Blind: Advocates for Equality, Canadian Blind Monitor, 2002. 14.Google Scholar
- McNeill, D. and S. Duncan, Growth points in thinking-for-speaking, in Language & Gesture, D. McNeill, Editor. 2000, Cambridge University Press: Cambridge, MA. p. 141--161.Google ScholarCross Ref
- McNeill, D., Gesture and language dialectic. Acta Linguistica Hafniensia, 2002. 34: p. 7--37.Google Scholar
- Beattie, G. and H. Shovelton, Iconic hand gestures and the predictability of words in context in spontaneous speech. British Journal of Psychology, 2000. 91: p. 473--491.Google Scholar
- Beattie, G., Visible Thought: The New Psychology of body Language. 2003, Hove: Routledge.Google Scholar
- Furuyama, N., Gestural interaction between the instructor and the learner in origami instruction, in Language and gesture. 2000, Cambridge U. Press: Cambridge. p. 99--117.Google Scholar
- Penrose, R., The Emporer's New Mind. 1989, New York: Oxford University Press.Google Scholar
- McNeill, D., Hand and Mind: What Gestures Reveal about thought. 1992, Chicago: University of Chicago Press.Google Scholar
- Smith, N., Gesture and Beyond, in Cognitive Science. 2003, University of California at: Berkeley.Google Scholar
- Haber, R. N., Haber, L. R., Levin, C. A. and Hollyfield, R., Properties of spatial representations: Data from sighted and blind subjects. Percept. & Psychophysics, 1993. 54: p. 1--13.Google Scholar
- Millar, S., Movement cues and body orientation in recall of locations by blind and sighted children. Quarterly Journal of Psychology, 1985(A 37): p. 257--279.Google Scholar
- Landau, B., E. Spelke, and H. Gleitman, Spatial knowledge in a young blind child. Cognition, 1984. 16: p. 225--260.Google Scholar
- Kennedy, J. M., Drawing and the Blind. 1993, New Haven, CT: Yale Press.Google Scholar
- Iverson, J. M. and S. Goldin-Meadow, Why people gesture as they speak. Nature, 1998. 396: p. 228.Google Scholar
- Heller, M. A., Tactile picture perception in sighted and blind people. Behavioural Brain Research, 2002. 135: p. 65--68.Google Scholar
- Craig, R. H., Learning the Nemeth Braille Code: A Manual for Teachers. 1980, Salt Lake City: Brigham Young University Press.Google Scholar
- Eramian, M. G., et al. Talking Tactile Diagrams. in Universal Access in HCI: Inclusive Design in the Information Society, Proceedings of HCI International 2003. 2003. Hersonissos, Crete, Greece.Google Scholar
- Williams, A., E. Kabish, and P. Dourish. From Interaction to Participation: Configuring Space through Embodied Interaction. in Proc. Intl. Conf. Ubiquitous Computing (Ubicomp 2005). 2005. Tokyo, Japan. Google ScholarDigital Library
- Tall, D., A Theory of Mathematical Growth through Embodiment, Symbolism and Proof, in International Colloquium on Mathematical Learning from Early Childhood to Adulthood. 2005: Nevellis,Belguim.Google Scholar
Index Terms
- Embodiment and multimodality
Recommendations
Enabling multimodal communications for enhancing the ability of learning for the visually impaired
ICMI '06: Proceedings of the 8th international conference on Multimodal interfacesStudents who are blind are typically one to three years behind their seeing counterparts in mathematics and science. We posit that a key reason for this resides in the inability of such students to access multimodal embodied communicative behavior of ...
Levels of embodiment: linguistic analyses of factors influencing hri
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot InteractionIn this paper, we investigate the role of physical embodiment of a robot and its degrees of freedom in HRI. Both factors have been suggested to be relevant in definitions of embodiment, and so far we do not understand their effects on the way people ...
The Role of Embodiment and Simulation in Evaluating HCI: Theory and Framework
Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body, Motion and BehaviorAbstractIn this paper, we argue that embodiment can play an important role in the evaluation of systems developed for Human Computer Interaction. To this end, we describe a simulation platform for building Embodied Human Computer Interactions (EHCI). This ...
Comments