Jingtao Wang
Jennifer Mankoff
ABSTRACT
The graphical user interface (GUI) is today's de facto standard for desktop computing. GUIs are designed and optimized for use with a mouse and keyboard. However, modern trends make this reliance on a mouse and keyboard problematic for two reasons. First, people with disabilities may have trouble operating those devices. Second, with the popularization of wireless communication and mobile devices such as personal data assistants, the mouse and keyboard are often replaced by other input devices. Our solution is a tool that can be used to translate a user's input to a form recognizable by any Windows-based application. We argue that a formal model of input is necessary to support arbitrary translations of this sort. We present a model, based on Markov information sources, that extends past work in its ability to handle software-based input such as speech recognition, and to measure relative device bandwidth. We also present our translation tool, which is based on our model, along with four applications built using that tool.
- Abramson, N. Information Theory and Coding, McGraw-Hill Inc, 1963.Google Scholar
- Avantgo Mobile Channel. http://www.avantgo.comGoogle Scholar
- Barrett, R., and Maglio, P. P., Intermediaries: New places for producing and manipulating web content. In Proc. of WWW7, pp. 509--518. 1998. Google ScholarDigital Library
- Buxton, W. A., A Three-state Model of Graphical Input. Human-Computer Interaction. In Proc. of INTERACT '90. pp. 449--456, 1990. Google ScholarDigital Library
- Buyukkokten, O., Garcia-Molina, H., Paepcke, A., and Winograd, T., Power browser: efficient Web browsing for PDAs. In Proc. of CHI'00, pp. 430--437. 2000. Google ScholarDigital Library
- Card, S., Mackinlay, J., and Robertson, G., A Morphological Analysis of the Design Space of Input Devices. In ACM Transactions on Information Systems, 9(2):99--122. April 1991. Google ScholarDigital Library
- Grover, D. L., King, M. T., and Kuschler, C. A., Patent No. US5818437, Reduced keyboard disambiguating computer. Tegic Communications, Inc., Seattle, WA 1998.Google Scholar
- Hudson, S., and Newell, G., Probabilistic State Machines: Dialog Management for Inputs with Uncertainty. In Proc. of UIST '92, pp.199--208. 1992 Google ScholarDigital Library
- Krantz, S. G. "Jensen's Inequality", in Handbook of Complex Analysis. Birkhäuser. p. 118. 1999.Google Scholar
- Mankoff, J., Dey, A., Batra, U., and Moore, M., Web Accessibility for Low Bandwidth Input. In Proc. of ASSETS 2002, pp. 17--24. 2002. Google ScholarDigital Library
- Mankoff, J., Hudson S., and Abowd, G., Providing Integrated Toolkit-Level Support for Ambiguity in Recognition-Based Interfaces. In Proc. of CHI 2000, pp. 368--375. 2000. Google ScholarDigital Library
- Myers, B. and Kosbie, D., Reusable Hierarchical Command Objects. In Proc. of CHI '96, pp. 260--267. 1996. Google ScholarDigital Library
- Mynatt, E. D., and Edwards, W. K., Mapping GUIs to Auditory Interfaces, In Proc. of UIST '92, pp. 61--70. 1992 Google ScholarDigital Library
- Olsen, D., Hudson, S., Verratti, T., Heiner, J., and Phelps, M., Implementing interface attachments based on surface representations. In Proc. of CHI '99, pp. 191--198. 1999. Google ScholarDigital Library
- Olsen, D. R., Jefferies, S., Nielsen, T., Moyes, W. and Fredrickson, P., Cross-modal interaction using Xweb. In Proc. of UIST 2000, pp. 191--200. 2000. Google ScholarDigital Library
- Rudniky, A., and Hauptmann, A., Models for evaluating interaction protocols in speech recognition. In Proc. of CHI'91, pp. 285--291. 1991. Google ScholarDigital Library
- Smith, I. E., Support for Multi-Viewed Interfaces. Ph.D. Thesis, Georgia Institute of Technology, 1998. Google ScholarDigital Library
- User Interface Markup Language 3.0 http://www.uiml.org/specs/Google Scholar
Index Terms
- Theoretical and architectural support for input device adaptation
Recommendations
Theoretical and architectural support for input device adaptation
The graphical user interface (GUI) is today's de facto standard for desktop computing. GUIs are designed and optimized for use with a mouse and keyboard. However, modern trends make this reliance on a mouse and keyboard problematic for two reasons. ...
An architecture to improve the generalization of interacting device developments for accessibility
WebMedia '06: Proceedings of the 12th Brazilian Symposium on Multimedia and the webWhen used to support users with motor impairment, sensor-based interaction devices rely heavily on exploiting the available user movements to work properly. This implies that the design of sensor-based interaction devices depend on proper attending ...
Customization of sensor-based input devices
IHC '06: Proceedings of VII Brazilian symposium on Human factors in computing systemsThe literature reports many efforts with respect to facilitate building applications using non-traditional input devices --- for instance to support those designers who do not master the low level programming demanded for building sensor-based ...
Comments