Mike Wu
ABSTRACT
Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points of input from several users simultaneously. However, apart from a few demonstration techniques [17], current user interfaces do not take advantage of this increased input bandwidth. We present a variety of multifinger and whole hand gestural interaction techniques for these displays that leverage and extend the types of actions that people perform when interacting on real physical tabletops. Apart from gestural input techniques, we also explore interaction and visualization techniques for supporting shared spaces, awareness, and privacy. These techniques are demonstrated within a prototype room furniture layout application, called RoomPlanner.
Supplemental Material
- 1. Bier, E., Stone, M., Pier, K., Buxton, W., & DeRose, T. (1993). Toolglass and Magic Lenses: The see-through interface. ACM SIGGRAPH Conference. p. 73-80. Google Scholar
Digital Library
- 2. Buxton, W., Chuncking and phrasing and the design of human-computer dialogues, in Readings in human-computer interaction: Towards the year 2000, R. Baecker, et al., Editors. 1986, Morgan Kaufmann: San Fransisco, CA. p. 494-499. Google ScholarDigital Library
- 3. Buxton, W., Living in augmented reality: Ubiquitous Media and Reactive Environments, in Video Mediated Communication, K. Finn, Sellen, A., Wilber, S., Editor. 1997, Erlbaum: Hillsdale, NJ. p. 363-384.Google Scholar
- 4. Callahan, J., Hopkins, D., Weiser, M., & Shneiderman, B. (1988). A comparative analysis of pie menu performance. ACM CHI Conference.Google Scholar
- 5. Dietz, P., & Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST Symposium on User Interface Software and Technology. p. 219-226. Google ScholarDigital Library
- 6. Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4). p. 486-517.Google ScholarCross Ref
- 7. Krueger, M., VIDEOPLACE and the interface of the future, in The art of human computer interface design, B. Laurel, Editor. 1991, Addison Wesley: Menlo Park, CA. p. 417-422.Google Scholar
- 8. Kurtenbach, G., & Buxton, W. (1993). The limits of expert performance using hierarchical marking menus. ACM CHI Conference. p. 35-42. Google ScholarDigital Library
- 9. Kurtenbach, G., Fitzmaurice, G., Baudel, T., & Buxton, W. (1997). The design of a GUI paradigm based on tablets, two-hands, and transparency. ACM CHI Conference. p. 35-42. Google ScholarDigital Library
- 10. Matsushita, N., Ayatsuka, Y., & Rekimoto, J. (2000). Dual touch: A two-handed interface for pen-based PDAs. ACM UIST Symposium on User Interface Software and Technology. p. 211-212. Google ScholarDigital Library
- 11. Myers, B. (1990). All the widgets. ACM SIGRAPH Video Review, CHI'90 Special Issue, 57.Google Scholar
- 12. Olsen, G., & Olsen, J. (2000). Distance matters. Human-Computer Interaction, 15(2&3). p. 139-178. Google ScholarDigital Library
- 13. Pierce, J., Stearns, B., & Pausch, R. (1999). Two handed manipulation of voodoo dolls in virtual environments. ACM Symposium on Interactive 3D Graphics. p. 141-145. Google ScholarDigital Library
- 14. Pook, S., Lecolinet, E., Vaysseix, G., & Barillot, E. (2000). Control menus: Execution and control in a single interactor. ACM CHI Conference, Extended Abstracts. p. 263-264. Google ScholarDigital Library
- 15. Rauterberg, M., Fjeld, M., Krueger, H., Bichsel, M., Leonhardt, U., & Meier, M. (1998). BUILD-IT: A planning tool for construction and design. ACM CHI Conference, Extended Abstracts. p. 177-178. Google ScholarDigital Library
- 16. Rekimoto, J. (2000). Multiple-computer interfaces: "Beyond the desktop" direct manipulation environments. ACM CHI Conference, Extended Abstracts. p. 6-7. Google ScholarDigital Library
- 17. Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI Conference. p. 113-120. Google ScholarDigital Library
- 18. Shen, C., Lesh, N., Vernier, F., Forlines, C., & Frost, J. (2002). A social sense of time: Sharing and building digital group histories. ACM CSCW Conference on Computer Supported Cooperative Work. p. 324-333. Google ScholarDigital Library
- 19. Stewart, J., Bederson, B., & Druin, A. (1999). Single display groupware: A model for copresent collaboration. ACM CHI Conference. p. 286-293. Google ScholarDigital Library
- 20. Streitz, N., Geißler, J., Holmer, T., Konomi, S.i., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., & Steinmetz, R. (1999). i-LAND: an interactive landscape for creativity and innovation. ACM CHI Conference. p. 120-127. Google ScholarDigital Library
- 21. Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., & Steinmetz, R. (2001). Connectables: dynamic coupling of displays for the flexible creation of shared workspaces. ACM UIST Symposium on User Interface Software and Technology. p. 11-20. Google ScholarDigital Library
- 22. Ullmer, B., & Ishii, H. (1997). The metaDESK: Models and prototypes for tangible user interfaces. ACM UIST Symposium on User Inteface Software and Technology. p. 223-232. Google ScholarDigital Library
- 23. Vernier, F., Lesh, N., & Shen, C. (2002). Visualization techniques for circular tabletop interfaces. Advanced Visual Interfaces. Google ScholarDigital Library
- 24. Wellner, P. (1993). Interacting with paper on the digital desk. Communications of the ACM, 36(7). p. 87-96. Google ScholarDigital Library
Index Terms
- Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays
Recommendations
Multi-finger gestural interaction with 3D volumetric displays
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersVolumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking
ACHI '08: Proceedings of the First International Conference on Advances in Computer-Human InteractionA rear-projection multi-touch tabletop display was augmented with hand tracking utilizing computer vision techniques. Touch detection by frustrated total internal reflection is useful for achieving interaction with tabletop displays, but the technique ...
Multi-finger gestural interaction with 3D volumetric displays
Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Comments