Amy Ingram
ABSTRACT
Intuition is an important yet ill-defined factor when designing effective multi-touch interactions. Throughout the research community, there is a lack of consensus regarding both the nature of intuition and, more importantly, how to systematically incorporate it into the design of multi-touch gestural interactions. To strengthen our understanding of intuition, we surveyed various domains to determine the level of consensus among researchers, commercial developers, and the general public regarding which multi-touch gestures are intuitive, and which of these gestures intuitively lead to which interaction outcomes. We reviewed more than one hundred papers regarding multi-touch interaction, approximately thirty of which contained key findings we report herein. Based on these findings, we have constructed a framework of five factors that determine the intuition of multi-touch interactions, including direct manipulation, physics, feedback, previous knowledge, and physical motion. We further provide both design recommendations for multi-touch developers and an evaluation of research problems which remain due to the limitations of present research regarding these factors. We expect our survey and discussion of intuition will raise awareness of its importance, and lead to the active pursuit of intuitive multi-touch interaction design.
- Andrews, D. 2010. MTVis: Tree Exploration Using a Multi-Touch Interface. In Visualization and Data Analysis 2010, Proceedings of the SPIE, 7530. 2010.Google Scholar
- Apple Inc. iPad 2, 2011. Retrieved Nov. 21, 2011, from: http://www.apple.com/ipad/.Google Scholar
- Bartoschek, T. and Schwering, A. 2011. Usability testing of the interaction of novices with a multi-touch table in semi public space. In Proceedings of the 14th international conference on human-computer interaction: interaction techniques and environments (HCII'11), Vol. Part II. Springer-Verlag, Berlin, Heidelberg, 71--80. Google ScholarDigital Library
- Beaudouin-Lafon, M. 2004. Designing interaction, not interfaces. In Proceedings of the working conference on advanced visual interfaces (AVI '04). ACM, New York, NY, USA, 15--22. Google ScholarDigital Library
- Butkiewicz, T. and Ware, C. 2011. Exploratory Analysis of Ocean Flow Models with Stereoscopic Multi-Touch. In IEEE Visualization Posters.Google Scholar
- Epps, J., Lichman, S., and Wu, M. 2006. A study of hand shape use in tabletop gesture interaction. In CHI '06 extended abstracts on human factors in computing systems (CHI EA '06). ACM, New York, NY, USA, 748--753. Google ScholarDigital Library
- Frisch, M., Heydekorn, J., and Dachselt, R. 2009. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 149--156. Google ScholarDigital Library
- Fu, C., Goh, W., and Ng, J. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the 28th international conference on human factors in computing systems (CHI '10). ACM, New York, NY, USA, 2213--2222. Google ScholarDigital Library
- Hornecker, E. 'I don't understand it either, but it is cool'-visitor interactions with a multi-touch table in a museum. 2008 IEEE International Workshop on Horizontal Interactive Human Computer System (TABLETOP), IEEE, 113--120.Google Scholar
- Intuition. Retrieved March 31, 2012, from Merriam-Webster: http://www.merriam-webster.com/dictionary/intuition.Google Scholar
- Isenberg, P. and Fisher, D. 2009. Collaborative brushing and linking for co-located visual analytics of document collections. In Computer Graphics Forum, 28, 3, 1031--1038. Google ScholarDigital Library
- Koskinen, H., Laarni, J., and Honkamaa, P. 2008. Hands-on the process control: users preferences and associations on hand movements. In CHI '08 extended abstracts on human factors in computing systems (CHI EA '08). ACM, New York, NY, USA, 3063--3068. Google ScholarDigital Library
- Kristensson, P. O., Arnell, O., Björk, A., Dahlbäck, N., Pennerup, J., Prytz, E., Wikman, J., and Åström, N. 2008. InfoTouch: an explorative multi-touch visualization interface for tagged photo collections. In Proceedings of the 5th Nordic conference on human-computer interaction: building bridges (NordiCHI '08). ACM, New York, NY, USA, 491--494. Google ScholarDigital Library
- Lam, H. 2008. A Framework of Interaction Costs in Information Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 6 (November 2008), 1149--1156. Google ScholarDigital Library
- Lee, S. and Zhai, S. 2009. The performance of touch screen soft buttons. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 309--318. Google ScholarDigital Library
- Lundström, C., Rydell, T., Forsell, C., Persson, A. and Ynnerman, A. 2011. Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning. IEEE Trans. on Visualization and Computer Graphics 17, 12 (December 2011), 1775--1784. Google ScholarDigital Library
- Mauney, D., Howarth, J., Wirtanen, A., and Capra, M. 2010. Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA '10). ACM, New York, NY, USA, 4015--4020. Google ScholarDigital Library
- Murata, A. and Iwase, H. 2005. Usability of Touch-Panel Interfaces for Older Adults. Human Factors: The Journal of the Human Factors and Ergonomics Society, 47, 4, 767--776.Google ScholarCross Ref
- Noyes, J. 1983. The QWERTY keyboard: a review. International Journal of Man-Machine Studies, 18, 3, 265--281.Google ScholarCross Ref
- Pike, W., Stasko, J., Chang, R., and O'Connell, T. 2009. The science of interaction. Info. Vis. 8, 4 (Dec. 2009), 263--274. Google ScholarDigital Library
- Pirker, M., Bernhaupt, R., and Mirlacher, T. 2010. Investigating usability and user experience as possible entry barriers for touch interaction in the living room. In Proceedings of the 8th international interactive conference on Interactive TV & Video (EuroITV '10). ACM, New York, NY, USA, 145--154. Google ScholarDigital Library
- Ryall, K., Morris, M., Everitt, K., Forlines, C., and Shen, C. 2006. Experiences with and Observations of Direct-Touch Tabletops. In Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06). IEEE, Washington, DC, USA, 89--96. Google ScholarDigital Library
- Shneiderman, B. 1981. Direct manipulation: A step beyond programming languages. In Proceedings of the joint conference on easier and more productive use of computer systems. (Part II): Human interface and the user interface -- Vol. 1981 (CHI '81). ACM, New York, NY, USA. Google ScholarDigital Library
- Stößel, C. 2009. Familiarity as a factor in designing finger gestures for elderly users. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 78, 2 pages. Google ScholarDigital Library
- Tweedie, L. 2007. Proceedings of the SIGCHI conference on human factors in computing systems. (CHI '97). New York, New York, USA, 1997, pp. 375--382. Google ScholarDigital Library
- Verification in Visualization: Building a Common Culture. 2011. Retrieved December 6, 2011, from Visweek: http://visweek.org/visweek/2011.Google Scholar
- Wigdor, D., Fletcher, J., and Morrison, G. 2009. Designing user interfaces for multi-touch and gesture devices. In Proceedings of the 27th international conference extended abstracts on human factors in computing systems (CHI EA '09). ACM, New York, NY, USA, 2755--2758. Google ScholarDigital Library
- Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., and Benko, H. 2009. Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. In Proceedings of the 22nd annual ACM symposium on user interface software and technology (UIST '09). ACM, New York, NY, USA, 3--12. Google ScholarDigital Library
- Wobbrock, J., Morris, M., and Wilson, A. 2009. User-defined gestures for surface computing. In Proceedings of the 27th international conference on human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1083--1092. Google ScholarDigital Library
- Wroblewski, L. Touch Gesture Reference Guide, 2010. Retrieved Nov. 1, 2011 from: http://www.lukew.com/touch.Google Scholar
- Wu, M. and R. Balakrishnan, R. 2003. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proceedings of the 16th annual ACM symposium on user interface software and technology (UIST '03). ACM, New York, NY, USA, 193--202. Google ScholarDigital Library
Index Terms
- Towards the establishment of a framework for intuitive multi-touch interaction design
Recommendations
Towards a formalization of multi-touch gestures
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesMulti-touch is a technology which offers new styles of interaction compared to traditional input devices like keyboard and mouse. Users can quickly manipulate objects or execute commands by means of their fingers and hands. Current multi-touch ...
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineMulti-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Comments