Abstract
Learning text entry systems is challenging, yet necessary. Many layouts and keyboards exist, but they rely on laborious learning techniques. Passive haptic learning (PHL) has already demonstrated some benefit for learning the Braille text entry system. Could this computing-enabled technique be used to improve desktop keyboard typing skills? It is unknown whether passive haptic training can improve speed on a motor task (as opposed to initial learning). We use a randomized numeric keypad to examine users’ typing performance with or without passive haptic training. When users were prevented from looking at the keyboard, the PHL group demonstrated consistent accuracy (-0.011 KSPC) while those in the control group greatly increased their error (+1.26 KSPC on average). This result is consistent with the finding that PHL users looked significantly less at the keyboard. In a second, longer study, users exposed to PHL were found to significantly improve their typing speed (mean increase of 11 WPM) versus control (mean increase of 2.2 WPM).
- Xiaojun Bi, Barton A Smith, and Shumin Zhai. 2010. Quasi-qwerty soft keyboard optimization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 283--286. Google ScholarDigital Library
- Stephen Brewster, Faraz Chohan, and Lorna Brown. 2007. Tactile Feedback for Mobile Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 159--162. Google ScholarDigital Library
- Thomas Allen Bullock, Lorraine C Schmertzing, and D Education Center. 2010. Instructional experiences of fifth grade students with keyboarding instruction. PDF accessed on November 1 (2010).Google Scholar
- Becky Chwirka, Burke Gurney, and Patricia A Burtner. 2002. Keyboarding and visual-motor skills in elementary students: A pilot study. Occupational Therapy in Health Care 16, 2-3 (2002), 39--51.Google ScholarCross Ref
- Edward Clarkson, James Clawson, Kent Lyons, and Thad Starner. 2005. An empirical study of typing rates on mini-QWERTY keyboards. In CHI extended abstracts on Human factors in computing systems. ACM, 1288--1291. Google ScholarDigital Library
- William E Cooper. 1983. Cognitive aspects of skilled typewriting. Springer Science 8 Business Media.Google Scholar
- Arindam Das and Wolfgang Stuerzlinger. 2007. A cognitive simulation model for novice text entry on cell phone keypads. In Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore! ACM, 141--147. Google ScholarDigital Library
- Ludovic Dovat, Olivier Lambercy, Roger Gassert, Thomas Maeder, Ted Milner, Teo Chee Leong, and Etienne Burdet. 2008. HandCARE: a cable-actuated rehabilitation system to train hand function after stroke. Transactions on Neural Systems and Rehabilitation Engineering 16, 6 (2008), 582--591.Google ScholarCross Ref
- David Feygin, Madeleine Keehner, and R Tendick. 2002. Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS. IEEE, 40--47. Google ScholarDigital Library
- Julia K. Harpole. 2015. 5 Things you Should Know Before you Consider Court Reporting School. https://stenofabulous.com/2015/01/5-things-you-should-know-before-you-consider-court-reporting-school. (2015). Accessed: 2017-4-24.Google Scholar
- Lynda S. Hartman. 2005. Handwriting / Keyboarding Rates. http://www.qiat.org/docs/resourcebank/hwriting_kybding_rate_info.pdf, (2005). Accessed: 2017-4-24.Google Scholar
- Lynda S. Hartman. 2005. Typing Agent Keys to Keyboarding Success. http://wis.cromwell.k12.ct.us/common/pages/DisplayFile.aspx?itemId=1919671, (2005). Accessed: 2017-4-24.Google Scholar
- Kevin Huang, Ellen Yi-Luen Do, and Thad Starner. 2008. PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills. In Proceedings of the International Symposium on Wearable Computers (ISWC). IEEE, 41--44. Google ScholarDigital Library
- Kevin Huang, Thad Starner, Ellen Do, Gil Weiberg, Daniel Kohlsdorf, Claas Ahlrichs, and Ruediger Leibrandt. 2010. Mobile music touch: mobile tactile stimulation for passive learning. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 791--800. Google ScholarDigital Library
- Seungwoo Je, Brendan Rooney, Liwei Chan, and Andrea Bianchi. 2017. tactoRing: A Skin-Drag Discrete Display. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3106--3114. Google ScholarDigital Library
- Gavin Jenkins. 2015. Hanging Out with America’s Elite, Underappreciated Court Reporters. https://www.vice.com/en_us/article/hanging-out-with-americas-elite-underappreciated-court-reporters-812. (2015). Accessed: 2017-4-24.Google Scholar
- Daniel Kohlsdorf and Thad Starner. 2010. Mobile music touch: The effect of primary tasks on passively learning piano sequences. In Proceedings of the International Symposium on Wearable Computers (ISWC). IEEE, 1--8.Google ScholarCross Ref
- Katherine J Kuchenbecker, Jonathan Fiene, and Günter Niemeyer. 2006. Improving contact realism through event-based haptic feedback. Transactions on visualization and computer graphics 12, 2 (2006), 219--230. Google ScholarDigital Library
- Ville Lehtinen, Antti Oulasvirta, Antti Salovaara, and Petteri Nurmi. 2012. Dynamic tactile guidance for visual search tasks. In Proceedings of the 25th annual symposium on User interface software and technology. ACM, 445--452. Google ScholarDigital Library
- Craig Edwin Lewiston. 2008. MaGKeyS: A haptic guidance keyboard system for facilitating sensorimotor training and rehabilitation. Ph.D. Dissertation. Citeseer.Google Scholar
- Jenna Lüttgen and Herbert Heuer. 2013. The influence of robotic guidance on different types of motor timing. Journal of motor behavior 45, 3 (2013), 249--258.Google ScholarCross Ref
- Kent Lyons, Daniel Plaisted, and Thad Starner. 2004. Expert chording text entry on the twiddler one-handed keyboard. In Proceedings of the International Symposium on Wearable Computers (ISWC), Vol. 1. IEEE, 94--101. Google ScholarDigital Library
- I Scott MacKenzie and Kumiko Tanaka-Ishii. 2010. Text entry systems: Mobility, accessibility, universality. Morgan Kaufmann. Google ScholarDigital Library
- Edgar Matias, I Scott MacKenzie, and William Buxton. 1993. Half-QWERTY: A one-handed keyboard facilitating skill transfer from QWERTY. In Proceedings of the INTERACT and CHI Conference on Human Factors in Computing Systems. ACM, 88--94. Google ScholarDigital Library
- Edgar Matias, I. Scott MacKenzie, and William Buxton. 1996. One-handed Touch Typing on a QWERTY Keyboard. Human-Computer Interact. 11, 1 (March 1996), 1--27. Google ScholarDigital Library
- Everett M Rogers. 2010. Diffusion of innovations. Simon and Schuster.Google Scholar
- Harriet Rogers, Jody Laehn, Anne Lang, Deb OfiLeary, and Mary Sommers. 2003. The status of elementary keyboarding: A longitudinal study. Unpublished research study, Whitewater, WI: UW-Whitewater (2003).Google Scholar
- Janet Rogers and Jane Case-Smith. 2002. Relationships between handwriting and keyboarding performance of sixth-grade students. American Journal of Occupational Therapy 56, 1 (2002), 34--39.Google ScholarCross Ref
- Jesse Sargent, Stephen Dopkins, John Philbeck, and David Chichka. 2010. Chunking in spatial memory. Journal of Experimental Psychology: Learning, memory, and cognition 36, 3 (2010), 576.Google ScholarCross Ref
- Caitlyn Seim, John Chandler, Kayla DesPortes, Siddharth Dhingra, Miru Park, and Thad Starner. 2014. Passive haptic learning of Braille typing. In Proceedings of the International Symposium on Wearable Computers. ACM, 111--118. Google ScholarDigital Library
- Caitlyn Seim, Tanya Estes, and Thad Starner. 2015. Towards Passive Haptic Learning of piano songs. In World Haptics Conference (WHC). IEEE, 445--450.Google ScholarCross Ref
- Caitlyn Seim, Saul Reynolds-Haertle, Sarthak Srinivas, and Thad Starner. 2016. Tactile taps teach rhythmic text entry: passive haptic learning of morse code. In Proceedings of the International Symposium on Wearable Computers. ACM, 164--171. Google ScholarDigital Library
- Caitlyn E Seim, David Quigley, and Thad E Starner. 2014. Passive haptic learning of typing skills facilitated by wearable computers. In CHI Extended Abstracts on Human Factors in Computing Systems. ACM, 2203--2208. Google ScholarDigital Library
- Charles H Shea, Qin Lai, Charles Black, and Jin-Hoon Park. 2000. Spacing practice sessions across days benefits the learning of motor skills. Human movement science 19, 5 (2000), 737--760.Google Scholar
- Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomic Bulletin 8 Review 20, 1 (2013), 21--53.Google Scholar
- Daniel Spelmezan, Deepak Ranjan Sahoo, and Sriram Subramanian. 2017. Sparkle: Hover Feedback with Touchable Electric Arcs. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3705--3717. Google ScholarDigital Library
- Evan Strasnick, Jessica R Cauchard, and James A Landay. 2017. BrushTouch: Exploring an Alternative Tactile Method for Wearable Haptics. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3120--3125. Google ScholarDigital Library
- Jane Bruner Wallace. 2000. The Effects of Color-Coding on Keyboarding Instruction of Third Grade Students. (2000).Google Scholar
- Behymer-J. Waner, K. and S. McCrary. 1992. Two points of view on elementary school keyboarding. Business Education Forum, 27--29.Google Scholar
- Bernhard Weber, Simon Schätzle, Thomas Hulin, Carsten Preusche, and Barbara Deml. 2011. Evaluation of a vibrotactile feedback device for spatial guidance. In World Haptics Conference (WHC). IEEE, 349--354.Google ScholarCross Ref
- Camille K Williams and Heather Carnahan. 2014. Motor Learning Perspectives on HapticTraining for the Upper Extremities. Transactions on Haptics 7, 2 (2014), 240--250. Google ScholarDigital Library
- Xiaoli Yang, Youn K Kim, Qian Wu, and Qing Chen. 2006. Hand function training in haptic virtual environment. In Proceedings of the International Conference on Mechatronics and Automation. IEEE, 395--399.Google ScholarCross Ref
Index Terms
- Passive Haptic Training to Improve Speed and Performance on a Keypad
Recommendations
Investigating Retention in Passive Haptic Learning of Piano Songs
Passive haptic learning (PHL) is a phenomenon where one is able to acquire new motor skills through repeated haptic stimuli applied to the body without paying active attention to learning. In the following work, we investigated the retention of ...
Passive haptic learning for vibrotactile skin reading
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable ComputersThis paper investigates the effects of using passive haptic learning to train the skill of comprehending text from vibrotactile patterns. The method of transmitting messages, skin-reading, is effective at conveying rich information but its active ...
Towards haptic learning on a smartwatch
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable ComputersHaptic technology can be used as a tool for learning. Can even the haptic elements in a smartwatch teach a new skill? Here we present a case of using a smartwatch for passive tactile learning. We use the Sony Smartwatch 3 to teach users Morse code while ...
Comments