skip to main content
10.1145/3411764.3445106acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing

Published:07 May 2021Publication History

ABSTRACT

Typing on wearables while situationally impaired, such as while walking, is challenging. However, while HCI research on wearable typing is diverse, existing work focuses on stationary scenarios and fine-grained input that will likely perform poorly when users are on-the-go. To address this issue we explore single-handed wearable typing using intra-hand touches between the thumb and fingers, a modality we argue will be robust to the physical disturbances inherent to input while mobile. We first examine the impact of walking on performance of these touches, noting no significant differences in accuracy or speed, then feed our study data into a multi-objective optimization process in order to design keyboard layouts (for both five and ten keys) capable of supporting rapid, accurate, comfortable, and unambiguous typing. A final study tests these layouts against QWERTY baselines and reports performance improvements of up to 10.45% WPM and 39.44% WER when users type while walking.

References

  1. Sunggeun Ahn, Seongkook Heo, and Geehyuk Lee. 2017. Typing on a Smartwatch for Smart Glasses. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS ’17). Association for Computing Machinery, New York, NY, USA, 201–209. https://doi.org/10.1145/3132272.3134136Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Joanna Bergstrom-Lehtovirta, Antti Oulasvirta, and Stephen Brewster. 2011. The Effects of Walking Speed on Target Acquisition on a Touchscreen Interface. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/2037373.2037396Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, and Shumin Zhai. 2012. Bimanual Gesture Keyboard. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 137–146. https://doi.org/10.1145/2380116.2380136Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Xiaojun Bi, Barton A. Smith, and Shumin Zhai. 2010. Quasi-Qwerty Soft Keyboard Optimization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 283–286. https://doi.org/10.1145/1753326.1753367Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Xiaojun Bi and Shumin Zhai. 2016. IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 49–58. https://doi.org/10.1145/2858036.2858421Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Blank and K. Deb. 2020. Pymoo: Multi-Objective Optimization in Python. IEEE Access 8(2020), 89497–89509.Google ScholarGoogle ScholarCross RefCross Ref
  7. J. Blank and K. Deb. 2020. A Running Performance Metric and Termination Criterion for Evaluating Evolutionary Multi- and Many-objective Optimization Algorithms. In 2020 IEEE Congress on Evolutionary Computation (CEC). 1–8.Google ScholarGoogle Scholar
  8. Roger Boldu, Alexandru Dancu, Denys J.C. Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction (Berlin, Germany) (SUI ’18). Association for Computing Machinery, New York, NY, USA, 150–157. https://doi.org/10.1145/3267782.3267796Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Thorsten Brants and Alex Franz. 2006. Web 1T 5-gram Version 1. http://www. ldc. upenn. edu/Catalog/CatalogEntry. jsp? catalogId= LDC2006T13(2006).Google ScholarGoogle Scholar
  10. Brian X Chen. 2019. Texting While Walking Is Dangerous. Here’s How to Stop.The New York Times (Nov 2019). https://www.nytimes.com/2019/11/13/technology/personaltech/distracted-walking-twalking.htmlGoogle ScholarGoogle Scholar
  11. James Clawson, Thad Starner, Daniel Kohlsdorf, David P. Quigley, and Scott Gilliland. 2014. Texting While Walking: An Evaluation of Mini-Qwerty Text Input While on-the-Go. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (Toronto, ON, Canada) (MobileHCI ’14). Association for Computing Machinery, New York, NY, USA, 339–348. https://doi.org/10.1145/2628363.2628408Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2(2002), 182–197.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. David Dobbelstein, Gabriel Haas, and Enrico Rukzio. 2017. The Effects of Mobility, Encumbrance, and (Non-)Dominant Hand on Interaction with Smartwatches. In Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (ISWC ’17). Association for Computing Machinery, New York, NY, USA, 90–93. https://doi.org/10.1145/3123021.3123033Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Mark Dunlop and Andrew Crossan. 2000. Predictive Text Entry Methods for Mobile Phones. Personal Technologies 4 (08 2000). https://doi.org/10.1007/BF01324120Google ScholarGoogle ScholarCross RefCross Ref
  15. Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3334480.3382888Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Anna Maria Feit. 2018. Assignment Problems for Optimizing Text Input. Ph.D. Dissertation. Aalto University. http://urn.fi/URN:ISBN:978-952-60-8016-1Google ScholarGoogle Scholar
  17. Leah Findlater and Jacob Wobbrock. 2012. Personalized Input: Improving Ten-Finger Touchscreen Typing through Automatic Adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 815–824. https://doi.org/10.1145/2207676.2208520Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Gene V Glass, Percy D. Peckham, and James R. Sanders. 1972. Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance. Review of Educational Research 42, 3 (1972), 237–288. https://doi.org/10.3102/00346543042003237 arXiv:https://doi.org/10.3102/00346543042003237Google ScholarGoogle ScholarCross RefCross Ref
  19. Jun Gong, Zheer Xu, Qifan Guo, Teddy Seyed, Xiang ’Anthony’ Chen, Xiaojun Bi, and Xing-Dong Yang. 2018. WrisText: One-Handed Text Entry on Smartwatch Using Wrist Gestures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173755Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jun Gong, Xing-Dong Yang, and Pourang Irani. 2016. WristWhirl: One-Handed Continuous Smartwatch Input Using Wrist Gestures. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 861–872. https://doi.org/10.1145/2984511.2984563Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Tovi Grossman, Xiang Anthony Chen, and George Fitzmaurice. 2015. Typing on Glasses: Adapting Text Entry to Smart Eyewear. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 144–152. https://doi.org/10.1145/2785830.2785867Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 59–70. https://doi.org/10.1145/2858036.2858052Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, and Daniel Vogel. 2019. RotoSwype: Word-Gesture Typing Using a Ring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300244Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jibo He, Jason S. McCarley, Kirsten Crager, Murtuza Jadliwala, Lesheng Hua, and Sheng Huang. 2018. Does wearable device bring distraction closer to drivers? Comparing smartphones and Google Glass. Applied Ergonomics 70(2018), 156 – 166. https://doi.org/10.1016/j.apergo.2018.02.022Google ScholarGoogle ScholarCross RefCross Ref
  25. Eve Hoggan, Stephen A. Brewster, and Jody Johnston. 2008. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 1573–1582. https://doi.org/10.1145/1357054.1357300Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Joggi Hong, Seongkook Heo, Poika Isokoski, and Geehyuk Lee. 2016. Comparison of Three QWERTY Keyboards for a Smartwatch. Interacting with Computers 28, 6 (10 2016), 811–825. https://doi.org/10.1093/iwc/iww003 arXiv:https://academic.oup.com/iwc/article-pdf/28/6/811/7920055/iww003.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  27. Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1526–1537. https://doi.org/10.1145/2858036.2858483Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, and Yong Jeong. 2017. Smartwatch Wearing Behavior Analysis: A Longitudinal Study. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 60 (Sept. 2017), 31 pages. https://doi.org/10.1145/3131892Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. Hifinger: One-handed text entry technique for virtual environments based on touches between fingers. Sensors 19, 14 (2019), 3063.Google ScholarGoogle ScholarCross RefCross Ref
  30. Shaun K. Kane, Jacob O. Wobbrock, and Ian E. Smith. 2008. Getting off the Treadmill: Evaluating Walking User Interfaces for Mobile Devices in Public Spaces(MobileHCI ’08). Association for Computing Machinery, New York, NY, USA, 109–118. https://doi.org/10.1145/1409240.1409253Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Hsin-Liu (Cindy) Kao, Artem Dementyev, Joseph A. Paradiso, and Chris Schmandt. 2015. NailO: Fingernails as an Input Surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3015–3018. https://doi.org/10.1145/2702123.2702572Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Andreas Karrenbauer and Antti Oulasvirta. 2014. Improvements to Keyboard Optimization with Integer Programming. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 621–626. https://doi.org/10.1145/2642918.2647382Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Keiko Katsuragawa, Ju Wang, Ziyang Shan, Ningshan Ouyang, Omid Abari, and Daniel Vogel. 2019. Tip-Tap: Battery-Free Discrete 2D Fingertip Input. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1045–1057. https://doi.org/10.1145/3332165.3347907Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Junhyeok Kim, William Delamare, and Pourang Irani. 2018. ThumbText: Text Entry for Wearable Devices Using a Miniature Ring. In Proceedings of Graphics Interface 2018 (Toronto, Ontario) (GI 2018). Canadian Human-Computer Communications Society / Société canadienne du dialogue humain-machine, 18 – 25. https://doi.org/10.20380/GI2018.04Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Andreas Komninos and Mark Dunlop. 2014. Using a smart-watch as a input device for text. IEEE Pervasive Computing 13 (01 2014).Google ScholarGoogle Scholar
  36. DoYoung Lee, SooHwan Lee, and Ian Oakley. 2020. Nailz: Sensing Hand Input with Touch Sensitive Nails. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376778Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing Socially Acceptable Hand-to-Face Input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 711–723. https://doi.org/10.1145/3242587.3242642Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Lik Hang Lee, Kit Yung Lam, Tong Li, Tristan Braud, Xiang Su, and Pan Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 94 (Sept. 2019), 27 pages. https://doi.org/10.1145/3351252Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Luis A. Leiva, Alireza Sahami, Alejandro Catala, Niels Henze, and Albrecht Schmidt. 2015. Text Entry on Tiny QWERTY Soft Keyboards. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 669–678. https://doi.org/10.1145/2702123.2702388Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Gregory Lesher, Bryan Moulton, and Jeffery Higginbotham. 1999. Optimal character arrangements for ambiguous keyboards. IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society 6 (01 1999), 415–23. https://doi.org/10.1109/86.736156Google ScholarGoogle ScholarCross RefCross Ref
  41. Haiko Luepsen. 2017. The aligned rank transform and discrete variables: A warning. Communications in Statistics - Simulation and Computation 46, 9(2017), 6923–6936. https://doi.org/10.1080/03610918.2016.1217014 arXiv:https://doi.org/10.1080/03610918.2016.1217014Google ScholarGoogle ScholarCross RefCross Ref
  42. I. Scott MacKenzie. [n.d.]. 2016. A note on calculating text entry speed. (2016). https://www.yorku.ca/mack/RN-TextEntrySpeed.htmlGoogle ScholarGoogle Scholar
  43. I. Scott MacKenzie and Shawn X. Zhang. 1999. The Design and Evaluation of a High-Performance Soft Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 25–31. https://doi.org/10.1145/302979.302983Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Donald McMillan, Barry Brown, Airi Lampinen, Moira McGregor, Eve Hoggan, and Stefania Pizza. 2017. Situating Wearables: Smartwatch Use in Context. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3582–3594. https://doi.org/10.1145/3025453.3025993Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Sachi Mizobuchi, Mark Chignell, and David Newton. 2005. Mobile Text Entry: Relationship between Walking Speed and Text Input Task Difficulty. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (Salzburg, Austria) (MobileHCI ’05). Association for Computing Machinery, New York, NY, USA, 122–128. https://doi.org/10.1145/1085777.1085798Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Aske Mottelson, Christoffer Larsen, Mikkel Lyderik, Paul Strohmeier, and Jarrod Knibbe. 2016. Invisiboard: Maximizing Display and Input Space with a Full Screen Text Entry Method for Smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 53–59. https://doi.org/10.1145/2935334.2935360Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Josip Musić and Roderick Murray-Smith. 2016. Nomadic Input on Mobile Devices: The Influence of Touch Input Technique and Walking Speed on Performance and Offset Modeling. Human–Computer Interaction 31, 5 (2016), 420–471. https://doi.org/10.1080/07370024.2015.1071195 arXiv:https://doi.org/10.1080/07370024.2015.1071195Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Alexander Ng, John Williamson, and Stephen Brewster. 2015. The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 536–546. https://doi.org/10.1145/2785830.2785853Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Peter Norvig. 2009. Natural language corpus data. Beautiful data (2009), 219–242.Google ScholarGoogle Scholar
  50. D. R. O’Day and R. A. Calix. 2013. Text message corpus: Applying natural language processing to mobile device forensics. In 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW). 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  51. Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: A Diminutive Qwerty Soft Keyboard Using Iterative Zooming for Ultra-Small Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2799–2802. https://doi.org/10.1145/2470654.2481387Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen, and Per Ola Kristensson. 2013. Improving Two-Thumb Text Entry on Touchscreen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2765–2774. https://doi.org/10.1145/2470654.2481383Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Roberto Refinetti. 1996. Demonstrating the Consequences of Violations of Assumptions in between-Subjects Analysis of Variance. Teaching of Psychology 23, 1 (1996), 51–54. https://doi.org/10.1207/s15328023top2301_14Google ScholarGoogle ScholarCross RefCross Ref
  54. Rufat Rzayev, Paweł W. Woundefinedniak, Tilman Dingler, and Niels Henze. 2018. Reading on Smart Glasses: The Effect of Text Position, Presentation Type and Walking. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3173574.3173619Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F. Yuksel, I. Scott MacKenzie, and Robert J.K. Jacob. 2016. DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 575–582. https://doi.org/10.1145/2984511.2984591Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Miika Silfverberg, I. Scott MacKenzie, and Panu Korhonen. 2000. Predicting Text Entry Speed on Mobile Phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI ’00). Association for Computing Machinery, New York, NY, USA, 9–16. https://doi.org/10.1145/332040.332044Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Gaganpreet Singh, William Delamare, and Pourang Irani. 2018. D-SWIME: A Design Space for Smartwatch Interaction Techniques Supporting Mobility and Encumbrance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174208Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Brian A. Smith, Xiaojun Bi, and Shumin Zhai. 2015. Optimizing Touchscreen Keyboards for Gesture Typing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3365–3374. https://doi.org/10.1145/2702123.2702357Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces(Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/3279778.3279799Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Despina Stavrinos, Katherine W Byington, and David C Schwebel. 2011. Distracted walking: cell phones increase injury risk for college pedestrians. Journal of safety research 42, 2 (2011), 101–107.Google ScholarGoogle ScholarCross RefCross Ref
  61. Craig Stewart, Michael Rohs, Sven Kratz, and Georg Essl. 2010. Characteristics of Pressure-Based Input for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 801–810. https://doi.org/10.1145/1753326.1753444Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Colton Turner, Barbara Chaparro, and Jibo He. 2020. Typing on a Smartwatch While Mobile: A Comparison of Input Methods. Human Factors: The Journal of the Human Factors and Ergonomics Society (02 2020), 001872081989129. https://doi.org/10.1177/0018720819891291Google ScholarGoogle ScholarCross RefCross Ref
  63. Katia Vega and Hugo Fuks. 2014. Beauty Tech Nails: Interactive Technology at Your Fingertips. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction(Munich, Germany) (TEI ’14). Association for Computing Machinery, New York, NY, USA, 61–64. https://doi.org/10.1145/2540930.2540961Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Keith Vertanen and Per Kristensson. 2019. Mining, analyzing, and modeling text written on mobile devices. Natural Language Engineering (10 2019), 1–33. https://doi.org/10.1017/S1351324919000548Google ScholarGoogle ScholarCross RefCross Ref
  65. Keith Vertanen and Per Ola Kristensson. 2011. A Versatile Dataset for Text Entry Evaluations Based on Genuine Mobile Emails. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). Association for Computing Machinery, New York, NY, USA, 295–298. https://doi.org/10.1145/2037373.2037418Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015. PalmType: Using Palms as Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 153–160. https://doi.org/10.1145/2785830.2785886Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben, and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-Air Visuals and Wrist-Worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 716–721. https://doi.org/10.1145/3025453.3025852Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (Sept. 2017), 21 pages. https://doi.org/10.1145/3130978Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Jacob O. Wobbrock. 2019. Situationally-Induced Impairments and Disabilities. Springer London, London, 59–92. https://doi.org/10.1007/978-1-4471-7440-0_5Google ScholarGoogle ScholarCross RefCross Ref
  70. Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Pui Chung Wong, Kening Zhu, and Hongbo Fu. 2018. FingerT9: Leveraging Thumb-to-Finger Interaction for Same-Side-Hand Text Entry on Smartwatches. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173752Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). Association for Computing Machinery, New York, NY, USA, 47–50. https://doi.org/10.1145/2817721.2817737Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376306Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 883–899. https://doi.org/10.1145/3332165.3347865Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi, and Yuanchun Shi. 2017. COMPASS: Rotational Keyboard on Non-Touch Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 705–715. https://doi.org/10.1145/3025453.3025454Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Xin Yi, Chun Yu, Mingrui Zhang, Sida Gao, Ke Sun, and Yuanchun Shi. 2015. ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology(Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 539–548. https://doi.org/10.1145/2807442.2807504Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Chun Yu, Ke Sun, Mingyuan Zhong, Xincheng Li, Peijun Zhao, and Yuanchun Shi. 2016. One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 71–82. https://doi.org/10.1145/2858036.2858542Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Shumin Zhai, Michael Hunter, and Barton A. Smith. 2002. Performance Optimization of Virtual Keyboards. Human–Computer Interaction 17, 2-3 (2002), 229–269. https://doi.org/10.1080/07370024.2002.9667315 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/07370024.2002.9667315Google ScholarGoogle ScholarCross RefCross Ref
  79. Shumin Zhai and Per Ola Kristensson. 2008. Interlaced QWERTY: Accommodating Ease of Visual Search and Input Flexibility in Shape Writing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 593–596. https://doi.org/10.1145/1357054.1357149Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Shengdong Zhao, Pierre Dragicevic, Mark Chignell, Ravin Balakrishnan, and Patrick Baudisch. 2007. Earpod: Eyes-Free Menu Selection Using Touch Input and Reactive Audio Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1395–1404. https://doi.org/10.1145/1240624.1240836Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
      May 2021
      10862 pages
      ISBN:9781450380966
      DOI:10.1145/3411764

      Copyright © 2021 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 May 2021

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format