skip to main content
10.1145/3428361.3428391acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
short-paper

Challenges in Mobile Text Entry using Virtual Keyboards for Low-Vision Users

Published:22 November 2020Publication History

ABSTRACT

Mobile text entry for sighted and blind persons has received much research attention. However, much less is known about meeting the text entry needs of persons with low vision, whose ability to use the visual channel alongside audio, speech and haptic modalities, may open unexplored opportunities for efficient and privacy-preserving mobile text entry. We present findings from a qualitative study with 9 low vision users, revealing current text entry challenges for this user group, and providing future directions for text entry research.

References

  1. Ohoud Alharbi, Ahmed Sabbir Arif, Wolfgang Stuerzlinger, Mark D. Dunlop, and Andreas Komninos. 2019. WiseType: A tablet keyboard with color-coded visualization and various editing options for error correction. In Proceedings of graphics interface 2019(GI 2019). Canadian Information Processing Society. https://doi.org/10.20380/GI2019.04 Citation Key: Alharbi:2019:10.20380/GI2019.04 ISSN: 0713-5424 number-of-pages: 10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mrim Alnfiai and Srinivas Sampalli. 2016. SingleTapBraille: Developing a Text Entry Method Based on Braille Patterns Using a Single Tap. Procedia Computer Science 94 (2016), 248 – 255. https://doi.org/10.1016/j.procs.2016.08.038 The 11th International Conference on Future Networks and Communications (FNC 2016) / The 13th International Conference on Mobile Systems and Pervasive Computing (MobiSPC 2016) / Affiliated Workshops.Google ScholarGoogle ScholarCross RefCross Ref
  3. Vassilios Argyropoulos, Andrea Hathazi, and Magda Nikolaraizi. 2019. Undergraduate Student Education Programs Regarding Braille Literacy: A Transnational Comparative Study. Higher Education Studies 9, 4 (2019), 44–57.Google ScholarGoogle ScholarCross RefCross Ref
  4. A. S. Arif and W. Stuerzlinger. 2009. Analysis of text entry performance metrics. In 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). 100–105. https://doi.org/10.1109/TIC-STH.2009.5444533Google ScholarGoogle ScholarCross RefCross Ref
  5. Jan Balata and Zdenek Mikovec. 2016. Why Visually Impaired People Resist to Adopt Touchscreen Smartphones in the Czech Republic?. In 2016 7th IEEE International Conference on Cognitive Infocommunications (CogInfoCom). 000049–000054. https://doi.org/10.1109/CogInfoCom.2016.7804523Google ScholarGoogle ScholarCross RefCross Ref
  6. Nikola Banovic, Varun Rao, Abinaya Saravanan, Anind K. Dey, and Jennifer Mankoff. 2017. Quantifying Aversion to Costly Typing Errors in Expert Mobile Text Entry. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, 4229–4241. https://doi.org/10.1145/3025453.3025695Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Nikola Banovic, Koji Yatani, and Khai N. Truong. 2013. Escape-Keyboard: A Sight-Free One-Handed Text Entry Method for Mobile Touch-screen Devices. International Journal of Mobile Human Computer Interaction 5, 3 (July 2013), 42–61. https://doi.org/10.4018/jmhci.2013070103Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Rachel Bartlett, Yi Xuan Khoo, Juan Pablo Hourcade, and Kyle K. Rector. 2019. Exploring the Opportunities for Technologies to Enhance Quality of Life with People who have Experienced Vision Loss. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, 1–8. https://doi.org/10.1145/3290605.3300421Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Matthew N. Bonner, Jeremy T. Brudvik, Gregory D. Abowd, and W. Keith Edwards. 2010. No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry. In Pervasive Computing, Patrik Floréen, Antonio Krüger, and Mirjana Spasojevic (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 409–426.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Emeline Brulé, Brianna J. Tomlinson, Oussama Metatla, Christophe Jouffrais, and Marcos Serrano. 2020. Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, 1–14. https://doi.org/10.1145/3313831.3376749Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Xiang Anthony Chen, Tovi Grossman, and George Fitzmaurice. 2014. Swipeboard: A Text Entry Technique for Ultra-Small Interfaces That Supports Novice to Expert Transitions. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 615–620. https://doi.org/10.1145/2642918.2647354Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Mark Dunlop, Andreas Komninos, Emma Nicol, and Iain Hamiliton. 2014. Shake “n” Tap: a gesture enhanced keyboard for older adults. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services(MobileHCI ’14). Association for Computing Machinery, 525–530. https://doi.org/10.1145/2628363.2634227Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Agebson Rocha Façanha, Windson Viana, Mauro Cavalcante Pequeno, Márcia de Borba Campos, and Jaime Sánchez. 2014. Touchscreen Mobile Phones Virtual Keyboarding for People with Visual Disabilities. In Human-Computer Interaction. Applications and Services, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 134–145.Google ScholarGoogle Scholar
  14. Xinhui Jiang, Yang Li, Jussi P.P. Jokinen, Viet Ba Hirvola, Antti Oulasvirta, and Xiangshi Ren. 2020. How We Type: Eye and Finger Movement Strategies in Mobile Typing. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, 1–14. https://doi.org/10.1145/3313831.3376711Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Akif Khan and Shah Khusro. 2020. An insight into smartphone-based assistive solutions for visually impaired and blind people: issues, challenges and opportunities. Universal Access in the Information Society (Jul 2020). https://doi.org/10.1007/s10209-020-00733-8Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Andreas Komninos, Emma Nicol, and Mark D. Dunlop. 2015. Designed with Older Adults to SupportBetter Error Correction in SmartPhone Text Entry: The MaxieKeyboard. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct(MobileHCI ’15). ACM, 797–802. https://doi.org/10.1145/2786567.2793703Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jianwei Lai, Dongsong Zhang, Sen Wang, Isil Doga Yakut Kilic, and Lina Zhou. 2019. ThumbStroke: A Virtual Keyboard in Support of Sight-Free and One-Handed Text Entry on Touchscreen Mobile Devices. ACM Trans. Manage. Inf. Syst. 10, 3, Article 11 (Sept. 2019), 19 pages. https://doi.org/10.1145/3343858Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Elke Mattheiss, Georg Regal, Johann Schrammel, Markus Garschall, and Manfred Tscheligi. 2014. Dots and Letters: Accessible Braille-Based Text Input for Visually Impaired People on Mobile Touchscreen Devices. In Computers Helping People with Special Needs, Klaus Miesenberger, Deborah Fels, Dominique Archambault, Petr Peňáz, and Wolfgang Zagler (Eds.). Springer International Publishing, Cham, 650–657.Google ScholarGoogle Scholar
  19. Emma Nicol, Andreas Komninos, and Mark D. Dunlop. 2016. A Participatory Design and Formal Study Investigation into Mobile Text Entry for Older Adults. International Journal of Mobile Human Computer Interaction (IJMHCI) 8, 2 (Apr 2016), 20–46. https://doi.org/10.4018/IJMHCI.2016040102.oaGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hugo Nicolau, Kyle Montague, Tiago Guerreiro, André Rodrigues, and Vicki L. Hanson. 2015. HoliBraille: Multipoint Vibrotactile Feedback on Mobile Devices. In Proceedings of the 12th Web for All Conference (Florence, Italy) (W4A ’15). Association for Computing Machinery, New York, NY, USA, Article 30, 4 pages. https://doi.org/10.1145/2745555.2746643Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Hugo Nicolau, Kyle Montague, Tiago Guerreiro, André Rodrigues, and Vicki L. Hanson. 2017. Investigating Laboratory and Everyday Typing Performance of Blind Users. ACM Transactions on Accessible Computing 10, 1 (March 2017), 4:1–4:26. https://doi.org/10.1145/3046785Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen, and Per Ola Kristensson. 2013. Improving Two-Thumb Text Entry on Touchscreen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2765–2774. https://doi.org/10.1145/2470654.2481383Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Gulnar Rakhmetulla and Ahmed Sabbir Arif. 2020. Senorita: A Chorded Keyboard for Sighted, Low Vision, and Blind Mobile Users. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376576Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. André Rodrigues, Kyle Montague, Hugo Nicolau, and Tiago Guerreiro. 2015. Getting Smartphones to Talkback: Understanding the Smartphone Adoption Process of Blind Users. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility(ASSETS ’15). Association for Computing Machinery, Lisbon, Portugal, 23–32. https://doi.org/10.1145/2700648.2809842Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. André Rodrigues, Hugo Nicolau, Kyle Montague, João Guerreiro, and Tiago Guerreiro. 2020. Open Challenges of Blind People Using Smartphones. International Journal of Human–Computer Interaction 0, 0 (Jun 2020), 1–18. https://doi.org/10.1080/10447318.2020.1768672Google ScholarGoogle ScholarCross RefCross Ref
  26. Huniya Shahid, Munam Ali Shah, Bilal Khalid Dar, and Fizzah Fizzah. 2018. A Review of Smartphone’s Text Entry for Visually Impaired. In 2018 24th International Conference on Automation and Computing (ICAC). 1–7. https://doi.org/10.23919/IConAC.2018.8749128Google ScholarGoogle Scholar
  27. Weinan Shi, Chun Yu, Shuyi Fan, Feng Wang, Tong Wang, Xin Yi, Xiaojun Bi, and Yuanchun Shi. 2019. VIPBoard: Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, Glasgow, Scotland Uk, 1–12. https://doi.org/10.1145/3290605.3300747Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sarit Felicia Anais Szpiro, Shafeka Hashash, Yuhang Zhao, and Shiri Azenkot. 2016. How People with Low Vision Access Computing Devices: Understanding Challenges and Opportunities. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’16). Association for Computing Machinery, 171–180. https://doi.org/10.1145/2982142.2982168Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Tetsuya Watanabe, Hirotsugu Kaga, Makoto Kobayashi, and Kazunori Minatani. 2019. [Paper] Touchscreen Text Entry Methods Used by Blind and Low Vision Users. ITE Transactions on Media Technology and Applications 7, 3(2019), 134–141. https://doi.org/10.3169/mta.7.134Google ScholarGoogle ScholarCross RefCross Ref
  30. Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and future mobile and wearable device use by people with visual impairments. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI ’14. ACM Press, Toronto, Ontario, Canada, 3123–3132. https://doi.org/10.1145/2556288.2557085Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    MUM '20: Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia
    November 2020
    353 pages
    ISBN:9781450388702
    DOI:10.1145/3428361

    Copyright © 2020 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 22 November 2020

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • short-paper
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate190of465submissions,41%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format