skip to main content
research-article

Bringing Things Closer: Enhancing Low-Vision Interaction Experience with Office Productivity Applications

Published:29 May 2021Publication History
Skip Abstract Section

Abstract

Many people with low vision rely on screen-magnifier assistive technology to interact with productivity applications such as word processors, spreadsheets, and presentation software. Despite the importance of these applications, little is known about their usability with respect to low-vision screen-magnifier users. To fill this knowledge gap, we conducted a usability study with 10 low-vision participants having different eye conditions. In this study, we observed that most usability issues were predominantly due to high spatial separation between main edit area and command ribbons on the screen, as well as the wide span grid-layout of command ribbons; these two GUI aspects did not gel with the screen-magnifier interface due to lack of instantaneous WYSIWYG (What You See Is What You Get) feedback after applying commands, given that the participants could only view a portion of the screen at any time. Informed by the study findings, we developed MagPro, an augmentation to productivity applications, which significantly improves usability by not only bringing application commands as close as possible to the user's current viewport focus, but also enabling easy and straightforward exploration of these commands using simple mouse actions. A user study with nine participants revealed that MagPro significantly reduced the time and workload to do routine command-access tasks, compared to using the state-of-the-art screen magnifier.

References

  1. Aries Arditi and Jianwei Lu. 2008. Accessible Web Browser Interface Design for Users with Low Vision. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 52, 6 (2008), 576--580. https://doi.org/10.1177/154193120805200614 arXiv: https://doi.org/10.1177/154193120805200614Google ScholarGoogle ScholarCross RefCross Ref
  2. Edward C Bell and Natalia M Mino. 2015. Employment outcomes for blind and visually impaired adults. (2015).Google ScholarGoogle Scholar
  3. Jeffrey P. Bigham. 2014. Making the Web Easier to See with Opportunistic Accessibility Improvement. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA)(UIST '14). ACM, New York, NY, USA, 117--122. https://doi.org/10.1145/2642918.2647357 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Syed Masum Billah, Vikas Ashok, Donald E. Porter, and I.V. Ramakrishnan. 2018. Steering Wheel: A Locality-Preserving Magnification Interface for Low Vision Web Browsing. In Proceedings of the 2018 CHI Conference on Human Factorsin Computing Systems(Montreal QC, Canada)(CHI '18). ACM, New York, NY, USA, Article 20, 13 pages. https://doi.org/10.1145/3173574.3173594 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Yevgen Borodin, Jeffrey P. Bigham, Glenn Dausch, and I. V. Ramakrishnan. 2010. More than Meets the Eye: A Survey of Screen-Reader Browsing Strategies. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)(Raleigh, North Carolina)(W4A '10). Association for Computing Machinery, New York, NY, USA, Article 13, 10 pages. https://doi.org/10.1145/1805986.1806005 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. James V. Bradley. 1958. Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design. J. Amer. Statist. Assoc. 53, 282 (1958), 525--528. https://doi.org/10.1080/01621459.1958.10501456arXiv: https://amstat.tandfonline.com/doi/pdf/10.1080/01621459.1958.10501456Google ScholarGoogle ScholarCross RefCross Ref
  7. Julian Brinkley and Nasseh Tabrizi. 2017. A Desktop Usability Evaluation of the Facebook Mobile Interface using the JAWS Screen Reader with Blind Users. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61, 1(2017), 828--832. https://doi.org/10.1177/1541931213601699 arXiv:https://doi.org/10.1177/1541931213601699Google ScholarGoogle ScholarCross RefCross Ref
  8. John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry189, 194 (1996), 4--7.Google ScholarGoogle Scholar
  9. D. G. Evans, T. Diggle, S. H. Kurniawan, and P. Blenkhorn. 2003. An investigation into formatting and layout errors produced by blind word-processor users and an evaluation of prototype error prevention and correction techniques. IEEE Transactions on Neural Systems and Rehabilitation Engineering11, 3 (Sept 2003), 257--268. https://doi.org/10.1109/TNSRE.2003.816868Google ScholarGoogle ScholarCross RefCross Ref
  10. Krzysztof Z. Gajos, Daniel S. Weld, and Jacob O. Wobbrock. 2010. Automatically generating personalized user interfaces with Supple.Artificial Intelligence 174, 12 (2010), 910 -- 950. https://doi.org/10.1016/j.artint.2010.05.005 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. 2007. Automatically Generating User Interfaces Adapted to Users' Motor and Vision Capabilities. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology(Newport, Rhode Island, USA)(UIST '07). ACM, New York, NY, USA, 231--240. https://doi.org/10.1145/1294211.1294253 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139 -- 183. https://doi.org/10.1016/S0166--4115(08)62386--9Google ScholarGoogle Scholar
  13. Apple Inc. 2020. Change Zoom preferences for accessibility on Mac - Apple Support. https://support.apple.com/guide/mac-help/change-zoom-preferences-for-accessibility-mh40579/mac.Google ScholarGoogle Scholar
  14. Julie A. Jacko, Armando B. Barreto, Gottlieb J. Marmet, Josey Y. M. Chu, Holly S. Bautsch, Ingrid U. Scott, and Robert H. Rosa, Jr. 2000. Low Vision: The Role of Visual Acuity in the Efficiency of Cursor Movement. In Proceedings of the Fourth International ACM Conference on Assistive Technologies(Arlington, Virginia, USA)(Assets '00). ACM, New York, NY, USA, 1--8. https://doi.org/10.1145/354324.354327 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Richard L. Kline and Ephraim P. Glinert. 1995. Improving GUI Accessibility for People with Low Vision. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(Denver, Colorado, USA)(CHI '95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 114--121. https://doi.org/10.1145/223904.223919 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Thomas Knack. 2012. Real-time content-aware video retargeting on the Android platform for tunnel vision assistance.(2012).Google ScholarGoogle Scholar
  17. Sri Hastuti Kurniawan, Alistair G Sutcliffe, and Paul Blenkhorn. 2003. How Blind Users' Mental Models Affect Their Perceived Usability of an Unfamiliar Screen Reader. In INTERACT, Vol. 3. 631--638.Google ScholarGoogle Scholar
  18. Jonathan Lazar, Aaron Allen, Jason Kleinman, and Chris Malarkey. 2007. What frustrates screen reader users on the web: A study of 100 blind users. International Journal of human-computer interaction 22, 3 (2007), 247--269.Google ScholarGoogle ScholarCross RefCross Ref
  19. Jingyi Li, Son Kim, Joshua A. Miele, Maneesh Agrawala, and Sean Follmer. 2019. Editing Spatial Layouts Through Tactile Templates for People with Visual Impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(Glasgow, Scotland Uk)(CHI '19). ACM, New York, NY, USA, Article 206, 11 pages. https://doi.org/10.1145/3290605.3300436 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. George Mamaladze. 2015. Global Mouse Key Hook. https://github.com/gmamaladze/globalmousekeyhook.Google ScholarGoogle Scholar
  21. Natalie Maus, Dalton Rutledge, Sedeeq Al-Khazraji, Reynold Bailey, Cecilia Ovesdotter Alm, and Kristen Shinohara. 2020. Gaze-Guided Magnification for Individuals with Vision Impairments. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(Honolulu, HI, USA)(CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382995 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Nihal Menzi-Çetin, Ecenaz Alemda?, Hakan Tüzün, and Merve Y?ld?z. 2017. Evaluation of a University Website's Usability for Visually Impaired Students.Univers. Access Inf. Soc.16, 1 (March 2017), 151--160. https://doi.org/10.1007/s10209-015-0430--3 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Microsoft. 2017. Office solutions development overview (VSTO). https://docs.microsoft.com/en-us/visualstudio/vsto/office-solutions-development-overview-vsto?view=vs-2019.Google ScholarGoogle Scholar
  24. Microsoft. 2019. Office primary interop assemblies - Visual Studio. https://docs.microsoft.com/en-us/visualstudio/vsto/office-primary-interop-assemblies?view=vs-2019.Google ScholarGoogle Scholar
  25. Microsoft. 2020. Use Magnifier to make things on the screen easier to see - Windows Help. https://support.microsoft.com/en-us/help/11542/windows-use-magnifier-to-make-things-easier-to-see.Google ScholarGoogle Scholar
  26. Lourdes Morales, Sonia M. Arteaga, and Sri Kurniawan. 2013. Design Guidelines of a Tool to Help Blind Authors Independently Format Their Word Documents. In CHI '13 Extended Abstracts on Human Factors in Computing Systems(Paris, France)(CHI EA '13). ACM, New York, NY, USA, 31--36. https://doi.org/10.1145/2468356.2468363 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Lourdes Moreno, Xabier Valencia, J. Eduardo Pérez, and Myriam Arrue. 2018. Exploring the Web Navigation Strategies of People with Low Vision. In Proceedings of the XIX International Conference on Human Computer Interaction(Palma, Spain)(Interacción 2018). Association for Computing Machinery, New York, NY, USA, Article 13, 8 pages. https://doi.org/10.1145/3233824.3233845 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Giulio Mori, Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Victor M. R. Penichet. 2011. Making "Google Docs" User Interface More Accessible for Blind People. In Advances in New Technologies, Interactive Interfaces, and Communicability. Springer Berlin Heidelberg, Berlin, Heidelberg, 20--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Thomas Rathfux, Jasmin Thöner, Hermann Kaindl, and Roman Popp. 2018. Combining Design-Time Generation of Web-Pages with Responsive Design for Improving Low-Vision Accessibility. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems(Paris, France)(EICS '18). Association for Computing Machinery, New York, NY, USA, Article 10, 7 pages. https://doi.org/10.1145/3220134.3220141 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Johnny Saldaña. 2015.The coding manual for qualitative researchers. Sage.Google ScholarGoogle Scholar
  31. Andreas Savakis, Mark Stump, Grigorios Tsagkatakis, Roy Melton, Gary Behm, and Gwen Sterns. 2012. Low vision assistance using face detection and tracking on android smartphones. In2012 IEEE 55th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE, 1176--1179.Google ScholarGoogle ScholarCross RefCross Ref
  32. Freedom Scientific. 2020. Zoom Text Screen Magnifier and Screen Reader - zoomtext.com. https://www.zoomtext.com/.Google ScholarGoogle Scholar
  33. Lee Stearns, Victor DeSouza, Jessica Yin, Leah Findlater, and Jon E. Froehlich. 2017. Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(Baltimore, Maryland, USA)(ASSETS '17). Association for Computing Machinery, New York, NY, USA, 361--362. https://doi.org/10.1145/3132525.3134812 Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Sarit Felicia Anais Szpiro, Shafeka Hashash, Yuhang Zhao, and Shiri Azenkot. 2016. How People with Low Vision Access Computing Devices: Understanding Challenges and Opportunities. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(Reno, Nevada, USA)(ASSETS '16). ACM, New York, NY, USA,171--180. https://doi.org/10.1145/2982142.2982168 Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Katie Wang, Laura G Barron, and Michelle R Hebl. 2010. Making those who cannot see look best: Effects of visual resume formatting on ratings of job applicants with blindness. Rehabilitation psychology 55, 1 (2010), 68.Google ScholarGoogle Scholar
  36. Hui-Yin Wu, Aurelie Calabrese, and Pierre Kornprobst. 2020.Towards Accessible News Reading Design in Virtual Reality for Low Vision. Research Report RR-9298. UCA; Inria. 20 pages. https://hal.inria.fr/hal-02321739Google ScholarGoogle Scholar
  37. Yuhang Zhao, Edward Cutrell, Christian Holz, Meredith Ringel Morris, Eyal Ofek, and Andrew D. Wilson. 2019. SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. In Proceedings of the 2019CHI Conference on Human Factors in Computing Systems(Glasgow, Scotland Uk)(CHI '19). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300341 Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Yuhang Zhao, Elizabeth Kupferstein, Doron Tal, and Shiri Azenkot. 2018. "It Looks Beautiful but Scary": How Low Vision People Navigate Stairs and Other Surface Level Changes. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility(Galway, Ireland)(ASSETS '18). Association for Computing Machinery, New York, NY, USA, 307--320. https://doi.org/10.1145/3234695.3236359 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Bringing Things Closer: Enhancing Low-Vision Interaction Experience with Office Productivity Applications

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Human-Computer Interaction
        Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue EICS
        EICS
        June 2021
        546 pages
        EISSN:2573-0142
        DOI:10.1145/3468527
        Issue’s Table of Contents

        Copyright © 2021 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 May 2021
        Published in pacmhci Volume 5, Issue EICS

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader