Noora Alsakar
Yasmeen Abdrabou
Simone Stumpf
Mohamed Khamis
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Although eye tracking brings many benefits to users of mobile devices and developers of mobile applications, it poses significant privacy risks to both: the users of mobile devices, and the bystanders that surround users, are within the front-facing camera's field of view. Recent research demonstrates that tracking an individual's gaze reveals personal and sensitive information. This paper presents an investigation of the privacy perceptions and the subjective acceptance of users towards eye tracking on handheld mobile devices. In a four-phase user study (N=17), participants used a smartphone eye tracking app, were interviewed before and after viewing a video showing the amount of sensitive and personal data that could be derived from eye movements, and had their privacy concerns measured. Our findings 1) show factors that influence users' and bystanders' attitudes toward eye tracking on mobile devices such as the algorithms' transparency and the developers' credibility and 2) support designing mechanisms to allow for privacy-aware eye tracking solutions on mobile-devices.
Supplemental Material
Available for Download
zip
v7etra164aux.zip (472.9 KB)
Paper Title: Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices Authors: Noora Alsakar et al.
- Melvin Abraham, Pejman Saeghe, Mark Mcgill, and Mohamed Khamis. 2022. Implications of XR on Privacy, Security and Behaviour: Insights from Experts. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI '22). Association for Computing Machinery, New York, NY, USA, Article 30, 12 pages. https://doi.org/10.1145/3546155. 3546691Google Scholar
Digital Library
- APPLE. 2022. https://www.apple.com/.Google Scholar
- Tom Beesley, Daniel Pearson, and Mike Le Pelley. 2019. Chapter 1 - Eye Tracking as a Tool for Examining Cognitive Processes. In Biophysical Measurement in Experimental Social Science Research, Gigi Foster (Ed.). Academic Press, 1--30. https://doi.org/10.1016/B978-0--12--813092--6.00002--2Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.Google Scholar
- Virginia Braun and Victoria Clarke. 2021. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qualitative research in psychology 18, 3 (2021), 328--352.Google Scholar
- Tamara Denning, Zakariya Dehlawi, and Tadayoshi Kohno. 2014. In Situ with Bystanders of Augmented Reality Glasses: Perspectives on Recording and Privacy-Mediating Technologies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2377--2386. https://doi.org/10.1145/2556288.2557352Google ScholarDigital Library
- Michael D Dodd, John R Hibbing, and Kevin B Smith. 2011. The politics of attention: gaze-cuing effects are moderated by political temperament. Attention, Perception, & Psychophysics 73, 1 (2011), 24--29.Google ScholarCross Ref
- Andrew T. Duchowski, Krzysztof Krejtz, Izabela Krejtz, Cezary Biele, Anna Niedzielska, Peter Kiefer, Martin Raubal, and Ioannis Giannopoulos. 2018. The Index of Pupillary Activity: Measuring Cognitive Load Vis-à-Vis Task Difficulty with Pupil Oscillation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/ 10.1145/3173574.3173856Google ScholarDigital Library
- Kerstin Gidlöf, Annika Wallin, Richard Dewhurst, and Kenneth Holmqvist. 2013. Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment. Journal of eye movement research 6, 1 (2013).Google ScholarCross Ref
- Jie Gu, Yunjie Calvin Xu, Heng Xu, Cheng Zhang, and Hong Ling. 2017. Privacy concerns for mobile app download: An elaboration likelihood model perspective. Decision Support Systems 94 (2017), 19--28.Google ScholarDigital Library
- David Harborth and Alisa Frik. 2021. Evaluating and Redefining Smartphone Permissions with Contextualized Justifications for Mobile Augmented Reality Apps.. In SOUPS@ USENIX Security Symposium. 513--534.Google Scholar
- Sabrina Hoppe, Tobias Loetscher, Stephanie A Morey, and Andreas Bulling. 2018. Eye movements during everyday behavior predict personality traits. Frontiers in human neuroscience (2018), 105.Google Scholar
- Roberto Hoyle, Robert Templeman, Denise Anthony, David Crandall, and Apu Kapadia. 2015. Sensitive lifelogs: A privacy analysis of photos from wearable cameras. In Proceedings of the 33rd Annual ACM conference on human factors in computing systems. 1645--1648.Google ScholarDigital Library
- Michael Xuelin Huang, Jiajia Li, Grace Ngai, Hong Va Leong, and Andreas Bulling. 2019. Moment-to-moment detection of internal thought during video viewing from eye vergence behavior. In Proceedings of the 27th ACM International Conference on Multimedia. 2254--2262.Google ScholarDigital Library
- Christina Katsini, Yasmeen Abdrabou, George E Raptis, Mohamed Khamis, and Florian Alt. 2020. The role of eye gaze in security and privacy applications: Survey and future HCI research directions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--21.Google ScholarDigital Library
- Christina Katsini, Christos Fidas, George E. Raptis, Marios Belk, George Samaras, and Nikolaos Avouris. 2018. Influences of Human Cognition and Visual Behavior on Password Strength during Picture Password Composition. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3173574.3173661Google ScholarDigital Library
- Mohamed Khamis, Florian Alt, and Andreas Bulling. 2015. A Field Study on Spontaneous Gaze-Based Interaction with a Public Display Using Pursuits. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 863--872. https://doi.org/10.1145/2800835.2804335Google ScholarDigital Library
- Mohamed Khamis, Florian Alt, and Andreas Bulling. 2018. The past, present, and future of gaze-enabled handheld mobile devices: Survey and lessons learned. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--17.Google ScholarDigital Library
- Marion Koelle. 2000. Designing Socially Acceptable Body-worn Cameras. Masterthesis. University of Oldenburg.Google Scholar
- Marion Koelle, Swamy Ananthanarayan, Simon Czupalla, Wilko Heuten, and Susanne Boll. 2018. Your smart glasses' camera bothers me! exploring opt-in and opt-out gestures for privacy mediation. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 473--481.Google ScholarDigital Library
- Marion Koelle, Matthias Kranz, and Andreas Möller. 2015. Don't look at me that way! understanding user attitudes towards data glasses usage. In Proceedings of the 17th international conference on human-computer interaction with mobile devices and services. 362--372.Google ScholarDigital Library
- Marion Koelle, Thomas Olsson, Robb Mitchell, Julie Williamson, and Susanne Boll. 2019. What is (Un)Acceptable? Thoughts on Social Acceptability in HCI Research. Interactions 26, 3 (apr 2019), 36--40. https://doi.org/10.1145/3319073Google ScholarDigital Library
- Jacob Leon Kröger, Otto Hans-Martin Lutz, and Florian Müller. 2019. What does your gaze reveal about you? On the privacy implications of eye tracking. In IFIP International Summer School on Privacy and Identity Management. Springer, 226--241.Google Scholar
- Bruno Laeng and Liv Falkenberg. 2007. Women's pupillary responses to sexually significant others during the hormonal cycle. Hormones and behavior 52, 4 (2007), 520--530.Google Scholar
- Päivi Majaranta. 2011. Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies: Advances in Assistive Technologies. IGI Global.Google Scholar
- Päivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human--Computer Interaction. Springer London, London, 39--65. https://doi.org/10.1007/978--1--4471--6392--3_3Google Scholar
- Päivi Majaranta and Kari-Jouko Räihä. 2007. Text entry by gaze: Utilizing eye-tracking. Text entry systems: Mobility, accessibility, universality (2007), 175--187.Google Scholar
- Naresh K Malhotra, Sung S Kim, and James Agarwal. 2004. Internet users' information privacy concerns (IUIPC): The construct, the scale, and a causal model. Information systems research 15, 4 (2004), 336--355.Google Scholar
- Karola Marky, Sarah Prange, Max Mühlhäuser, and Florian Alt. 2021. Roles Matter! Understanding Differences in the Privacy Mental Models of Smart Home Visitors and Residents. Association for Computing Machinery, New York, NY, USA, 108--122. https://doi.org/10.1145/3490632.3490664Google ScholarDigital Library
- Sven Mayer, Gierad Laput, and Chris Harrison. 2020. Enhancing mobile voice assistants with worldgaze. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--10.Google ScholarDigital Library
- Calkin S Montero, Jason Alexander, Mark T Marshall, and Sriram Subramanian. 2010. Would you do that? Understanding social acceptance of gestural interfaces. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services. 275--278.Google ScholarDigital Library
- Omar Namnakani, Yasmeen Abdrabou, Jonathan Grizou, Augusto Esteves, and Mohamed Khamis. 2023. Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices. In Proceedings of the 41st Annual ACM Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). ACM, New York, NY, USA. https://doi.org/10.1145/3544548.3580871Google ScholarDigital Library
- Gie-seo Park, Jong-gil Ahn, and Gerard J Kim. 2011. Gaze-directed hands-free interface for mobile interaction. In International Conference on Human-Computer Interaction. Springer, 304--313.Google Scholar
- Alfredo J Perez, Sherali Zeadally, and Scott Griffith. 2017. Bystanders' privacy. IT Professional 19, 3 (2017), 61--65.Google ScholarDigital Library
- Sören Preibusch. 2014. Eye-tracking. Privacy interfaces for the next ubiquitous modality. In 2014 W3C Workshop on Privacy and User-Centric Controls.Google Scholar
- George E. Raptis, Christos Fidas, and Nikolaos Avouris. 2019. Do Game Designers' Decisions Related to Visual Activities Affect Knowledge Acquisition in Cultural Heritage Games? An Evaluation From a Human Cognitive Processing Perspective. J. Comput. Cult. Herit. 12, 1, Article 4 (feb 2019), 25 pages. https://doi.org/10.1145/3292057Google ScholarDigital Library
- George E. Raptis, Christina Katsini, Marios Belk, Christos Fidas, George Samaras, and Nikolaos Avouris. 2017. Using Eye Gaze Data and Visual Activities to Infer Human Cognitive Styles: Method and Feasibility Studies. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization (Bratislava, Slovakia) (UMAP '17). Association for Computing Machinery, New York, NY, USA, 164--173. https://doi.org/10.1145/3079628.3079690Google ScholarDigital Library
- D. Rozado, T. Moreno, J. San Agustin, F. B. Rodriguez, and P. Varona. 2015. Controlling a Smartphone Using Gaze Gestures as the Input Mechanism. Human--Computer Interaction 30, 1 (2015), 34--63. https://doi.org/10.1080/07370024. 2013.870385 arXiv:https://doi.org/10.1080/07370024.2013.870385Google ScholarCross Ref
- Javier San Agustin, John Paulin Hansen, and Martin Tall. 2010. Gaze-Based Interaction with Public Displays Using off-the-Shelf Components. In Proceedings of the 12th ACM International Conference Adjunct Papers on Ubiquitous Computing - Adjunct (Copenhagen, Denmark) (UbiComp '10 Adjunct). Association for Computing Machinery, New York, NY, USA, 377--378. https://doi.org/10.1145/1864431.1864444Google ScholarDigital Library
- Julian Steil, Inken Hagestedt, Michael Xuelin Huang, and Andreas Bulling. 2019. Privacy-aware eye tracking using differential privacy. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. 1--9.Google ScholarDigital Library
- Pauline van der Wel and Henk van Steenbergen. 2018. Pupil dilation as an index of effort in cognitive control tasks: A review. Psychonomic bulletin & review 25, 6 (2018), 2005--2015.Google ScholarCross Ref
- Yaxing Yao, Justin Reed Basdeo, Oriana Rosata Mcdonough, and Yang Wang. 2019. Privacy Perceptions and Designs of Bystanders in Smart Homes. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 59 (nov 2019), 24 pages. https: //doi.org/10.1145/3359161Google ScholarDigital Library
- Yaxing Yao, Huichuan Xia, Yun Huang, and Yang Wang. 2017. Privacy Mechanisms for Drones: Perceptions of Drone Controllers and Bystanders. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 6777--6788. https: //doi.org/10.1145/3025453.3025907Google ScholarDigital Library
- Jakub ?evcech and Mária Bieliková. 2014. User's Interest Detection through Eye Tracking for Related Documents Retrieval. In 2014 9th International Workshop on Semantic and Social Media Adaptation and Personalization. 9--13. https://doi.org/10.1109/SMAP.2014.20Google ScholarDigital Library
Index Terms
- Investigating Privacy Perceptions and Subjective Acceptance of Eye Tracking on Handheld Mobile Devices
Recommendations
DynamicRead: Exploring Robust Gaze Interaction Methods for Reading on Handheld Mobile Devices under Dynamic Conditions
ETRAEnabling gaze interaction in real-time on handheld mobile devices has attracted significant attention in recent years. An increasing number of research projects have focused on sophisticated appearance-based deep learning models to enhance the precision ...
Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsGaze is promising for hands-free interaction on mobile devices. However, it is not clear how gaze interaction methods compare to each other in mobile settings. This paper presents the first experiment in a mobile setting that compares three of the most ...
4th international workshop on pervasive eye tracking and mobile eye-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationPrevious work on eye tracking and eye-based human-computer interfaces mainly concentrated on making use of the eyes in traditional desktop settings. With the recent growth of interest in smart glass devices and low-cost eye trackers, however, gaze-based ...
Comments