Rufat Rzayev
Sven Mayer
Niels Henze
ABSTRACT
Virtual reality (VR) is commonly used for entertainment applications but is also increasingly employed for a large number of use cases such as digital prototyping or training workers. Here, VR is key to present an immersive secondary world. VR enables experiences that are close to reality, regardless of time and place. However, highly immersive VR can result in missing digital information from the real world, such as important notifications. For efficient notification presentation in VR, it is necessary to understand how notifications should be integrated in VR without breaking the immersion. Thus, we conducted a study with 24 participants to investigate notification placement in VR while playing games, learning, and solving problems. We compared placing notifications using a Head-Up Display, On-Body, Floating, and In-Situ in open, semi-open, and closed VR environments. We found significant effects of notification placement and task on how notifications are perceived in VR. Insights from our study inform the design of VR applications that support digital notifications.
Supplemental Material
- Ghassem Alaee, Amit P Deasi, Lourdes Pena-Castillo, Edward Brown, and Oscar Meruvia-Pastor. 2018. A User Study on Augmented Virtuality Using Depth Sensing Cameras for Near-Range Awareness in Immersive VR.Google Scholar
- Esta A. Berg. 1948. A Simple Objective Technique for Measuring Flexibility in Thinking. The Journal of General Psychology 39, 1 (1948), 15--22. DOI: http://dx.doi.org/10.1080/00221309.1948.9918159Google ScholarCross Ref
- Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative Hci Research: Going Behind the Scenes. Morgan & Claypool Publishers. 1--115 pages. DOI: http://dx.doi.org/10.2200/S00706ED1V01Y201602HCI034Google ScholarCross Ref
- John Brooke. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.Google Scholar
- Pulkit Budhiraja, Rajinder Sodhi, Brett Jones, Kevin Karsch, Brian Bailey, and David Forsyth. 2015. Where's My Drink? Enabling Peripheral Real World Interactions While Using HMDs. arXiv preprint arXiv:1502.04744 (2015).Google Scholar
- Soon Hau Chua, Simon T. Perrault, Denys J. C. Matthies, and Shengdong Zhao. 2016. Positioning Glass: Investigating Display Positions of Monocular Optical See-Through Head-Mounted Display. In Proceedings of the Fourth International Symposium on Chinese CHI (ChineseCHI2016). ACM, New York, NY, USA, Article 1, 6 pages. DOI: http://dx.doi.org/10.1145/2948708.2948713Google ScholarDigital Library
- Fulvio Corno, Luigi De Russis, and Teodoro Montanaro. 2017. XDN: Cross-device Framework for Custom Notifications Management. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '17). ACM, New York, NY, USA, 57--62. DOI: http://dx.doi.org/10.1145/3102113.3102127Google ScholarDigital Library
- Amit P Desai, Lourdes Pena-Castillo, and Oscar Meruvia-Pastor. 2017. A Window to Your Smartphone: Exploring Interaction and Communication in Immersive VR with Augmented Virtuality. In 14th Conference on Computer and Robot Vision (CRV '17). 217--224. DOI: http://dx.doi.org/10.1109/CRV.2017.16Google ScholarCross Ref
- Tilman Dingler, Kai Kunze, and Benjamin Outram. 2018. VR Reading UIs: Assessing Text Parameters for Reading in VR. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW094, 6 pages. DOI: http://dx.doi.org/10.1145/3170427.3188695Google ScholarDigital Library
- Thomas Gaubert. 2016. Zephyr. GitHub repository. (2016). https://github.com/ThomasGaubert/zephyr.Google Scholar
- Ceenu George, Manuel Demmler, and Heinrich Hussmann. 2018. Intelligent Interruptions for IVR: Investigating the Interplay Between Presence, Workload and Attention. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW511, 6 pages. DOI: http://dx.doi.org/10.1145/3170427.3188686Google ScholarDigital Library
- Sarthak Ghosh, Lauren Winston, Nishant Panchal, Philippe Kimura-Thollander, Jeff Hotnog, Douglas Cheong, Gabriel Reyes, and Gregory D. Abowd. 2018. NotifiVR: Exploring Interruptions and Notifications in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4 (2018), 1447--1456. DOI: http://dx.doi.org/10.1109/TVCG.2018.2793698Google ScholarDigital Library
- Jeffrey I Gold, Katharine A Belmont, and David A Thomas. 2007. The neurobiology of virtual reality pain attenuation. CyberPsychology & Behavior 10, 4 (2007), 536--544.Google ScholarCross Ref
- Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104. DOI:http://dx.doi.org/10.1145/2702123.2702561Google ScholarDigital Library
- Hsiu-Mei Huang, Ulrich Rauch, and Shu-Sheng Liaw. 2010. Investigating learners' attitudes toward virtual reality learning environments: Based on a constructivist approach. Computers & Education 55 (11 2010), 1171--1182. DOI: http://dx.doi.org/10.1016/j.compedu.2010.05.014Google ScholarDigital Library
- Shamsi T. Iqbal and Brian P. Bailey. 2010. Oasis: A Framework for Linking Notification Delivery to the Perceptual Structure of Goal-directed Tasks. ACM Trans. Comput.-Hum. Interact. 17, 4, Article 15 (Dec. 2010), 28 pages. DOI: http://dx.doi.org/10.1145/1879831.1879833Google ScholarDigital Library
- Jason Jerald. 2016. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool, New York, NY, USA.Google ScholarDigital Library
- Kohei Kanamori, Nobuchika Sakata, Tomu Tominaga, Yoshinori Hijikata, Kensuke Harada, and Kiyoshi Kiyokawa. 2018. Obstacle Avoidance Method in Real Space for Virtual Reality Immersion. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR '18). IEEE, 80--89. DOI: http://dx.doi.org/10.1109/ISMAR.2018.00033Google ScholarCross Ref
- Anjuli Kannan, Karol Kurach, Sujith Ravi, Tobias Kaufman, Balint Miklos, Greg Corrado, Andrew Tomkins, Laszlo Lukacs, Marina Ganea, Peter Young, and Vivek Ramavajjala. 2016. Smart Reply: Automated Response Suggestion for Email. In Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD'16). https://arxiv.org/pdf/1606.04870v1.pdfGoogle ScholarDigital Library
- Romina Kettner, Patrick Bader, Thomas Kosch, Stefan Schneegass, and Albrecht Schmidt. 2017. Towards Pressure-based Feedback for Non-stressful Tactile Notifications. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 89, 8 pages. DOI: http://dx.doi.org/10.1145/3098279.3122132Google ScholarDigital Library
- Thomas Kubitza, Alexandra Voit, Dominik Weber, and Albrecht Schmidt. 2016. An IoT Infrastructure for Ubiquitous Notifications in Intelligent Living Environments. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 1536--1541. DOI: http://dx.doi.org/10.1145/2968219.2968545Google ScholarDigital Library
- Owlchemy Labs. 2016. Job Simulator: The 2050 Archives. Game [Microsoft Windows, PlayStation 4]. (5 April 2016). Owlchemy Labs.Google Scholar
- Wolf & Wood Interactive Ltd. 2016. A Chair in a Room : Greenwater. Game [Microsoft Windows]. (5 April 2016). Wolf & Wood Interactive Ltd, UK.Google Scholar
- Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2143--2152. DOI:http://dx.doi.org/10.1145/2702123.2702382Google ScholarDigital Library
- Jason Orlosky, Kiyoshi Kiyokawa, and Haruo Takemura. 2014. Managing Mobile Text in Head Mounted Displays: Studies on Visual Preference and Text Placement. SIGMOBILE Mob. Comput. Commun. Rev. 18, 2 (June 2014), 20--31. DOI: http://dx.doi.org/10.1145/2636242.2636246Google ScholarDigital Library
- Martin Pielot, Karen Church, and Rodrigo de Oliveira. 2014. An In-situ Study of Mobile Phone Notifications. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 233--242. DOI: http://dx.doi.org/10.1145/2628363.2628364Google ScholarDigital Library
- Martin Pielot and Luz Rello. 2015. The Do Not Disturb Challenge: A Day Without Notifications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1761--1766. DOI: http://dx.doi.org/10.1145/2702613.2732704Google ScholarDigital Library
- Martin Pielot and Luz Rello. 2017. Productive, Anxious, Lonely: 24 Hours Without Push Notifications. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 11, 11 pages. DOI: http://dx.doi.org/10.1145/3098279.3098526Google ScholarDigital Library
- Martin Pielot, Amalia Vradi, and Souneil Park. 2018. Dismissed!: A Detailed Exploration of How Mobile Phone Users Handle Push Notifications. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 3, 11 pages. DOI: http://dx.doi.org/10.1145/3229434.3229445Google ScholarDigital Library
- Elizabeth Quinn and Ian Stephen Paul Nation. 1974. Speed reading: A course for learners of English. Oxford University Press.Google Scholar
- Sylvia Rothe, Kim Tran, and Heinrich Hussmann. 2018. Dynamic Subtitles in Cinematic Virtual Reality. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video (TVX '18). ACM, New York, NY, USA, 209--214. DOI: http://dx.doi.org/10.1145/3210825.3213556Google ScholarDigital Library
- Rufat Rzayev, Pawel W. Wo´ zniak, Tilman Dingler, and Niels Henze. 2018. Reading on Smart Glasses: The Effect of Text Position, Presentation Type and Walking. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 45, 9 pages. DOI: http://dx.doi.org/10.1145/3173574.3173619Google ScholarDigital Library
- Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale Assessment of Mobile Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3055--3064. DOI: http://dx.doi.org/10.1145/2556288.2557189Google ScholarDigital Library
- Stefan Schneegass and Rufat Rzayev. 2016. Embodied Notifications: Implicit Notifications Through Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 954--959. DOI:http://dx.doi.org/10.1145/2957265.2962663Google ScholarDigital Library
- Susan M. Schneider, Cassandra K. Kisby, and Elizabeth P. Flint. 2011. Effect of virtual reality on time perception in patients receiving chemotherapy. Supportive Care in Cancer 19, 4 (01 Apr 2011), 555--564. DOI: http://dx.doi.org/10.1007/s00520-010-0852--7Google ScholarCross Ref
- Guy Schofield, Gareth Beale, Nicole Beale, Martin Fell, Dawn Hadley, Jonathan Hook, Damian Murphy, Julian Richards, and Lewis Thresh. 2018. Viking VR: Designing a Virtual Reality Experience for a Museum. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 805--815. DOI: http://dx.doi.org/10.1145/3196709.3196714Google ScholarDigital Library
- Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments 10, 3 (2001), 266--281.Google ScholarDigital Library
- Lior Shapira and Daniel Freedman. 2016. Reality Skins: Creating Immersive and Tactile Virtual Environments. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR '16). 115--124. DOI: http://dx.doi.org/10.1109/ISMAR.2016.23Google ScholarCross Ref
- Ludwig Sidenmark, Nicolas Kiefer, and Hans Gellersen. 2019. Subtitles in Interactive Virtual Reality: Using Gaze to Address Depth Conflicts. In Workshop on Emerging Novel Input Devices and Interaction Techniques.Google Scholar
- Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3307--3316. DOI:http://dx.doi.org/10.1145/2702123.2702389Google ScholarDigital Library
- Misha Sra, Sergio Garrido-Jurado, Chris Schmandt, and Pattie Maes. 2016. Procedurally Generated Virtual Reality from 3D Reconstructed Physical Space. In Proceedings of the 22Nd ACM Conference on Virtual Reality Software and Technology (VRST '16). ACM, New York, NY, USA, 191--200. DOI: http://dx.doi.org/10.1145/2993369.2993372Google ScholarDigital Library
- Bethesda Game Studios. 2018. The Elder Scrolls V: Skyrim VR. Game [Microsoft Windows]. (3 April 2018). Bethesda Softworks.Google Scholar
- Ubisoft and Red Storm Entertainment. 2017. Star Trek: Bridge Crew. Game [PlayStation 4, Microsoft Windows]. (30 May 2017). Ubisoft and Red Storm Entertainment.Google Scholar
- Alexandra Voit, Tonja Machulla, Dominik Weber, Valentin Schwind, Stefan Schneegass, and Niels Henze. 2016. Exploring Notifications in Smart Home Environments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 942--947. DOI: http://dx.doi.org/10.1145/2957265.2962661Google ScholarDigital Library
- Dominik Weber, Sven Mayer, Alexandra Voit, Rodrigo Ventura Fierro, and Niels Henze. 2016. Design Guidelines for Notifications on Smart TVs. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX '16). ACM, New York, NY, USA, 13--24. DOI: http://dx.doi.org/10.1145/2932206.2932212Google ScholarDigital Library
- Dominik Weber, Alireza Sahami Shirazi, and Niels Henze. 2015. Towards Smart Notifications Using Research in the Large. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '15). ACM, New York, NY, USA, 1117--1122. DOI: http://dx.doi.org/10.1145/2786567.2794334Google ScholarDigital Library
- Dominik Weber, Alexandra Voit, Jonas Auda, Stefan Schneegass, and Niels Henze. 2018b. Snooze!: Investigating the User-defined Deferral of Mobile Notifications. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 2, 13 pages. DOI: http://dx.doi.org/10.1145/3229434.3229436Google ScholarDigital Library
- Dominik Weber, Alexandra Voit, and Niels Henze. 2018a. Notification Log: An Open-Source Framework for Notification Research on Mobile Devices. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (UbiComp '18). ACM, New York, NY, USA, 1271--1278. DOI: http://dx.doi.org/10.1145/3267305.3274118Google ScholarDigital Library
- Dominik Weber, Alexandra Voit, Gisela Kollotzek, Lucas van der Vekens, Marcus Hepting, Florian Alt, and Niels Henze. 2018c. PD Notify: Investigating Personal Content on Public Displays. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW014, 6 pages. DOI: http://dx.doi.org/10.1145/3170427.3188475Google ScholarDigital Library
- Bob G. Witmer, Christian J. Jerome, and Michael J. Singer. 2005. The Factor Structure of the Presence Questionnaire. Presence: Teleoperators and Virtual Environments 14, 3 (2005), 298--312. DOI: http://dx.doi.org/10.1162/105474605323384654Google ScholarDigital Library
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 143--146. DOI: http://dx.doi.org/10.1145/1978942.1978963Google ScholarDigital Library
- André Zenner, Marco Speicher, Sören Klingner, Donald Degraen, Florian Daiber, and Antonio Krüger. 2018. Immersive Notification Framework: Adaptive & Plausible Notifications in Virtual Reality. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW609, 6 pages. DOI: http://dx.doi.org/10.1145/3170427.3188505Google ScholarDigital Library
Index Terms
- Notification in VR: The Effect of Notification Placement, Task and Environment
Recommendations
Immersive Notification Framework: Adaptive & Plausible Notifications in Virtual Reality
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsNotifications in everyday virtual reality (VR) applications are currently realized by displaying generic pop-ups within the immersive virtual environment (IVE) containing the message of the sender. However, this approach tends to break the immersion of ...
A study on the verification of the effect of sensory extension through cutaneous sensation on experiential learning using VR
AbstractThis study verifies the effects of learning experiences by measuring the degrees of awareness of direct experience felt by users detecting both temperature and wind occurring within a virtual space as real cutaneous sensations. Learning while ...
Effects of dynamic field-of-view restriction on cybersickness and presence in HMD-based virtual reality
AbstractThe phenomenon of cybersickness is currently hindering the mass market adoption of head-mounted display (HMD) virtual reality (VR) technologies. This study examined the effects of dynamic field-of-view (FOV) restriction on the cybersickness ...
Comments