David Goedicke
Jamy Li
Vanessa Evers
Wendy Ju
ABSTRACT
Researchers and designers of in-vehicle interactions and interfaces currently have to choose between performing evaluation and human factors experiments in laboratory driving simulators or on-road experiments. To enjoy the benefit of customizable course design in controlled experiments with the immediacy and rich sensations of on-road driving, we have developed a new method and tools to enable VR driving simulation in a vehicle as it travels on a road. In this paper, we describe how the cost-effective and flexible implementation of this platform allows for rapid prototyping. A preliminary pilot test (N = 6), centered on an autonomous driving scenario, yields promising results, illustrating proof of concept and indicating that a basic implementation of the system can invoke genuine responses from test participants.
Supplemental Material
- Talal Al-Shihabi and Ronald Mourant. 2003. Toward more realistic driving behavior models for autonomous vehicles in driving simulators. Transportation Research Record: Journal of the Transportation Research Board 1843 (2003), 41--49.Google Scholar
Cross Ref
- Micah Alpern and Katie Minardo. 2003. Developing a car gesture interface for use as a secondary task. In CHI'03 extended abstracts on Human factors in computing systems. ACM, 932--933. Google ScholarDigital Library
- Ignacio Alvarez, Laura Rumbel, and Robert Adams. 2015. Skyline: a rapid prototyping driving simulator for user experience. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 101--108. Google ScholarDigital Library
- Bruce Artz, Larry Cathey, Peter Grant, Dan Houston, Jeff Greenberg, and Max Mariani. 2001. The design and construction of the visual subsystem for VIRTTEX, the driving simulator at the Ford research laboratories. In Driving simulation conference. 255--262.Google Scholar
- Ed Bachelder. 2006. Helicopter aircrew training using fused reality. Technical Report. Systems Technology Inc. Hawthorne, CA.Google Scholar
- Sonia Baltodano, Srinath Sibi, Nikolas Martelaro, Nikhil Gowda, and Wendy Ju. 2015. The RRADS platform: a real road autonomous driving simulator. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 281--288. Google ScholarDigital Library
- Salvador Bayarri, Marcos Fernandez, and Mariano Perez. 1996. Virtual Reality for Driving Simulation. Commun. ACM 39, 5 (Dec. 1996), 72--76. Google ScholarDigital Library
- Miles Branman. 2017 (accessed September 17, 2017). Honda's Dream Drive VR experience may be the future of in-car entertainment. https://www.digitaltrends.com/ cars/ces-2017-honda-dream-drive/Google Scholar
- Monroe Conner. 2015 (accessed September 17, 2017). Fused Reality: Making the Imagined Seem Real. https://www.nasa.gov/centers/armstrong/features/fused_reality.htmlGoogle Scholar
- Piotr Didyk, Elmar Eisemann, Tobias Ritschel, Karol Myszkowski, and Hans-Peter Seidel. 2010. Perceptually-motivated Real-time Temporal Upsampling of 3D Content for High-refresh-rate Displays. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 713--722.Google Scholar
- Thomas A Dingus, Sheila G Klauer, Vicki L Neale, A Petersen, Suzanne E Lee, JD Sudweeks, MA Perez, J Hankey, DJ Ramsey, S Gupta, and others. 2006. The 100-car naturalistic driving study, Phase II-results of the 100-car field experiment. Technical Report.Google Scholar
- Frank Flemisch, Matthias Heesen, Tobias Hesse, Johann Kelsch, Anna Schieben, and Johannes Beller. 2012. Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cognition, Technology & Work 14, 1 (2012), 3--18. Google ScholarDigital Library
- JS Freeman, G Watson, YE Papelis, TC Lin, A Tayyab, RA Romano, and JG Kuhl. 1995. The Iowa driving simulator: An implementation and application overview. (1995).Google Scholar
- Petra Geutner, Frank Steffens, and Dietrich Manstetten. 2002. Design of the VICO Spoken Dialogue System: Evaluation of User Expectations by Wizard-of-Oz Experiments. In LREC.Google Scholar
- Christian Gold, Lutz Lorenz, Daniel Damböck, and Klaus Bengler. 2013. Partially automated driving as a fallback level of high automation. Tagung Fahrerassistenzsysteme. Der Weg zum automatischen Fahren 28, 29.11 (2013), 2013.Google Scholar
- D Grothkopp, W Krautter, B Grothkopp, F Steffens, and F Geutner. 2001. Using a driving simulator to perform a Wizard-of-Oz experiment on speech-controlled driver information systems. In Proceedings of the 1st Human-Centered Transportation Simulation Conference.Google Scholar
- David Hallvig, Anna Anund, Carina Fors, Göran Kecklund, Johan G Karlsson, Mattias Wahde, and Torbjörn Åkerstedt. 2013. Sleepy driving on the real road and in the simulator--A comparison. Accident Analysis & Prevention 50 (2013), 44--50.Google ScholarCross Ref
- Arne Helland, Gunnar D Jenssen, Lone-Eirin Lervåg, Andreas Austgulen Westin, Terje Moen, Kristian Sakshaug, Stian Lydersen, Jørg Mørland, and Lars Slørdal. 2013. Comparison of driving simulator performance with real driving after alcohol intake: A randomised, single blind, placebo-controlled, cross-over trial. Accident Analysis & Prevention 53 (2013), 9--16.Google ScholarCross Ref
- Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. 4034--4044. Google ScholarDigital Library
- Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 201--210. Google ScholarDigital Library
- Nico Kaptein, Jan Theeuwes, and Richard Van Der Horst. 1996. Driving simulator validity: Some considerations. Transportation Research Record: Journal of the Transportation Research Board 1550 (1996), 30--36.Google ScholarCross Ref
- Andras Kemeny and Francesco Panerai. 2003. Evaluating perception in driving simulation experiments. Trends in cognitive sciences 7, 1 (2003), 31--37.Google Scholar
- F Kramer and M Israel. 2014. Virtueller Greifreflex. Ein Konfliktpotenzial und die Moeglichkeiten der Kompensation in Personenkraftwagen mithilfe moderner Assistenzsysteme. Verkehrsunfall und Fahrzeugtechnik 52, 11 (2014).Google Scholar
- Markus Kuderer, Shilpa Gulati, and Wolfram Burgard. 2015. Learning driving styles for autonomous vehicles from demonstration. 2015 IEEE International Conference on Robotics and Automation (ICRA) (2015), 2641--2646.Google ScholarCross Ref
- Brian Lathrop, Hua Cheng, Fuliang Weng, Rohit Mishra, Joyce Chen, Harry Bratt, Lawrence Cavedon, Carsten Bergmann, Tess Hand-Bender, Heather Pon-Barry, and others. 2004. A Wizard of Oz framework for collecting spoken human-computer dialogs: An experiment procedure for the design and testing of natural language in-vehicle technology systems. In Proc. ITS.Google Scholar
- Jack M Loomis, James J Blascovich, and Andrew C Beall. 1999. Immersive virtual environment technology as a basic research tool in psychology. Behavior Research Methods, Instruments, & Computers 31, 4 (1999), 557--564.Google ScholarCross Ref
- Nikolas Martelaro and Wendy Ju. 2017. WoZ Way: Enabling Real-time Remote Interaction Prototyping & Observation in On-road Vehicles. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 21--24. Google ScholarDigital Library
- Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17 (2017), 5655--5668. Google ScholarDigital Library
- Natasha Merat, A Hamish Jamson, Frank CH Lai, Michael Daly, and Oliver MJ Carsten. 2014. Transition to manual: Driver behaviour when resuming control from a highly automated vehicle. Transportation research part F: traffic psychology and behaviour 27 (2014), 274--282.Google Scholar
- David Miller, Annabel Sun, Mishel Johns, Hillary Ive, David Sirkin, Sudipto Aich, and Wendy Ju. 2015. Distraction becomes engagement in automated driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 59. SAGE Publications Sage CA: Los Angeles, CA, 1676--1680.Google ScholarCross Ref
- Rohit Mishra, Elizabeth Shriberg, Sandra Upson, Joyce Chen, Fuliang Weng, Stanley Peters, Lawrence Cavedon, John Niekrasz, Hua Cheng, and Harry Bratt. 2004. A wizard of Oz framework for collecting spoken human-computer dialogs. In Eighth International Conference on Spoken Language Processing.Google ScholarCross Ref
- Brian Ka-Jun Mok, David Sirkin, Srinath Sibi, David Bryan Miller, and Wendy Ju. 2015. Understanding driver-automated vehicle interactions through Wizard of Oz design improvisation. In Proceedings of the International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design. 386--392.Google Scholar
- Anna Schieben, Matthias Heesen, Julian Schindler, Johann Kelsch, and Frank Flemisch. 2009. The theater-system technique: Agile designing and testing of system behavior and interaction, applied to highly automated vehicles. In Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 43--46. Google ScholarDigital Library
- G Schmidt, M Kiss, E Babbel, and A Galla. 2008. The Wizard on Wheels: Rapid Prototyping and User Testing of Future Driver Assistance Using Wizard of Oz Technique in a Vehicle. In Proceedings of the FISITA 2008 World Automotive Congress, Munich.Google Scholar
- JJ Slob. 2008. State-of-the-art driving simulators, a literature survey. DCT report 107 (2008).Google Scholar
- Jonathan Stevens, Peter Kincaid, and Robert Sottilare. 2015. Visual modality research in virtual and mixed reality simulation. The Journal of Defense Modeling and Simulation 12, 4 (2015), 519--537.Google ScholarCross Ref
- Thomas Waltemate, Irene Senna, Felix Hülsmann, Marieke Rohde, Stefan Kopp, Marc Ernst, and Mario Botsch. 2016. The Impact of Latency on Perceptual Judgments and Motor Performance in Closed-loop Interaction in Virtual Reality. In Proceedings of the 22Nd ACM Conference on Virtual Reality Software and Technology (VRST '16). ACM, New York, NY, USA, 27--35. Google ScholarDigital Library
- Peter Wang, Srinath Sibi, Brian Mok, and Wendy Ju. 2017. Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 234--243. Google ScholarDigital Library
- Ginger S. Watson and Yiannis E. Papelis. 1997. The Iowa Driving Simulator: Using Simulation for Human Performance Measurement. In Emerging Technologies for Nutrition Research: Potential for Assessing Military Performance Capability, Sydne J. Carlson-Newberry and Rebecca B. Costello (Eds.). Institute of Medicine (US) Committee on Military Nutrition Research, Oxford, Chapter 26, 551--568.Google Scholar
Index Terms
- VR-OOM: Virtual Reality On-rOad driving siMulation
Recommendations
Driving with the Fishes: Towards Calming and Mindful Virtual Reality Experiences for the Car
We present the use of in-car virtual reality (VR) as a way to create calm, mindful experiences for passengers and, someday, autonomous vehicle occupants. Specifically, we describe a series of studies aimed at exploring appropriate VR content, ...
A Low-Cost VR-Based Automated Driving Simulator for Rapid Automotive UI Prototyping
AutomotiveUI '18: Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsConducting User Experience Design (UXD) research in the context of automated driving today is challenging due to the lack of availability of automated cars that are SAE level 3 or above. This Extended Abstract presents a novel methodological tool for ...
A framework for designing interactions between pedestrians and driverless cars: insights from a ride-sharing design study
OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human InteractionPrevious work has highlighted the need for human factors research to not only focus on the passengers inside driverless cars but also consider others who will interact with the car in an urban environment such as pedestrians. In this paper, we position ...
Comments