Kyle Harrington
ABSTRACT
Employing a 2x2 within-subjects design, forty-eight experienced drivers (28 male, 20 female) undertook repeated button selection and 'slider-bar' manipulation tasks, to compare a traditional touchscreen with a virtual mid-air gesture interface in a driving simulator. Both interfaces were tested with and without haptic feedback generated using ultrasound. Results show that combining gestures with mid-air haptic feedback was particularly promising, reducing the number of long glances and mean off-road glance time associated with the in-vehicle tasks. For slider-bar tasks in particular, gestures-with-haptics was also associated with the shortest interaction times, highest number of correct responses and least 'overshoots', and was favoured by participants. In contrast, for button-selection tasks, the touchscreen was most popular, enabling the highest accuracy and quickest responses, particularly when combined with haptic feedback to guide interactions, although this also increased visual demand. The study shows clear potential for gestures with mid-air ultrasonic haptic feedback in the automotive domain.
- D. Large, G. Burnett, E. Crundall, G. Lawson and L. Skrypchuk, "Twist It, Touch It, Push It, Swipe It: Evaluating Secondary Input Devices for Use with an Automotive Touchscreen HMI," in Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2016. Google Scholar
Digital Library
- S. Klauer, T. Dingus, V. Neale, J. Sudweeks and D. Ramsey, "The impact of driver inattention on near-crash/crash risk: An analysis using the 100-car naturalistic driving study data," 2006.Google Scholar
- S. Rümelin and A. Butz, "How to make large touch screens usable while driving," in Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2013. Google ScholarDigital Library
- D. Large, G. Burnett, E. Crundall, E. van Loon, A. Eren and L. Skrypchuk, "Developing predictive equations to model the visual demand of in-vehicle touchscreen HMIs.," International Journal of Human--Computer Interaction, vol. 34, no. 1, pp. 1--14, 2018.Google ScholarCross Ref
- B. Donmez, L. Boyle and J. Lee, "Differences in off-road glances: effects on young drivers' performance.," Journal of transportation engineering, vol. 136, no. 5, pp. 403--409, 2009.Google ScholarCross Ref
- L. Garber, "Gestural Technology: Moving Interfaces in a New Direction," Computer, vol. 46, no. 10, pp. 22--25, 2013. Google ScholarDigital Library
- A. van Laack, Measurement of Sensory and Cultural Influences on Haptic Quality Perception of Vehicle Interiors, BoD--Books on Demand, 2014.Google Scholar
- A. Laack, O. Kirsch, G. Tuzar and J. Blessing, "Controlling vehicle functions with natural body language," in Mensch und Computer 2016--Workshopband, 2016.Google Scholar
- S. Rümelin, T. Gabler and J. Bellenbaum, "Clicks are in the Air: How to Support the Interaction with Floating Objects through Ultrasonic Feedback.," in 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Oldenburg, Germany, 2017. Google ScholarDigital Library
- Postmedia Network Inc., "How It Works: BMW's Gesture Control," 10 08 2016. {Online}. Available: http://driving.ca/bmw/7-series/auto-news/news/how-it-works-bmw-gesture-control. {Accessed 22 03 2018}.Google Scholar
- M. Biet, F. Giraud and B. Lemaire-Semail, "Implementation of tactile feedback by modifying the perceived friction," The European Physical Journal-Applied Physics, vol. 43, no. 1, pp. 123--135, 2008.Google ScholarCross Ref
- H. Iwata, H. Yano, F. Nakaizumi and R. Kawamura, "Project FEELEX: adding haptic surface to graphics," in Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001. Google ScholarDigital Library
- M. Pitts, G. Burnett, L. Skrypchuk, T. Wellings, A. Attridge and M. Williams, "Visual-haptic feedback interaction in automotive touchscreen use," Displays, vol. 33, no. 1, pp. 7--16, 2012.Google ScholarCross Ref
- M. Weiss, C. Wacharamanotham, S. Voelker and J. Borchers, "FingerFlux: near-surface haptic feedback on tabletops.," in Proceedings of the 24th annual ACM symposium on User interface software and technology, 2011. Google ScholarDigital Library
- C. Wusheng, W. Tianmiao and H. Lei, "Design of data glove and arm type haptic interface," in Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003., 2003. Google ScholarDigital Library
- T. Carter, S. Seah, B. Long, B. Drinkwater and S. Subramanian, "UltraHaptics: multi-point mid-air haptic feedback for touch surfaces.," in Proceedings of the 26th annual ACM symposium on User interface software and technology, 2013. Google ScholarDigital Library
- T. Hoshi, M. Takahashi, T. Iwamoto and H. Shinoda, "Noncontact tactile display based on radiation pressure of airborne ultrasound," IEEE Transactions on Haptics, vol. 3, no. 3, pp. 155--165, 2010. Google ScholarDigital Library
- L. Gavrilov and E. Tsirulnikov, "Mechanisms of Stimulation Effects of Focused Ultrasound on Neural Structures: Role of Nonlinear Effects.," in Nonlinear Acoust. at the Beginning of the 21st Cent., 2002, p. 445--448.Google Scholar
- K. Brookhuis, D. Waard and B. Mulder, "Measuring driving performance by car-following in traffic.," Ergonomics, vol. 37, no. 3, pp. 427--434, 1994.Google ScholarCross Ref
- National Highway Traffic Safety Administration (NHTSA), "Visual-Manual NHTSA Driver Distraction Guidelines For In-Vehicle Electronic Devices," 2013.Google Scholar
Index Terms
- Exploring the Use of Mid-Air Ultrasonic Feedback to Enhance Automotive User Interfaces
Recommendations
Using Mid-Air Haptics to Guide Mid-Air Interactions
Human-Computer Interaction – INTERACT 2023AbstractWhen users interact with mid-air gesture-based interfaces, it is not always clear what interactions are available, or how they might be executed. Mid-air interfaces offer no tactile affordances, pushing systems to rely on other modalities (e.g. ...
Head-mounted display with mid-air tactile feedback
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and TechnologyVirtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the ...
Extended Mid-air Ultrasound Haptics for Virtual Reality
Mid-air haptics allow bare-hand tactile stimulation; however, it has a constrained workspace, making it unsuitable for room-scale haptics. We present a novel approach to rendering mid-air haptic sensations in a large rendering volume by turning a static ...
Comments