David R. Large
ABSTRACT
Given the proliferation of digital assistants in everyday mobile technology, it appears inevitable that next generation vehicles will be embodied by similar agents, offering engaging, natural language interactions. However, speech can be cognitively captivating. It is therefore important to understand the demand that such interfaces may place on drivers. Twenty-five participants undertook four drives (counterbalanced), in a medium-fidelity driving simulator: 1. Interacting with a state-of-the-art digital driving assistant ('DDA') (presented using Wizard-of-Oz); 2. Engaged in a hands-free mobile phone conversation; 3. Undertaking the delayed-digit recall ('2-back') task and 4. With no secondary task (baseline). Physiological arousal, subjective workload assessment, tactile detection task (TDT) and driving performance measures consistently revealed the '2-back' drive as the most cognitively demanding (highest workload, poorest TDT performance). Mobile phone and DDA conditions were largely equivalent, attracting low/medium cognitive workload. Findings are discussed in the context of designing in-vehicle natural language interfaces to mitigate cognitive demand.
- Bainbridge, L., 1983. Ironies of automation. Automatica, 19(6), pp. 775--779. Google Scholar
Digital Library
- Barón, A. and Green, P., 2006. Safety and usability of speech interfaces for in-vehicle tasks while driving: A brief literature review (No. UMTRI-2006-5). University of Michigan, Transportation Research Institute.Google Scholar
- Bellegarda, J.R., 2014. Spoken language understanding for natural interaction: The siri experience. In Natural Interaction with Robots, Knowbots and Smartphones (pp. 3--14). Springer New York.Google Scholar
- Brookhuis, K.A. and de Waard, D., 2009. Monitoring drivers' mental workload in driving simulators using physiological measures. Accident Analysis & Prevention, 42(3), pp. 898--903. Google ScholarCross Ref
- Cooper, J.M., Vladisavljevic, I., Medeiros-Ward, N., Martin, P.T. and Strayer, D.L., 2009. Near the tipping point of traffic stability: An investigation of driving while conversing on a cell phone in simulated highway traffic of varying densities. Human Factors, 51, pp. 261--268. Google ScholarCross Ref
- Dahlbäck, N., A. Jönsson, and L. Ahrenberg. Wizard-of-Oz Studies -- Why and How. In Proceedings of Intelligent User Interfaces '93. pp. 193--200 1993.Google ScholarDigital Library
- Diels C. (2011). Tactile Detection Task as a real time cognitive workload measure. In M. Anderson (Ed.), Contemporary Ergonomics and Human Factors 2011, pp. 183--190, CRC Press. Google ScholarCross Ref
- Engström, J. (2010). The Tactile Detection Task as a method for assessing drivers' cognitive load. In: G. L. Rupp (Ed.), Performance Methods for Assessing Driver Distraction: The Quest for Improved Road Safety (pp. 90--103). Warrendale, PA: SAE International.Google Scholar
- Gellatly, A.W. and Dingus, T.A., 1998, October. Speech recognition and automotive applications: using speech to perform in-vehicle tasks. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 42, No. 17, pp. 1247--1251). SAGE Publications. Google ScholarCross Ref
- Hart, S.G. and Staveland, L.E., 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, pp. 139--183. Google ScholarCross Ref
- Kelley, J.F., 1984. An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Information Systems (TOIS), 2(1), pp. 26--41. Google ScholarDigital Library
- Martens, M.H. and Van Winsum, W., 2000. Measuring distraction: the peripheral detection task. TNO Human Factors, Soesterberg, Netherlands.Google Scholar
- Mehler, B., Reimer, B. and Dusek, J.A., 2011. MIT AgeLab delayed digit recall task (n-back). Cambridge, MA: Massachusetts Institute of Technology.Google Scholar
- Mulder, L.J.M., De Waard, D., Brookhuis, K.A., 2004. Estimating mental effort using heart rate and heart rate variability. In: Stanton, N., Hedge, A., Hendrick, H.W., Brookhuis, K.A., Salas, E. (Eds.), Handbook of Ergonomics and Human Factors Methods. Taylor & Francis, London, pp. 201--208. Google ScholarCross Ref
- Nass, C.I. and Brave, S., 2005. Wired for speech: How voice activates and advances the human-computer relationship. Cambridge: MIT press.Google Scholar
- NHTSA. 2013. Visual-Manual NHTSA Driver Distraction Guidelines For In-Vehicle Electronic Devices. NHTSA-2010-0053Google Scholar
- Owen, A.M., McMillan, K.M., Laird, A.R. and Bullmore, E., 2005. N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human brain mapping, 25(1), pp. 46--59. Google ScholarCross Ref
- Recarte, M.A. and Nunes, L.M., 2000. Effects of verbal and spatial-imagery tasks on eye fixations while driving. Journal of Experimental Psychology: Applied, 6(1), p. 31. Google ScholarCross Ref
- Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J., Medeiros-Ward, N. and Biondi, F., 2013. Measuring cognitive distraction in the automobile.Google Scholar
- Strayer, D.L., Turrill, J., Coleman, J.R., Ortiz, E.V. and Cooper, J.M., 2014. Measuring cognitive distraction in the automobile II: Assessing in-vehicle voice-based interactive technologies.Google Scholar
- Van der Horst, A.R.A. and Martens, M.H., 2010. The Peripheral Detection Task (PDT): On-line measurement of driver cognitive workload and selective attention. SAE International Journal, Special Issue.Google Scholar
- Wang, Y., Reimer, B., Mehler, B., Zhang, J., Mehler, A. and Coughlin, J.F., 2010, July. The impact of repeated cognitive tasks on driving performance and visual attention. In Proc. Proceedings of the 3rd International Conference on Applied Human Factors and Ergonomics. Google ScholarCross Ref
Index Terms
- Assessing Cognitive Demand during Natural Language Interactions with a Digital Driving Assistant
Recommendations
Natural Language, Mixed-initiative Personal Assistant Agents
IMCOM '18: Proceedings of the 12th International Conference on Ubiquitous Information Management and CommunicationThe increasing popularity and use of personal voice assistant technologies, such as Siri and Google Now, is driving and expanding progress toward the long-term and lofty goal of using artificial intelligence to build human-computer dialog systems ...
Wizard of Oz experiments and companion dialogues
BCS '10: Proceedings of the 24th BCS Interaction Specialist Group ConferenceNovel speech systems such as the conversational agents being developed by the Companions Project (www.companions-project.org) can be simulated using the Wizard of Oz methodology. In this approach technologies that are not yet ready for testing by people ...
Study on Text-based and Voice-based Dialogue Interfaces for Human-Computer Interactions in a Blocks World
HAI '20: Proceedings of the 8th International Conference on Human-Agent InteractionWe conducted a small scale user study to understand user experiences with two different forms of dialogue interfaces - text-based and voice-based - to interact with a virtual agent in a Blocks World environment while perform tower building tasks. The ...
Comments