Saverio Perugini
ABSTRACT
We present the first user study of out-of-turn interaction inmenu-based, interactive voice-response systems. Out-of-turn interaction is atechnique which empowers the user (unable to respond to the current prompt) totake the conversational initiative by supplying information that is currentlyunsolicited, but expected later in the dialog. The technique permits the userto circumvent any flows of navigation hardwired into the design and navigatethe menus in a manner which reflects their model of the task. We conducted alaboratory experiment to measure the effect of the use of out-of-turninteraction on user performance and preference in a menu-based, voice interfaceto voicemail. Specifically, we compared two interfaces with the exact samehierarchical menu design: one with the capability of accepting out-of-turnutterances and one without this feature. The results indicate that out-of-turninteraction significantly reduces task completion time, improves usability, andis preferred to the baseline. This research studies an unexplored dimension ofthe design space for automated telephone services, namely the nature ofuser-addressable input (utterance) supplied (in-turn vs. out-of-turn), incontrast to more traditional dimensions such as input modality (touch-tone vs.text vs. voice) and style of interaction (menu-based vs. natural language).
- J. F. Allen, C. I. Guinn, and E. Horvitz. Mixed-Initiative Interaction. IEEE Intelligent Systems, Vol. 14(5):pp. 14--23, 1999. Google Scholar
Digital Library
- B. Arons. Hyerspeech: Navigation in Speech-Only Hypermedia. In Proceedings of the Third Annual ACM conference on Hypertext (HT), pp. 133--146, 1991. Google ScholarDigital Library
- J. Brooke. SUS: A Quick and Dirty Usability Scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland, editors, Usability Evaluation in Industry, pp. 189--194. Taylor and Francis, London, 1996.Google Scholar
- A. L. Gorin, G. Riccardi, and J.H. Wright. How May I Help You? Speech Communication, Vol. 23:pp. 113--127, 1997. Google ScholarDigital Library
- V. Lakshmipathy, C. Schmandt, and N. Marmasse. TalkBack: A Conversational Answering Machine. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), pp. 41--50, 2003. Google ScholarDigital Library
- A. Mane, S. Boyce, D. Karis, and N. Yankelovich. Designing the User Interface for Speech Recognition Applications. ACM SIGCHI Bulletin, Vol. 28(4):pp. 29--34, 1996. Google ScholarDigital Library
- M. A. Marics and G. Engelbeck. Designing Voice Menu Applications for Telephones. In M. Helander, T.K. Landauer, and P.V. Prabhu, editors, Handbook of Human-Computer Interaction, pp. 1085--1102. Elsevier, Amsterdam, 1997.Google ScholarCross Ref
- P. Resnick and R. A. Virzi. Skip and Scan: Cleaning Up Telephone Interface. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 419--426, 1992. Google ScholarDigital Library
- P. Resnick and R. A. Virzi. Relief from the Audio Interface Blues: Expanding the Spectrum of Menu, List, and Form Styles. ACM Transactions on Computer-Human Interaction, Vol. 2(2):pp. 145--176, 1995. Google ScholarDigital Library
- M. Ringel and J. Hirschberg. Automated Message Prioritization: Making Voicemail Retrieval More Efficient. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 592--593, 2002. Interactive Poster. Google ScholarDigital Library
- B. Shneiderman. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley, Reading, MA, Third edition, 1998. Google ScholarDigital Library
- S. Srinivasan and E. Brown. Is Speech Recognition Becoming Mainstream? IEEE Computer, Vol. 35(4):pp. 38--41, 2002. Google ScholarDigital Library
- B. Suhm, J. Bers, D. McCarthy, B. Freeman, D. Getty, K. Godfrey, and P. Peterson. A Comparative Study of Speech in the Call Center: Natural Language Call Routing vs. Touch-tone Menus. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 275--282, 2002. Google ScholarDigital Library
- S. Tomko, T.K. Harris, A. Toth, J. Sanders, A. Rudnicky, and R. Rosenfeld. Towards Efficient Human Machine Speech Communication: The Speech Graffiti Project. ACM Transactions on Speech and Language Processing, Vol. 2(1):pp. 1--27, 2005. Google ScholarDigital Library
- S. Whittaker, R. Davis, J. Hirschberg, and U. Muller. Jotmail: a voicemail interface that enables you to see what was said. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 89--96, 2000. Google ScholarDigital Library
- S. Whittaker, J. Hirschberg, B. Amento, L. Stark, M. Bacchiani, P. Isenhour, L. Stead, G. Zamchick, and A. Rosenberg. SCANMail: A Voicemail Interface that Makes Speech Browsable, Readable and Searchable. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 275--282, 2002. Google ScholarDigital Library
- N. Yankelovich. How Do Users Know What To Say? ACM Interactions, Vol. 3(6):pp. 32--43, 1996. Google ScholarDigital Library
- M. Yin and S. Zhai. The Benefits of Augmenting Telephone Voice Menu Navigation with Visual Browsing and Search. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), pp. 319--327, 2006. Google ScholarDigital Library
- W. Zadrozny, M. Budzikowski, J. Chai, N. Kambhatla, S. Levesque, and N. Nicolov. Natural Language Dialogue for Personalized Interaction. Communications of the ACM, Vol. 43(8):pp. 116--120, 2000. Google ScholarDigital Library
Index Terms
- A study of out-of-turn interaction in menu-based, IVR, voicemail systems
Recommendations
A comparative study of speech in the call center: natural language call routing vs. touch-tone menus
CHI '02: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper presents a field study that compares natural language call routing with standard touch-tone menus. Call routing is the task of getting callers to the right place in the call center, which could be the appropriate live agent or automated ...
Staging transformations for multimodal web interaction management
WWW '04: Proceedings of the 13th international conference on World Wide WebMultimodal interfaces are becoming increasingly ubiquitous with the advent of mobile devices, accessibility considerations, and novel software technologies that combine diverse interaction media. In addition to improving access and delivery capabilities,...
Curing the menu blues in touch-tone voice interfaces
CHI EA '01: CHI '01 Extended Abstracts on Human Factors in Computing SystemsThis paper presents a study on touch-tone menu design. In particular, we investigated whether short or long menus route callers more efficiently to the destination that can handle the call. A short menu offers a small number of broad selections, while a ...
Comments