Skip to main content
SpringerLink
Log in

Comparing the User Preferences Towards Emotional Voice Interaction Applied on Different Devices: An Empirical Study

  • Conference paper
  • First Online:
Human-Computer Interaction. Multimodal and Natural Interaction (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12182))

Included in the following conference series:

Abstract

Voice interaction has been widely used. Designers hope to use artificial intelligence technology to create humanlike voice assistants, which not only help users handle the daily chores, but also provide emotional support and communication. Voice interaction has been utilized for both mobile and home automation, and many researchers have studied the emotional voice interaction of various devices. As different voice interaction products have diversified orientations and the functions integrated in them varies, users may prefer to use them under different operating conditions or interaction modes. This paper chooses mobile phone voice assistant and smart home voice assistant as study subjects, representing mobile and stand-alone voice assistant respectively. A 2 (voice assistant type: mobile phone assistant V.S. smart home assistant) × 3 (interaction level: low V.S. medium, V.S. high) between-subjects experiment was conducted. Then the influences of different devices and voice interaction modes on user emotional experience were discussed. Thus it provides reference and guidance for the voice interaction design of corresponding products.

The first two authors Liao and Zhang are designated as co-first authors of this article.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tucker, P., Jones, D.M.: Voice as interface: an overview. Int. J. Hum. Comput. Interact. 3(2), 145–170 (1991)

    Article  Google Scholar 

  2. Porcheron, M., Fischer, J.E., Reeves, S., Sharples, S.: Voice interfaces in everyday life. In: Conference on Human Factors in Computing Systems - Proceedings of CHI 2018, pp. 1–12. ACM (2018)

    Google Scholar 

  3. Norman, D.A.: Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York (2004)

    Google Scholar 

  4. Romportl, J.: Speech synthesis and uncanny valley. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2014. LNCS (LNAI), vol. 8655, pp. 595–602. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10816-2_72

    Chapter  Google Scholar 

  5. Chen, L., Su, W., Feng, Y., Wu, M., She, J., Hirota, K.: Two-layer fuzzy multiple random forest for speech emotion recognition in human-robot interaction. Inf. Sci. 509, 150–163 (2020)

    Article  Google Scholar 

  6. Xie, Y., Liang, R., Liang, Z., Huang, C., Zou, C., Schuller, B.: Speech emotion classification using attention-based LSTM. IEEE/ACM Trans. Audio Speech Lang. Process. 27(11), 1675–1685 (2019)

    Article  Google Scholar 

  7. Tebbi, H., Hamadouche, M., Azzoune, H.: TTS-SA (A text-to-speech system based on Standard Arabic). In: 4th International Conference on Digital Information and Communication Technology and its Applications, DICTAP 2014, pp. 337–341. IEEE Press, Bangkok (2014)

    Google Scholar 

  8. Becker, C., Kopp, S., Wachsmuth, I.: Why emotions should be integrated into conversational agents. In: Conversational Informatics: An Engineering Approach, pp. 49–67. Wiley (2007)

    Google Scholar 

  9. Torrey, C., Fussell, S.R., Kiesler, S.: How a robot should give advice. In: 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 275–282. IEEE Press (2013)

    Google Scholar 

  10. Xue, Y., Hamada, Y., Akagi, M.: Voice conversion for emotional speech: rule-based synthesis with degree of emotion controllable in dimensional space. Speech Commun. 102, 54–67 (2018)

    Article  Google Scholar 

  11. Kase, T., Nose, T., Ito, A.: On appropriateness and estimation of the emotion of synthesized response speech in a spoken dialogue system. In: Stephanidis, C. (ed.) HCI 2015. CCIS, vol. 528, pp. 747–752. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21380-4_126

    Chapter  Google Scholar 

  12. Niculescu, A., Dijk, B., Nijholt, A., Li, H., See, S.L.: Making social robots more attractive: the effects of voice pitch, humor and empathy. Int. J. Soc. Robot. 5(2), 171–191 (2013)

    Article  Google Scholar 

  13. Braun, M., Schubert, J., Pfleging, B., Alt, F.: Improving driver emotions with affective strategies. Multimodal Technol. Interact. 3(1), 21 (2019)

    Article  Google Scholar 

  14. Bickmore, T.W., Cassell, J.: Small talk and conversational storytelling in embodied interface agents. In: Proceedings of the AAAI Fall Symposium on Narrative Intelligence, pp. 87–92 (1999)

    Google Scholar 

  15. Braun, M., Mainz, A., Chadowitz, R., Pfleging, B., Alt, F: At your service: designing voice assistant personalities to improve automotive user interfaces a real world driving study. In: Conference on Human Factors in Computing Systems - Proceedings of CHI 2019. ACM, New York (2019)

    Google Scholar 

  16. Ehrenbrink, P., Osman, S., Möller, S.: Google now is for the extraverted, Cortana for the introverted: investigating the influence of personality on IPA preference. In: 29th Australian Conference on Human-Computer Interaction, pp. 257–265. ACM, New York (2017)

    Google Scholar 

  17. Doyle, P.R., Edwards, J., Dumbleton, O., Clark, L., Cowan, B.R.: Mapping perceptions of humanness in intelligent personal assistant interaction. In: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2019. ACM, New York (2019)

    Google Scholar 

  18. Sun, Y., et al.: Attempts to leverage interaction design to mimic emotional care and empathy-based feedback on smart speakers. In: Rau, P.-L.P. (ed.) HCII 2019. LNCS, vol. 11577, pp. 354–369. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22580-3_26

    Chapter  Google Scholar 

  19. Ge, X., Li, D., Guan, D., Xu, S., Sun, Y., Zhou, M.: Do smart speakers respond to their errors properly? A study on human-computer dialogue strategy. In: Marcus, A., Wang, W. (eds.) HCII 2019. LNCS, vol. 11584, pp. 440–455. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23541-3_32

    Chapter  Google Scholar 

  20. Lee, S.S., Lee, J., Lee, K.P.: Designing intelligent assistant through user participations. In: Proceedings of the 2017 ACM Conference on Designing Interactive Systems, DIS 2017, pp. 173–177. ACM, New York (2017)

    Google Scholar 

  21. Jiang, J., et al.: Automatic online evaluation of intelligent assistants. In: 24th International Conference on World Wide Web, WWW 2015, pp. 506–516. ACM (2015)

    Google Scholar 

  22. Carolus, A., Muench, R., Schmidt, C., Schneider, F.: Impertinent mobiles - effects of politeness and impoliteness in human-smartphone interaction. Comput. Hum. Behav. 93, 290–300 (2019)

    Article  Google Scholar 

  23. Ghosh, S., Pherwani, J.: Designing of a natural voice assistants for mobile through user centered design approach. In: Kurosu, M. (ed.) HCI 2015. LNCS, vol. 9169, pp. 320–331. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20901-2_29

    Chapter  Google Scholar 

  24. Luger, E., Sellen, A.: “Like having a really bad PA”: the gulf between user expectation and experience of conversational agents. In: Conference on Human Factors in Computing Systems - Proceedings of CHI 2016, pp. 5286–5297. ACM (2016)

    Google Scholar 

  25. Lopatovska, I., et al.: Talk to me: exploring user interactions with the Amazon Alexa. J. Librarianship Inform. Sci. 51(4), 984–997 (2019)

    Article  Google Scholar 

  26. Lutfi, S.L., Fernández-Martínez, F., Lorenzo-Trueba, J., Barra-Chicote, R., Montero, J.M.: I feel you: the design and evaluation of a domotic affect-sensitive spoken conversational agent. Sensors 13(8), 10519–10538 (2013)

    Article  Google Scholar 

  27. Purington, A., Taft, J.G., Sannon, S., Bazarova, N.N., Taylor, S.H.: “Alexa is my new BFF”: social roles, user satisfaction, and personification of the Amazon Echo. In: Conference on Human Factors in Computing Systems - Proceedings of CHI 2017, vol. Part F127655, pp. 2853–2859. ACM (2017)

    Google Scholar 

  28. Kiseleva, J., et al.: Understanding user satisfaction with intelligent assistants. In: Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, CHIIR 2016, pp. 121–130. ACM (2016)

    Google Scholar 

  29. Yang, H., Lee, H.: Understanding user behavior of virtual personal assistant devices. IseB 17(1), 65–87 (2019)

    Article  MathSciNet  Google Scholar 

  30. Ammari, T., Kaye, J., Tsai, J.Y., Bentley, F.: Music, search, and IoT: how people (really) use voice assistants. ACM Trans. Comput. Hum. Interact. 26(3) (2019)

    Google Scholar 

  31. Sciuto, A., Saini, A., Forlizzi, J., Hong, J.I.: “Hey Alexa, what’s up?”: studies of in-home conversational agent usage. In: Proceedings of the 2018 Designing Interactive Systems Conference, DIS 2018, pp. 857–868. ACM (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Sichuan University, Chengdu, 610065, China

    Qinglin Liao, Shanshan Zhang, Mei Wang, Jia Li, Xinrong Wang & Xuemei Deng

Authors
  1. Qinglin Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shanshan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jia Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xinrong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xuemei Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mei Wang .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liao, Q., Zhang, S., Wang, M., Li, J., Wang, X., Deng, X. (2020). Comparing the User Preferences Towards Emotional Voice Interaction Applied on Different Devices: An Empirical Study. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49062-1_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49061-4

  • Online ISBN: 978-3-030-49062-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation