Jieun Kim
Gonzalo Gonzalez-Pumariega
Susan R. Fussell
ABSTRACT
Voice agents play a crucial role in providing verbal guidance to users, especially during emergency situations to ensure their successful evacuation. While the vocal presentation of emotion significantly impacts communication effectiveness in human-agent interaction, the context-dependent impacts of emotional voice in an emergency setting remain unexplored. This study investigates the effects of voice agents’ emotional expressions conveyed through tone (i.e., Calm vs. Urgent) during a fire emergency simulation. Participants (N=30) conducted an online simulation game where a voice agent instruct them on how to evacuate from a building, while their evacuation time was tracked. After the game, participants evaluated the task experience and the voice agent’s trustworthiness and context-appropriateness. Results show that the voice agent using an urgent voice increased the participants’ cognitive trust in the agent and context-appropriateness to the emergency, compared to the agent using a calm voice. The study findings provide design implications for a voice agent’s emergency instructions, aiming for an effective evacuation process.
- Sibel Adali, Robert Escriva, Mark K Goldberg, Mykola Hayvanovych, Malik Magdon-Ismail, Boleslaw K Szymanski, William A Wallace, and Gregory Williams. 2010. Measuring behavioral trust in social networks. In 2010 IEEE international conference on intelligence and security informatics. IEEE, 150–152.Google Scholar
Cross Ref
- Kyoko Arai. 2013. How to transmit disaster information effectively: A linguistic perspective on Japan’s Tsunami Warnings and Evacuation Instructions. International journal of disaster risk science 4, 3 (2013), 150–158.Google ScholarCross Ref
- Praveen Damacharla, Parashar Dhakal, Sebastian Stumbo, Ahmad Y Javaid, Subhashini Ganapathy, David A Malek, Douglas C Hodge, and Vijay Devabhaktuni. 2019. Effects of voice-based synthetic assistant on performance of emergency care provider in training. International Journal of Artificial Intelligence in Education 29, 1 (2019), 122–143.Google ScholarCross Ref
- Jill L Drury, Laurel Riek, and Nathan Rackliffe. 2006. A decomposition of UAV-related situation awareness. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. 88–94.Google ScholarDigital Library
- Judy Edworthy, Elizabeth Hellier, Kathryn Walters, Wendy Clift-Mathews, and Mark Crowther. 2003. Acoustic, semantic and phonetic influences in spoken warning signal words. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 17, 8 (2003), 915–933.Google Scholar
- Martin Fishbein and Icek Ajzen. 1977. Belief, attitude, intention, and behavior: An introduction to theory and research. Philosophy and Rhetoric 10, 2 (1977).Google Scholar
- Jonas Foehr and Claas Christian Germelmann. 2020. Alexa, can I trust you? Exploring consumer paths to trust in smart voice-interaction technologies. Journal of the Association for Consumer Research 5, 2 (2020), 181–205.Google ScholarCross Ref
- Quehong Gan, Zhen Liu, Tingting Liu, and Yanjie Chai. 2022. An indoor evacuation guidance system with an AR virtual agent. Procedia Computer Science 213 (2022), 636–642.Google ScholarDigital Library
- Judith A Hall and Mark L Knapp. 2013. Welcome to the handbook of nonverbal communication. Nonverbal communication (2013), 3–10.Google Scholar
- Zhongyi Huang, Siqi Cao, Zhiming Fang, Rui Ye, Zi Wang, and Xiaolian Li. 2021. Effect of voice alarms on temporal characteristics of the evacuation process inside metro train carriages: an experiment study. Safety science 142 (2021), 105403.Google ScholarCross Ref
- Jieun Kim, Woochan Kim, Jungwoo Nam, and Hayeon Song. 2020. "I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.Google ScholarDigital Library
- Sherrie YX Komiak and Izak Benbasat. 2006. The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS quarterly (2006), 941–960.Google Scholar
- Celeste Paul and Anita Komlodi. 2012. Emotion as an indicator for future interruptive notification experiences. In CHI’12 Extended Abstracts on Human Factors in Computing Systems. 2003–2008.Google Scholar
- Ioannis Politis, Stephen Brewster, and Frank Pollick. 2015. Language-based multimodal displays for the handover of control in autonomous cars. In Proceedings of the 7th international conference on automotive user interfaces and interactive vehicular applications. 3–10.Google ScholarDigital Library
- David Purser. 2010. Comparisons of evacuation efficiency and pre-travel activity times in response to a sounder and two different voice alarm messages. In Pedestrian and evacuation dynamics 2008. Springer, 121–134.Google Scholar
- Lisong Qiu, Yingwai Shiu, Pingping Lin, Ruihua Song, Yue Liu, Dongyan Zhao, and Rui Yan. 2020. What If Bots Feel Moods?. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1161–1170.Google ScholarDigital Library
- Tracy Sanders, Kristin E Oleson, Deborah R Billings, Jessie YC Chen, and Peter A Hancock. 2011. A model of human-robot trust: Theoretical model development. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 55. SAGE Publications Sage CA: Los Angeles, CA, 1432–1436.Google ScholarCross Ref
- Ilaria Torre and Laurence White. 2021. Trust in Vocal Human–Robot Interaction: Implications for Robot Voice Design. In Voice Attractiveness. Springer, 299–316.Google Scholar
- Cristen Torrey, Susan R Fussell, and Sara Kiesler. 2013. How a robot should give advice. In 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 275–282.Google ScholarCross Ref
- Biao Wang, Shiquan Xiong, Shuping Yi, Qian Yi, and Fangfei Yan. 2019. Measuring network user trust via mouse behavior characteristics under different emotions. In HCI for Cybersecurity, Privacy and Trust: First International Conference, HCI-CPT 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings 21. Springer, 471–481.Google Scholar
- Mun On Wong, Hui Zhou, Huaquan Ying, and Sanghoon Lee. 2022. A voice-driven IMU-enabled BIM-based multi-user system for indoor navigation in fire emergencies. Automation in Construction 135 (2022), 104137.Google ScholarCross Ref
- Priscilla NY Wong, Duncan P Brumby, Harsha Vardhan Ramesh Babu, and Kota Kobayashi. 2019. Voices in Self-Driving Cars Should be Assertive to More Quickly Grab a Distracted Driver’s Attention. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 165–176.Google ScholarDigital Library
Index Terms
- Urgency Builds Trust: A Voice Agent's Emotional Expression in an Emergency
Recommendations
Integrated Agent-Based Modeling with GIS for Large Scale Emergency Simulation
ISICA '08: Proceedings of the 3rd International Symposium on Advances in Computation and IntelligenceRecent development in the area of complex dynamic systems includes the integration of agent-based modeling (ABM) and Geographical Information Systems (GIS), which is used to simulate spatial dynamic processes. The use of ABM for experimenting and ...
Trust Model Based on M-CRGs in Emergency Response
WISM '09: Proceedings of the International Conference on Web Information Systems and MiningMany research results demonstrate that government itself cannot handle all the requests from residents in emergency response. Some scholars proposed that building community response grids which utilized pre-existing communities to support citizen ...
Mediating individual affective experience through the emotional photo frame
Affect Aware Ubiquitous ComputingA photograph is considered a medium with emotional legibility and a means of expressing and exchanging emotional experience. This research presents the interactive emotional photo frame system focusing on mediating individual affective experience among ...
Comments