skip to main content
10.1145/3610978.3640703acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
short-paper
Open Access

Prototyping a User Interface for Multi-Robot Speech Control

Published:11 March 2024Publication History

ABSTRACT

The Wizard-of-Oz (WoZ) method is a common and beneficial means of enabling researchers with control over robots in experimental settings. However, there is a lack of general robot control tools for WoZ that are publicly available and easily adaptable to various research domains and needs. In particular, existing control interfaces that may be used in WoZ experiments often do not support the control of multi-robot interactions. As such, in this work, we present the design of three prototypes for a multi-robot speech control interface that would enable the control of multi-robot dialogue interactions.

Skip Supplemental Material Section

Supplemental Material

lbr1156.mp4

Supplemental video

mp4

32.2 MB

References

  1. Paul Baxter, James Kennedy, Emmanuel Senft, Severin Lemaignan, and Tony Belpaeme. 2016. From characterising three years of HRI to methodology and reporting recommendations. In Proceedings of the 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  2. Alexandra Bejarano, Samantha Reig, Priyanka Senapati, and Tom Williams. 2022. You Had Me at Hello: The Impact of Robot Group Presentation Strategies on Mental Model Formation. In Proceedings of the 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI).Google ScholarGoogle ScholarCross RefCross Ref
  3. Alexandra Bejarano and Tom Williams. 2023. No Name, No Voice, Less Trust: Robot Group Identity Performance, Entitativity, and Trust Distribution. In 32nd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).Google ScholarGoogle ScholarCross RefCross Ref
  4. Abhinav Dahiya, Alexander M Aroyo, Kerstin Dautenhahn, and Stephen L Smith. 2023. A survey of multi-agent Human--Robot Interaction systems. Robotics and Autonomous Systems (2023).Google ScholarGoogle Scholar
  5. Dylan F Glas, Takayuki Kanda, Hiroshi Ishiguro, and Norihiro Hagita. 2008. Simultaneous teleoperation of multiple social robots. In Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Siying Hu, Hen Chen Yen, Ziwei Yu, Mingjian Zhao, Katie Seaborn, and Can Liu. 2023. Wizundry: A Cooperative Wizard of Oz Platform for Simulating Future Speech-based Interfaces with Multiple Wizards. Proceedings of the ACM on Human-Computer Interaction, Vol. 7, CSCW1 (2023).Google ScholarGoogle Scholar
  7. Ryan Blake Jackson, Alexandra Bejarano, Katie Winkle, and Tom Williams. 2021. Design, performance, and perception of robot identity. In Workshop on Robo-Identity: Artificial identity and multi-embodiment at HRI.Google ScholarGoogle Scholar
  8. Edith Law, Vicky Cai, Qi Feng Liu, Sajin Sasy, Joslin Goh, Alex Blidaru, and Dana Kulić. 2017. A wizard-of-oz study of curiosity in human-robot interaction. In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Michal Luria, Samantha Reig, Xiang Zhi Tan, Aaron Steinfeld, Jodi Forlizzi, and John Zimmerman. 2019. Re-Embodiment and Co-Embodiment: Exploration of social presence for robots and conversational agents. In Proceedings of the 2019 on Designing Interactive Systems Conference. 633--644.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Matthew Marge, Stephen Nogar, Cory J Hayes, Stephanie M Lukin, Jesse Bloecker, Eric Holder, and Clare Voss. 2019. A Research Platform for Multi-Robot Dialogue with Humans. NAACL HLT 2019 (2019).Google ScholarGoogle Scholar
  11. Bastian Pfleging, Norman Seyffer, Zina Beek, and Sebastian Zug. 2023. A Wizard-of-Oz Setup to Assess Pedestrian Behavior and Teach Delivery Robots on Sidewalk Encounters. In Workshopband Mensch und Computer 2023: MCI-WS17: Robots for Public and Social Spaces - Design for Intent Communication, Collaboration and Acceptance. GI. https://doi.org/10.18420/muc2023-mci-ws17--459Google ScholarGoogle ScholarCross RefCross Ref
  12. Samantha Reig, Michal Luria, Elsa Forberger, Isabel Won, Aaron Steinfeld, Jodi Forlizzi, and John Zimmerman. 2021. Social robots in service contexts: Exploring the rewards and risks of personalization and re-embodiment. In Designing Interactive Systems Conference 2021. 1390--1402.Google ScholarGoogle Scholar
  13. Laurel D Riek. 2012. Wizard of oz studies in hri: a systematic review and new reporting guidelines. Journal of Human-Robot Interaction, Vol. 1, 1 (2012).Google ScholarGoogle Scholar
  14. Finn Rietz, Alexander Sutherland, Suna Bensch, Stefan Wermter, and Thomas Hellström. 2021. WoZ4U: an open-source wizard-of-oz interface for easy, efficient and robust HRI experiments. Frontiers in Robotics and AI, Vol. 8 (2021).Google ScholarGoogle ScholarCross RefCross Ref
  15. Eike Schneiders, EunJeong Cheon, Jesper Kjeldskov, Matthias Rehm, and Mikael B Skov. 2022. Non-dyadic interaction: A literature review of 15 years of human-robot interaction conference publications. ACM Transactions on Human-Robot Interaction (THRI), Vol. 11, 2 (2022).Google ScholarGoogle Scholar
  16. Brett Stoddard, Abrar Fallatah, and Heather Knight. 2021. A web-based user interface for HRI studies on multi-robot furniture arrangement. In Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI).Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Hamish Tennent, Wen-Ying Lee, Yoyo Tsung-Yu Hou, Ilan Mandel, and Malte Jung. 2018. Paperino: Remote wizard-of-oz puppeteering for social robot behaviour design. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Michael Villano, Charles R Crowell, Kristin Wier, Karen Tang, Brynn Thomas, Nicole Shea, Lauren M Schmitt, and Joshua J Diehl. 2011. DOMER: A Wizard of Oz interface for using interactive robots to scaffold social skills for children with Autism Spectrum Disorders. In Proceedings of the 6th International Conference on Human-robot interaction (HRI).Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Tom Williams, Daniel Ayers, Camille Kaufman, Jon Serrano, and Sayanti Roy. 2021. Deconstructed trustee theory: Disentangling trust in body and identity in multi-robot distributed systems. In Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction. 262--271.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Prototyping a User Interface for Multi-Robot Speech Control

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction
          March 2024
          1408 pages
          ISBN:9798400703232
          DOI:10.1145/3610978

          Copyright © 2024 Owner/Author

          This work is licensed under a Creative Commons Attribution International 4.0 License.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 11 March 2024

          Check for updates

          Qualifiers

          • short-paper

          Acceptance Rates

          Overall Acceptance Rate242of1,000submissions,24%
        • Article Metrics

          • Downloads (Last 12 months)19
          • Downloads (Last 6 weeks)12

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader