Becky Spittle
Payod Panda
John Tang
Sasa Junuzovic
Abigail Sellen
Sean Rintel
ABSTRACT
Hybridge is an experimental system for exploring the design of remote inclusion for hybrid meetings. In-room users see remote participants on individual displays positioned around a table, and remotes see video feeds from the room integrated into a digital twin of the meeting room. Remotes can choose where to appear in and view the meeting room from. We designed two digital interfaces for remote attendees, one using a 2D canvas, and the other using a 3D digital twin of the room as the medium of interaction. To decide which interface to use for future evaluation, we conducted a within-subjects comparison of 24 groups completing survival tasks. We found that 3D outperformed 2D in the participants’ perceived sense of awareness, sense of agency, and physical presence. The majority of participants also subjectively preferred 3D over 2D. We discuss design recommendations based on usage patterns and participant comments, and plans for further research.
Footnotes
Supplemental Material
Available for Download
- Rachel Bergmann, Sean Rintel, Nancy Baym, Advait Sarkar, Damian Borowiec, Priscilla Wong, and Abigail Sellen. 2022. Meeting (the) Pandemic: Videoconferencing Fatigue and Evolving Tensions of Sociality in Enterprise Video Meetings During COVID-19. Computer Supported Cooperative Work (CSCW) (Nov. 2022). https://doi.org/10.1007/s10606-022-09451-6Google Scholar
Digital Library
- Nathan D Bos, Ayse Buyuktur, Judith S Olson, Gary M Olson, and Amy Voida. 2010. Shared identity helps partially distributed teams, but distance still matters. In Proceedings of the 16th ACM international conference on Supporting group work. 89–96.Google ScholarDigital Library
- John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).Google Scholar
- Judee K Burgoon, Valerie Manusov, and Laura K Guerrero. 2021. Nonverbal communication. Routledge.Google Scholar
- William A. S. Buxon. 1997. Living in Augmented Reality: Ubiquitous Media and Reactive Environments. In Video-Mediated Communication, Kathleen E. Finn, Abigail J. Sellen, and Sylvia B. Wilbur (Eds.). L. Erlbaum Associates Inc., Mahwah NJ, USA, 363–384.Google Scholar
- Thomas J. Cashman, Tim Hutton, Martin de La Gorce, Tibor Takács, Antonio Criminisi, Milica Ðorđević, Goran Dubajić, Ðorđe Marjanović, Milena Okošanović, Vukašin Ranković, Ivan Razumenić, Bojan Roško, Teo Šarkić, Marko Skakun, Miloš Stojanović, Nikola Veličković, Predrag Jovanović, Payod Panda, Lev Tankelevitch, and Sean Rintel. 2024. An Equal Seat at the Table: Exploring Videoconferencing with Shared Spatial Context combined with 3D Video Representations. In Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA, May 11–16, 2024) (CHI EA ’24). Association for Computing Machinery, New York, NY, USA, 9 pages. https://doi.org/10.1145/3613905.3650903Google ScholarDigital Library
- Mark H.D. Danton and Ian Bushnell. 2023. Zoom and its Discontents: Group Decision Making in Pediatric Cardiology in the Time of COVID (and Beyond). Journal of Medical Systems 47, 1 (May 2023), 59. https://doi.org/10.1007/s10916-023-01944-1Google ScholarCross Ref
- Melanie Duckert, Louise Barkhuus, and Pernille Bjørn. 2023. Collocated Distance: A Fundamental Challenge for the Design of Hybrid Work Technologies. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 612, 16 pages. https://doi.org/10.1145/3544548.3580899Google ScholarDigital Library
- Carmen Egido. 1988. Video conferencing as a technology to support group work: a review of its failures. In Proceedings of the 1988 ACM conference on Computer-supported cooperative work(CSCW ’88). Association for Computing Machinery, New York, NY, USA, 13–24. https://doi.org/10.1145/62266.62268Google ScholarDigital Library
- engadget. 2006. Cisco’s TelePresence Meeting does video meetings in ultra-HD. https://www.engadget.com/2006-10-23-ciscos-telepresence-meeting-does-video-meetings-in-ultra-hd.html/.Google Scholar
- Kathleen E. Finn, Abigail J. Sellen, and Sylvia B. Wilbur (Eds.). 1997. Video-Mediated Communication. L. Erlbaum Associates Inc., Mahwah NJ, USA.Google Scholar
- Charles Goodwin. 2002. Time in Action. Current Anthropology 43, S4 (Aug. 2002), S19–S35. https://doi.org/10.1086/339566 Publisher: The University of Chicago Press.Google ScholarCross Ref
- Jens Emil Grønbæk, Banu Saatçi, Carla F Griggio, and Clemens Nylandsted Klokmose. 2021. MirrorBlender: Supporting Hybrid Meetings with a Malleable Video-Conferencing System. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Jay Hall and W. H. Watson. 1970. The Effects of a Normative Intervention on Group Decision-Making Performance. Human Relations 23, 4 (Aug. 1970), 299–317. https://doi.org/10.1177/001872677002300404 Publisher: SAGE Publications Ltd.Google ScholarCross Ref
- Steve Harrison (Ed.). 2009. Media Space 20+ Years of Mediated Life. Springer-Verlag, London. https://doi.org/10.1007/978-1-84882-483-6Google ScholarCross Ref
- Christian Heath and Paul Luff. 1992. Media Space and Communicative Asymmetries: Preliminary Observations of Video-Mediated Interaction. Human–Computer Interaction 7, 3 (1992), 315–346. https://doi.org/10.1207/s15327051hci0703_3Google ScholarDigital Library
- Jon Hindmarsh, Mike Fraser, Christian Heath, Steve Benford, and Chris Greenhalgh. 1998. Fragmented Interaction: Establishing Mutual Orientation in Virtual Environments. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’98). Association for Computing Machinery, New York, NY, USA, 217–226. https://doi.org/10.1145/289444.289496Google ScholarDigital Library
- Ramon Hofer, Christoph Ganser, and Andreas Kunz. 2006. MatrixView: extending immersion in video conferencing. (2006), 3 p.https://doi.org/10.3929/ETHZ-A-005713962 Artwork Size: 3 p. Medium: application/pdf Publisher: ETH Zurich.Google ScholarCross Ref
- Felix Immohr, Gareth Rendle, Annika Neidhardt, Steve Göring, Rakesh Rao Ramachandra Rao, Stephanie Arevalo Arboleda, Bernd Froehlich, and Alexander Raake. 2023. Proof-of-Concept Study to Evaluate the Impact of Spatial Audio on Social Presence and User Behavior in Multi-Modal VR Communication. In Proceedings of the 2023 ACM International Conference on Interactive Media Experiences (Nantes, France) (IMX ’23). Association for Computing Machinery, New York, NY, USA, 209–215. https://doi.org/10.1145/3573381.3596458Google ScholarDigital Library
- Ellen A. Isaacs and John C. Tang. 1994. What video can and cannot do for collaboration: A case study. Multimedia Systems 2, 2 (Aug. 1994), 63–73. https://doi.org/10.1007/BF01274181Google ScholarDigital Library
- Adam Kendon. 1967. Some functions of gaze-direction in social interaction. Acta Psychologica 26 (Jan. 1967), 22–63. https://doi.org/10.1016/0001-6918(67)90005-4Google ScholarCross Ref
- Adam Kendon. 2010. Spacing and Orientation in Co-present Interaction. In Development of Multimodal Interfaces: Active Listening and Synchrony: Second COST 2102 International Training School, Dublin, Ireland, March 23-27, 2009, Revised Selected Papers, Anna Esposito, Nick Campbell, Carl Vogel, Amir Hussain, and Anton Nijholt (Eds.). Springer, Berlin, Heidelberg, 1–15. https://doi.org/10.1007/978-3-642-12397-9_1Google ScholarDigital Library
- Kristine M. Kuhn. 2022. The constant mirror: Self-view and attitudes to virtual meetings. Computers in Human Behavior 128 (March 2022), 107110. https://doi.org/10.1016/j.chb.2021.107110Google ScholarDigital Library
- Anastasia Kuzminykh and Sean Rintel. 2020. Classification of Functional Attention in Video Meetings. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376546Google ScholarDigital Library
- Amanda Lacy, Seth Polsley, Samantha Ray, and Tracy Hammond. 2022. A Seat at the Virtual Table: Emergent Inclusion in Remote Meetings. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 426 (nov 2022), 20 pages.Google ScholarDigital Library
- Jason Lawrence, Danb Goldman, Supreeth Achar, Gregory Major Blascovich, Joseph G. Desloge, Tommy Fortes, Eric M. Gomez, Sascha Häberling, Hugues Hoppe, Andy Huibers, Claude Knaus, Brian Kuschak, Ricardo Martin-Brualla, Harris Nover, Andrew Ian Russell, Steven M. Seitz, and Kevin Tong. 2021. Project Starline: A High-Fidelity Telepresence System. ACM Trans. Graph. 40, 6, Article 242 (dec 2021), 16 pages. https://doi.org/10.1145/3478513.3480490Google ScholarDigital Library
- Khanh-Duy Le, Ignacio Avellino, Cédric Fleury, Morten Fjeld, and Andreas M Kunz. 2019. GazeLens: Guiding Attention to Improve Gaze Interpretation in Hub-Satellite Collaboration. Lecture Notes in Computer Science (01 2019), 282–303. https://doi.org/10.1007/978-3-030-29384-0_18Google ScholarDigital Library
- Khanh-Duy Le, Morten Fjeld, Ali Alavi, and Andreas Kunz. 2017. Immersive environment for distributed creative collaboration. VRST ’17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (11 2017). https://doi.org/10.1145/3139131.3139163Google ScholarDigital Library
- Zhengqing Li, Shio Miyafuji, Erwin Wu, Hideaki Kuzuoka, Naomi Yamashita, and Hideki Koike. 2019. OmniGlobe: An Interactive I/O System For Symmetric 360-Degree Video Communication. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 1427–1438. https://doi.org/10.1145/3322276.3322314Google ScholarDigital Library
- Christian Licoppe, Paul K. Luff, Christian Heath, Hideaki Kuzuoka, Naomi Yamashita, and Sylvaine Tuncer. 2017. Showing Objects: Holding and Manipulating Artefacts in Video-mediated Collaborative Settings, In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI ’17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 5295–5306. https://doi.org/10.1145/3025453.3025848 event-place: Denver, Colorado, USA.Google ScholarDigital Library
- Paul Luff, Christian Heath, Hideaki Kuzuoka, Jon Hindmarsh, Keiichi Yamazaki, and Shinya Oyama. 2003. Fractured Ecologies: Creating Environments for Collaboration. Human–Computer Interaction 18, 1-2 (2003), 51–84. https://doi.org/10.1207/S15327051HCI1812_3Google ScholarDigital Library
- Lorenza Mondada. 2009. Emergent focused interactions in public places: A systematic analysis of the multimodal achievement of a common interactional space. Journal of pragmatics 41, 10 (2009), 1977–1997.Google ScholarCross Ref
- Thomas Neumayr, Mirjam Augstein, and Bettina Kubicek. 2022. Territoriality in Hybrid Collaboration. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2, Article 332 (nov 2022), 37 pages. https://doi.org/10.1145/3555224Google ScholarDigital Library
- David Nguyen and John Canny. 2005. MultiView: spatially faithful group video conferencing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’05). Association for Computing Machinery, New York, NY, USA, 799–808. https://doi.org/10.1145/1054972.1055084Google ScholarDigital Library
- Loi Anh Nguyen, Rebecca Evan, Sanghamitra Chaudhuri, Marcia Hagen, and Denise Williams. 2023. Inclusion in the workplace: an integrative literature review. European Journal of Training and Development ahead-of-print, ahead-of-print (Jan. 2023). https://doi.org/10.1108/EJTD-10-2022-0104Google ScholarCross Ref
- Kate Nowak, Lev Tankelevitch, John Tang, and Sean Rintel. 2023. Hear We Are: Spatial Audio Benefits Perceptions of Turn-Taking and Social Presence in Video Meetings. In Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work (, Oldenburg, Germany, ) (CHIWORK ’23). Association for Computing Machinery, New York, NY, USA, Article 2, 10 pages. https://doi.org/10.1145/3596671.3598578Google ScholarDigital Library
- Kenton O’hara, Jesper Kjeldskov, and Jeni Paay. 2011. Blended Interaction Spaces for Distributed Team Collaboration. ACM Trans. Comput.-Hum. Interact. 18, 1 (May 2011), 3:1–3:28. https://doi.org/10.1145/1959022.1959025Google ScholarDigital Library
- Kazuhiro Otsuka. 2016. MMSpace: Kinetically-augmented telepresence for small group-to-group conversations, In 2016 IEEE Virtual Reality (VR). IEEE Virtual Reality (VR), 19–28. https://doi.org/10.1109/VR.2016.7504684Google ScholarCross Ref
- Jay Peters. 2023. Logitech is working on a Project Starline-like video chat booth called Project Ghost. https://www.theverge.com/2023/1/31/23577918/logitech-steelcase-project-ghost-video-chat-booth-starlineGoogle Scholar
- Roger Pye and Ederyn Williams. 1977. Teleconferencing: is video valuable or is audio adequate?Telecommunications Policy 1, 3 (jun 1977), 230–241. https://doi.org/10.1016/0308-5961(77)90027-1Google ScholarCross Ref
- Karen Ruhleder and Brigitte Jordan. 2001. Co-Constructing Non-Mutual Realities: Delay-Generated Trouble in Distributed Interaction. 10, 1 (jan 2001), 113–138. https://doi.org/10.1023/A:1011243905593Google ScholarDigital Library
- Banu Saatçi, Kaya Akyüz, Sean Rintel, and Clemens Nylandsted Klokmose. 2020. (Re) Configuring Hybrid Meetings: Moving from User-Centered Design to Meeting-Centered Design. Computer Supported Cooperative Work (CSCW) 29, 6 (2020), 769–794.Google ScholarDigital Library
- Banu Saatçi, Roman Rädle, Sean Rintel, Kenton O’Hara, and Clemens Nylandsted Klokmose. 2019. Hybrid Meetings in the Modern Workplace: Stories of Success and Failure. In International Conference on Collaboration and Technology. Springer, 45–61.Google Scholar
- Abigail Sellen, Bill Buxton, and John Arnott. 1992. Using Spatial Cues to Improve Videoconferencing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 651–652. https://doi.org/10.1145/142750.143070Google ScholarDigital Library
- Lucas M. Seuren, Joseph Wherton, Trisha Greenhalgh, and Sara E. Shaw. 2021. Whose turn is it anyway? Latency and the organization of turn-taking in video-mediated interaction. Journal of Pragmatics 172 (Jan. 2021), 63–78. https://doi.org/10.1016/j.pragma.2020.11.005Google ScholarCross Ref
- Lynn M. Shore, Jeanette N. Cleveland, and Diana Sanchez. 2018. Inclusive workplaces: A review and model. Human Resource Management Review 28, 2 (June 2018), 176–189. https://doi.org/10.1016/j.hrmr.2017.07.003Google ScholarCross Ref
- Robert Stults. 1986. Media Space. Technical Report. Xerox PARC. https://www.academia.edu/44010741/Media%5FSpace%5FXerox%5FPARC%5F1986?auto=downloadGoogle Scholar
- John C. Tang, Kori Inkpen, Sasa Junuzovic, Keri Mallari, Andrew D. Wilson, Sean Rintel, Shiraz Cupala, Tony Carbary, Abigail Sellen, and William A.S. Buxton. 2023. Perspectives: Creating Inclusive and Equitable Hybrid Meeting Experiences. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 351 (oct 2023), 25 pages. https://doi.org/10.1145/3610200Google ScholarDigital Library
- Cameron Teoh, Holger Regenbrecht, and David O’Hare. 2012. How the Other Sees Us: Perceptions and Control in Videoconferencing. In Proceedings of the 24th Australian Computer-Human Interaction Conference (Melbourne, Australia) (OzCHI ’12). Association for Computing Machinery, New York, NY, USA, 572–578. https://doi.org/10.1145/2414536.2414624Google ScholarDigital Library
- Martin Usoh, Ernest Catena, Sima Arman, and Mel Slater. 2000. Using presence questionnaires in reality. Presence 9, 5 (2000), 497–503.Google ScholarDigital Library
- Roel Vertegaal, Ivo Weevers, Changuk Sohn, and Chris Cheung. 2003. GAZE-2: Conveying Eye Contact in Group Video Conferencing Using Eye-Controlled Camera Direction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 521–528. https://doi.org/10.1145/642611.642702Google ScholarDigital Library
- Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. 143–146.Google ScholarDigital Library
- Yizhong Zhang, Jiaolong Yang, Zhen Liu, Ruicheng Wang, Guojun Chen, Xin Tong, and Baining Guo. 2022. VirtualCube: An Immersive 3D Video Communication System. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 2146–2156. https://doi.org/10.1109/TVCG.2022.3150512Google ScholarCross Ref
Index Terms
- Comparing the Agency of Hybrid Meeting Remote Users in 2D and 3D Interfaces of the Hybridge System
Recommendations
CoExplorer: Generative AI Powered 2D and 3D Adaptive Interfaces to Support Intentionality in Video Meetings
CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing SystemsCurrent online meeting technologies lack holistic support for reducing the effort of planning and running meetings. We present CoExplorer2D and CoExplorerVR, generative AI (GenAI)-driven technology probes for exploring the significant transformative ...
Perspectives: Creating Inclusive and Equitable Hybrid Meeting Experiences
CSCWWith the shift to hybrid meetings in work spaces, there is an increasing need to create a more inclusive hybrid meeting experience where people meeting together in a room interact with those joining remotely. This paper describes a design exploration, ...
Tools to Assist Meeting Planning
Meetings take up a large amount of time, especially at the upper managerial levels. To help meetings progress smoothly and reach desired goals, meeting facilitators are frequently called in. Facilitators have at their disposal a number of techniques, ...
Comments