Austin Lee
Hiroshi Ishii
ABSTRACT
We introduce AnnoScape, a remote collaboration system that allows users to overlay live video of the physical desktop image on a shared 3D virtual workspace to support individual and collaborative review of 2D and 3D content using hand gestures and real ink. The AnnoScape system enables distributed users to visually navigate the shared 3D virtual workspace individually or jointly by moving tangible handles; simultaneously snap into a shared viewpoint and generate a live video overlay of freehand annotations from the desktop surface onto the system's virtual viewports which can be placed spatially in the 3D data space. Finally, we present results of our preliminary user study and discuss design issues and AnnoScape's potential to facilitate effective communication during remote 3D data reviews.
Supplemental Material
- Ahmed M. Elgammal, David Harwood, and Larry S. Davis. 2000. Non-parametric Model for Background Subtraction. In Proceedings of the 6th European Conference on Computer Vision-Part II (ECCV '00), David Vernon (Ed.). Google Scholar
Digital Library
- Austin Seugmin Lee. 2013. Use of Live Video Overlay on 3D Data for Distributed Collaborative Review. M.S. thesis. Dept. of Architecture. Program of Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.Google Scholar
- Autodesk Revit. Retrieved May, 2013, from: http://www.autodesk.com/products/autodesk-revitfamily/overviewGoogle Scholar
- Digital Project, Gehry Technology. Retrieved May, 2013, from: http://www.gehrytechnologies.com/digitalprojectGoogle Scholar
- George W. Fitzmaurice, Hiroshi Ishii, and William A. S. Buxton. 1995. Bricks: laying the foundations for graspable user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95), Irvin R. Katz, Robert Mack, Linn Marks, Mary Beth Rosson, and Jakob Nielsen (Eds.). Google ScholarDigital Library
- Google Hangouts. Retrieved May, 2013, from: https://www.google.com/+/learnmore/hangouts/Google Scholar
- H. Ishii. 1990. TeamWorkStation: towards a seamless shared workspace. In Proceedings of the 1990 ACM conference on Computer-supported cooperative work (CSCW '90). Google ScholarDigital Library
- Hiroshi Ishii and Minoru Kobayashi. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), Penny Bauersfeld, John Bennett, and Gene Lynch (Eds.). Google ScholarDigital Library
- I. Poupyrev, N. Tomokazu, and S. Weghorst. 1998. Virtual Notepad: Handwriting in Immersive VR. In Proceedings of the Virtual Reality Annual International Symposium (VRAIS '98). Google ScholarDigital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented surfaces: a spatially continuous work space for hybrid computing environments. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). Google ScholarDigital Library
- M. Stefik, D. G. Bobrow, G. Foster, S. Lanning, and D. Tatar. 1987. WYSIWIS revised: early experiences with multiuser interfaces. ACM Trans. Inf. Syst. 5, 2 (April 1987), 147--167. DOI=10.1145/27636.28056 Google ScholarDigital Library
- Michael Glueck, Sean Anderson, and Azam Khan. 2010. DeskCube: using physical zones to select and control combinations of 3D navigation operations. In Proceedings of the 2010 Spring Simulation Multiconference (SpringSim '10). Society for Computer Simulation International, San Diego, CA, USA, Article 200 , 4 pages. Google ScholarDigital Library
- Michael Tsang, George W. Fitzmzurice, Gordon Kurtenbach, Azam Khan, and Bill Buxton. 2003. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. In ACM SIGGRAPH 2003. Google ScholarDigital Library
- Morten Fjeld, Fred Voorhorst, Martin Bichsel, Kristina Lauche, Matthias Rauterberg, and Helmut Krueger. 1999. Exploring Brick-Based Navigation and Composition in an Augmented Reality. In Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing (HUC '99) Google ScholarDigital Library
- Moum, A. 2010. Design Team stories, Automation in Construction vol. 19 issue 5 August, 2010. p. 554--569.Google Scholar
- Pierre Wellner. 1993. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7 (July 1993), 87--96. Google ScholarDigital Library
- Sasa Junuzovic, Kori Inkpen, Tom Blank, and Anoop Gupta. 2012. IllumiShare: sharing any surface. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI '12). Google ScholarDigital Library
- Shunichi Kasahara, Valentin Heun, Austin S. Lee, and Hiroshi Ishii. 2012. Second surface: multi-user spatial collaboration system based on augmented reality. In SIGGRAPH Asia 2012 Emerging Technologies (SA '12). Google ScholarDigital Library
- Timbuktu(software). Retrieved May, 2013, from: http://en.wikipedia.org/wiki/Timbuktu_(software)Google Scholar
Index Terms
- AnnoScape: remote collaborative review using live video overlay in shared 3D virtual workspace
Recommendations
CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging TechnologiesWe present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Comments