Nate Hagbi
Skip Abstract Section
Abstract
Sketching leverages human skills for various purposes, such as content authoring. This paper explores the different aspects of sketch-based interaction in augmented reality. We explore the design space of sketching in in-place augmented reality with particular attention to AR games. We propose a contextual model that offers a framework for the exploration of the design space by the research community. We describe different case studies of sketch-based AR games we developed based on our shape-based tracking library and our sketch-based 3-D game engine. We finally present user feedback from our games and introduce guidelines for AR game designers focusing on sketch-based interaction.
- Alvarado, C. and Davis R. Resolving Ambiguities to Create a Natural Computer-Based Sketching Environment. In Proceedings of IJCAI'01, Washington, USA, August 2001, p 1365--1371. Google Scholar
Digital Library
- Anabuki, M. and Ishii, H. 2007. AR-Jig: A Handheld Tangible User Interface for Modification of 3D Digital Form via 2D Physical Curve. In Proceedings of ISMAR'07, 2007, IEEE Computer Society, p 1--10. Google ScholarDigital Library
- Anderson, D., Frankel, J. L., Marks, J., Agarwala, A., Beardsley, P., Hodgins, J., Leigh, D., Ryall, K., Sullivan, E., and Yedidia, J. S. Tangible interaction + graphical interpretation: a new approach to 3D modeling. In Proceedings of SIGGRAPH 2000, 2000. ACM, pp 393--402. Google ScholarDigital Library
- Barnes, C., Jacobs, D. E., Sanders, J., Goldman, D. B., Rusinkiewicz, S., Finkelstein, A., and Agrawala, M. Video puppetry: a performative interface for cutout animation. In ACM SIGGRAPH Asia 2008 Papers, 2008, ACM, p 1--9. Google ScholarDigital Library
- Oriel Bergig, Nate Hagbi, Jihad El-Sana, and Mark Billinghurst. In-place 3D Sketching for Authoring and Augmenting Mechanical Aystems. IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'09), 2009, 87--94. Google ScholarDigital Library
- Bertin, J., Barbut, M., Sémiologie Graphique. Les diagrammes, les réseaux, les cartes. 1967. Gauthier-Villars.Google Scholar
- Bimber, O., Raskar, R., Modern Approaches to Augmented Reality, EUROGRAPHICS 2004 Courses, 2004.Google Scholar
- Cheok, A. D., Edmund, N. W., and Eng, A. W. 2002. Inexpensive Non-Sensor Based Augmented Reality Modeling of Curves and Surfaces in Physical Space. In Proceedings of ISMAR'02., 2002., IEEE Computer Society, p 273. Google ScholarDigital Library
- Clark, A., Grant, R., Green, R. Perspective Correction for improved visual registration using natural features. In Proceedings of IVCNZ 2008, 2008, IEEE Computer Society.Google ScholarCross Ref
- Cook, M. T. and Agah, A. 2009. A survey of sketch-based 3-D modelling techniques. Interacting with Computers, 21(3) (July 2009), p 201--211. Google ScholarDigital Library
- Deering, M. F. 1996. The HoloSketch VR sketching system. Communications of the ACM 39(5) (May 1996), p 54--61. Google ScholarDigital Library
- Ferley, E., Cani, M., and Gascuel, J. 2001. Resolution adaptive volume sculpting. Graphical Models 63(6) (November 2001), p 459--478. Google ScholarDigital Library
- Fiorentino, M., de Amicis, R., Monno, G., and Stork, A. 2002. Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design. In Proceedings of ISMAR'02, 2002, IEEE Computer Society, p 86. Google ScholarDigital Library
- Gross, M. D., Visual languages and visual thinking: sketch based interaction and modelling. In Proceedings of SBIM'09. 2009. ACM. p 7--11. Google ScholarDigital Library
- Hagbi, N., Bergig, O., El-Sana, J., Billinghurst, M., Shape Recognition and Pose Estimation for Mobile Augmented Reality. To appear in IEEE Transactions on Visualization and Computer Graphics, 2011. Google ScholarDigital Library
- Nate Hagbi, Raphael Grasset, Oriel Bergig, and Mark Billinghurst. In-Place Sketching for Content Authoring in Augmented Reality Games. In Proceedings of IEEE Virtual Reality (VR), 2010, p 91--94. Google ScholarDigital Library
- Henrysson, A., Billinghurst, M., and Ollila, M. 2006. AR Tennis. In Proceedings of ACM SIGGRAPH 2006 Sketches, 2006. p 13. Google ScholarDigital Library
- Huynh, D. T., Raveendran, K., Xu, Y., Spreen, K., and MacIntyre, B. 2009. Art of defense: a collaborative handheld augmented reality board game. In Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, 2009, ACM, p 135--142. Google ScholarDigital Library
- Jung Von Matt/next. Tagged in Motion. http://nextwall.net/content/projekt/taggedinmotion.php.Google Scholar
- H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto, and K. Tachibana, Virtual Object Manipulation on a Table-Top AR Environment. In Proceedings of ISAR 2000, 2000, p. 111--119.Google ScholarCross Ref
- H. Kato, M. Billinghurst, I. Poupyrev, N. Tetsutani, and K. Tachibana, Tangible Augmented Reality for Human Computer Interaction. In Proceedings of Nicograph 2001, Nagoya, Japan, 2001.Google Scholar
- LaViola, J. J. and Zeleznik, R. C. 2004. MathPad2: a system for the creation and exploration of mathematical sketches. In Proceedings of ACM SIGGRAPH 2004, 2004, ACM, p 432--440. Google ScholarDigital Library
- Leitner, J., Köffel, C., Haller, M., Bridging the gap between real and virtual objects for tabletop game. International Journal of Virtual Reality, 2006, 5(3), p 1--5.Google Scholar
- Löchtefeld, M., Schöning, J., Rohs, M., Krüger, A. LittleProjectedPlanet: An Augmented Reality Game for Camera Projector Phones. In Proceedings of Mobile HCI 2009: Workshop on Mobile Interaction with the Real World (MIRW'09), 2009.Google Scholar
- Milgram, P., H. Takemura, Utsumi, A., Kishino, F., Augmented Reality: A Class of Displays on the Reality-Virutality Continuum. In SPIE Proceedings: Telemanipulator and Telepresence Technologies, 1994, SPIE. 2351: p 282--292.Google Scholar
- Mynatt, E. D., Igarashi, T., Edwards, W. K., and LaMarca, A. 1999. Flatland: new dimensions in office whiteboards. In Proceedings of CHI'99, 1999, ACM, p 346--353. Google ScholarDigital Library
- Oda, O., Lister, L. J., White, S., and Feiner, S. 2007. Developing an augmented reality racing game. In Proceedings of the 2nd international Conference on intelligent Technologies For Interactive Entertainment, 2008, p 1--8. Google ScholarDigital Library
- Olsen, L., Samavati, F. F., Sousa, M. C., and Jorge, J. A., Technical Section: Sketch-based modeling: A survey. Computer and Graphics. 33(1) (February 2009), p 85--103. Google ScholarDigital Library
- Petzold, F., Pfeil, J., Riechert, C. and Green, R., AR Bridge Builder: Real-time Vectorisation of Freehand Sketched Structures for an AR Application. In Proceedings of IVCNZ 2007, 2007, IEEE Computer Society, p 192--197.Google Scholar
- Ryokai, K., Marti, S., and Ishii, H. 2004. I/O brush: drawing with everyday objects as ink. In Proceedings of CHI'04, 2004, ACM, p 303--310. Google ScholarDigital Library
- Sareika M., Schamlstieg D., Urban Sketcher: Mixing Realities in the Urban Planning and Design Process. In Proc. of CHI'08 Workshop, 2008.Google Scholar
- Schkolne, S., Pruett, M., and Schröder, P. 2001. Surface drawing: creating organic 3D shapes with the hand and tangible tools. In Proceedings of CHI'01, 2001. ACM, p 261--268. Google ScholarDigital Library
- Ryan Schmidt, Karan Singh, Ravin Balakrishnan. (2008). Sketching and composing widgets for 3D manipulation. In Proceedings of Eurographics 2008. p 301--310.Google ScholarCross Ref
- Seichter, H., Sketchand+. In Computer-Aided Architectural Design Research in Asia (CAADRIA 2003), 2003, p 209--219.Google Scholar
- Sutherland, I. E. 1963. Sketchpad: A man-machine graphical communication system. In Proceedings of AFIPS'63, 1963, ACM, p 329--346. Google ScholarDigital Library
- Thorne, M., Burke, D., and van de Panne, M. 2004. Motion doodles: an interface for sketching character motion. In Proceedings of ACM SIGGRAPH 2004, 2004, ACM, p 424--431. Google ScholarDigital Library
- Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., Schmalstieg, D., Pose Tracking from Natural Features on Mobile Phones, In Proceedings of ISMAR'08, 2008, Cambridge, UK. Google ScholarDigital Library
- Xin, M., Sharlin, E., and Sousa, M. C. 2008. Napkin sketch: handheld mixed reality 3D sketching. In Proceedings of VRST'08, 2008, ACM, p 223--226. Google ScholarDigital Library
- Xin, M., Sharlin, E., Sousa, M. C., Greenberg, S., and Samavati, F. 2007. Purple crayon: from sketches to interactive environment. In Proceedings of ACE'07, 2007, vol. 203. ACM, p 208--211. Google ScholarDigital Library
- Yee, B., Ning, Y., Lipson, H. Augmented Reality In-Situ 3D Sketching of Physical Objects, in Proceedings of IUI'09, 2009.Google Scholar
- Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. SKETCH: an interface for sketching 3D scenes. In Proceedings of ACM SIGGRAPH 1996. ACM, p 163--170. Google ScholarDigital Library
Index Terms
- In-Place Sketching for Augmented Reality Games
Recommendations
Guidelines for designing augmented reality games
Future Play '08: Proceedings of the 2008 Conference on Future Play: Research, Play, ShareThe growing popularity of augmented reality (AR) games in both a research and more recently commercial context has led for a need to take a closer look at design related issues which impact on player experience. While issues relating to this area have ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical SystemsAs shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Comments