Margarita Papaefthymiou
George Papagiannakis
ABSTRACT
In this work we present a complete methodology for robust authoring of AR virtual characters powered from a versatile character animation framework (Smartbody), using only mobile devices. We can author, fully augment with life-size, animated, geometrically accurately registered virtual characters into any open space in less than 1 minute with only modern smartphones or tablets and then automatically revive this augmentation for subsequent activations from the same spot, in under a few seconds. Also, we handle efficiently scene authoring rotations of the AR objects using Geometric Algebra rotors in order to extract higher quality visual results. Moreover, we have implemented a mobile version of the global illumination for real-time Precomputed Radiance Transfer algorithm for diffuse shadowed characters in real-time, using High Dynamic Range (HDR) environment maps integrated in our open-source OpenGL Geometric Application (glGA) framework. Effective character interaction plays fundamental role in attaining high level of believability and makes the AR application more attractive and immersive based on the SmartBody framework.
- Arnold, D., Day, A., and J. Glauert, e. a. 2008. Tools for populating cultural heritage environments with interactive virtual humans. EPOCH Conference on Open Digital Cultural Heritage Systems, 1--7.Google Scholar
- Dorst, L., Fontijne, D., and Mann, S. 2010. Geometric Algebra for Computer Science. Morgan Kaufmann.Google Scholar
- Egges, A., Papagiannakis, G., and MagnenatThalmann, N. 2007. Presence and interaction in mixed reality environments. Visual Computer 23, 5, 317--333. Google ScholarDigital Library
- Feng, A., Huang, Y., Xu, Y., and Shapiro, A. 2014. Fast, automatic character animation pipelines. Computer Animation and Virtual Worlds 25, 1 (Jan.), 3--16. Google ScholarDigital Library
- Gandy, M., and MacIntyre, B. 2014. Designers augmented reality toolkit, ten years later: Implications for new media authoring tools. UIST, 627--636. Google ScholarDigital Library
- Green, R. 2003. Spherical harmonic lighting: The gritty details. Game Developers' Conference.Google Scholar
- Gun, A. L., and Billinghurst, M. 2013. A component based framework for mobile outdoor ar applications. In SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications (SA '13), 173--179. Google ScholarDigital Library
- Hestens, D., and Sobczyk, G. 1984. Clifford Algebra to Geometric Calculus: A Unified Language for Mathematics and Physics. Reidel Dordrecht.Google Scholar
- Huang, Z., Hui, P., Peylo, C., and D. Chatzopoulos. 2013. Mobile augmented reality survey: A bottom-up approach.Google Scholar
- Jung, Y., and et al., A. K. D. F. Believable virtual characters in human-computer dialogs. Eurographics 2011 - State of The Art Report, 75--100.Google Scholar
- Kanbara, M., and Yokoya, N. 2002. Geometric and photometric registration for real-time augmented reality. In Proceedings of ISMAR2002, 15--22. Google ScholarDigital Library
- Kopp, S., Krenn, B., Marsella, S., Marshall, A. N., Pelachaud, C., Pirker, H., Thórisson, K. R., and Vilhjálmsson, H. 2006. Towards a common framework for multimodal generation: The behavior markup language. In Intelligent virtual agents, Springer, 205--217. Google ScholarDigital Library
- Langlotz, T., Mooslechner, S., Zollmann, S., Reitmayr, C. D. G., and Schmalstieg, D. 2012. Sketching up the world: in situ authoring for mobile augmented reality. Personal and Ubiquitous Computing 16, 6, 623--630. Google ScholarDigital Library
- Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., and Shapiro, A. 2013. Virtual character performance from speech. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, 25--35. Google ScholarDigital Library
- Nowrouzezahrai, D., Geiger, S., Mitchell, K., Sumner, R., Jarosz, W., and Gross, M. 2011. Light factorization for mixed-frequency shadows in augmented reality. Computer Animation and Virtual Worlds, 173--179.Google Scholar
- Papagiannakis, G., Schertenleib, S., Ponder, M., Arevalo, M., Magnenat-Thalmann, N., and Thalmann, D. 2004. Real-time virtual humans in ar sites. 1st European Conference on Visual Media Production CVMP, 273--276.Google Scholar
- Papagiannakis, G., Papanikolaou, P., Greasidou, E., and Trahanias, P. 2014. glga: an opengl geometric application framework for a modern, shader-based computer graphics curriculum. Eurographics 2014, 1--8.Google Scholar
- Papagiannakis, G., Greasidou, E., P. Trahanias, and Tsioumas, M. 2015. Mixed-reality geometric algebra animation methods for gamified intangible heritage. International Journal of Heritage in the Digital 3, 683--699.Google ScholarCross Ref
- Shapiro, A. 2011. Building a character animation system.Google Scholar
- Sloan, P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of ACM SIGGRAPH. Google ScholarDigital Library
- Sloan, P. 2008. Stupid spherical harmonics(sh) tricks. GDC 2008, 1--42.Google Scholar
- Vacchetti, L., Lepetit, V., Ponder, M., Papagiannakis, G., Fua, P., Thalmann, D., and Thalmann, N. M. 2004. Stable real-time ar framework for training and planning in industrial environments. Virtual Reality and Augmented Reality Applications in Manufacturing, Ong, S. K., Nee, A. Y. C. (eds), ISBN: 1-85233-796-4, Springer-Verlag, 125--142.Google Scholar
- Xu, Y., Feng, A. W., Marsella, S., and Shapiro, A. 2013. A practical and configurable lip sync method for games. In Proceedings of Motion on Games, ACM, 131--140. Google ScholarDigital Library
Index Terms
- A fast and robust pipeline for populating mobile AR scenes with gamified virtual characters
Recommendations
A fast relighting engine for interactive cinematic lighting design
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniquesWe present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information ...
Interactive global illumination in dynamic scenes
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniquesIn this paper, we present a system for interactive computation of global illumination in dynamic scenes. Our system uses a novel scheme for caching the results of a high quality pixel-based renderer such as a bidirectional path tracer. The Shading Cache ...
Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments
We present a new, real-time method for rendering diffuse and glossy objects in low-frequency lighting environments that captures soft shadows, interreflections, and caustics. As a preprocess, a novel global transport simulator creates functions over the ...
Comments