Marco Volino
ABSTRACT
This paper presents a framework for creating realistic virtual characters that can be delivered via the Internet and interactively controlled in a WebGL enabled web-browser. Four-dimensional performance capture is used to capture realistic human motion and appearance. The captured data is processed into efficient and compact representations for geometry and texture. Motions are analysed against a high-level, user-defined motion graph and suitable inter- and intra-motion transitions are identified. This processed data is stored on a webserver and downloaded by a client application when required. A Javascript-based character animation engine is used to manage the state of the character which responds to user input and sends required frames to a WebGL-based renderer for display. Through the efficient geometry, texture and motion graph representations, a game character capable of performing a range of motions can be represented in 40--50 MB of data. This highlights the potential use of four-dimensional performance capture for creating web-based content. Datasets are made available for further research and an online demo is provided.
- Allain, B., Franco, J.-S., Boyer, E., and Tung, T. 2014. On Mean Pose and Variability of 3D Deformable Models. In ECCV 2014 - European Conference on Computer Vision, Springer, Zurich, Switzerland.Google Scholar
- Arikan, O., and Forsyth, D. 2002. Interactive motion generation from examples. ACM Transactions on Graphics 21, 3 (July), 483--490. Google ScholarDigital Library
- Blumenthal-Barby, D. C., and Eisert, P. 2014. High-resolution depth for binocular image-based modeling. Computers and Graphics 39. Google ScholarDigital Library
- Budd, C., Grau, O., and Schübel, P. 2012. Web delivery of free-viewpoint video of sport events.Google Scholar
- Budd, C., Huang, P., Klaudiny, M., and Hilton, A. 2012. Global Non-rigid Alignment of Surface Sequences. International Journal of Computer Vision 102, 1-3 (Aug.), 256--270. Google ScholarDigital Library
- Casas, D., Tejera, M., Guillemaut, J., and Hilton, A. 2013. Interactive animation of 4d performance capture. Visualization and Computer Graphics, IEEE Transactions on 19, 5, 762--773. Google ScholarDigital Library
- Casas, D., Volino, M., Collomosse, J., and Hilton, A. 2014. 4d video textures for interactive character appearance. Computer Graphics Forum (Proc. Eurographics 2014) 33, 2. Google ScholarDigital Library
- de Aguiar, E., Stoll, C., and Theobalt, C. 2008. Performance capture from sparse multi-view video. ACM Transactions on . . ., 1--10. Google ScholarDigital Library
- Furukawa, Y., and Ponce, J. 2010. Accurate, dense, and robust multiview stereopsis. Pattern Analysis and Machine Intelligence, IEEE Transactions on 32, 8 (Aug), 1362--1376. Google ScholarDigital Library
- Goldluecke, B., and Cremers, D. 2009. Superresolution texture maps for multiview reconstruction. IEEE 12th International Conference on Computer Vision (Sept.), 1677--1684.Google Scholar
- Huang, P., and Hilton, A. 2009. Surface motion graphs for character animation from 3d video. In SIGGRAPH 2009: Talks, ACM, New York, NY, USA, SIGGRAPH '09, 56:1--56:1. Google ScholarDigital Library
- Huang, P., Tejera, M., Collomosse, J., and Hilton, A. 2015. Hybrid skeletal-surface motion graphs for character animation from 4d performance capture. ACM Trans. Graph. 34, 2 (Mar.), 17:1--17:14. Google ScholarDigital Library
- Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '02, 473--482. Google ScholarDigital Library
- Laurentini, A. 1994. The visual hull concept for silhouette-based image understanding. Pattern Analysis and Machine Intelligence, IEEE . . . . Google ScholarDigital Library
- Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., and Pollard, N. S. 2002. Interactive control of avatars animated with human motion data. ACM Transactions on Graphics 21, 3, 491--500. Google ScholarDigital Library
- Lévy, B., Petitjean, S., Ray, N., and Maillot, J. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Transactions on Graphics ( . . ., 362--371. Google ScholarDigital Library
- Piponi, D., and Borshukov, G. 2000. Seamless texture mapping of subdivision surfaces by model pelting and texture blending. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00, ACM Press, New York, New York, USA, 471--478. Google ScholarDigital Library
- Rubner, Y., Tomasi, C., and Guibas, L. J. 1998. A Metric for Distributions with Applications to Image Databases. Computer Vision, 1998. Sixth International Conference on, 59--66. Google ScholarDigital Library
- Starck, J., and Hilton, A. 2007. Surface capture for performance-based animation. Computer Graphics and Applications, IEEE 27, 3 (May), 21--31. Google ScholarDigital Library
- Theobalt, C., Ahmed, N., Lensch, H., Magnor, M., and Seidel, H.-P. 2007. Seeing people in different light--joint shape, motion, and reflectance capture. IEEE transactions on visualization and computer graphics 13, 4, 663--674. Google ScholarDigital Library
- Tsiminaki, V., Franco, J., and Boyer, E. 2014. High Resolution 3D Shape Texture from Multiple Videos. International Conference on . . . .Google Scholar
- Vlasic, D., Baran, I., Matusik, W., and Popović, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27, 3 (Aug.), 1. Google ScholarDigital Library
- Volino, M., Casas, D., Collomosse, J., and Hilton, A. 2014. Optimal representation of multiple view video. In British Machine Vision Conference.Google Scholar
Index Terms
- Online interactive 4D character animation
Recommendations
4D parametric motion graphs for interactive animation
I3D '12: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and GamesA 4D parametric motion graph representation is presented for interactive animation from actor performance capture in a multiple camera studio. The representation is based on a 4D model database of temporally aligned mesh sequence reconstructions for ...
Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture
We present a novel hybrid representation for character animation from 4D Performance Capture (4DPC) data which combines skeletal control with surface motion graphs. 4DPC data are temporally aligned 3D mesh sequence reconstructions of the dynamic surface ...
Layered acting for character animation
We introduce an acting-based animation system for creating and editing character animation at interactive speeds. Our system requires minimal training, typically under an hour, and is well suited for rapidly prototyping and creating expressive motion. A ...
Comments