Abstract
A system is developed that from an image sequence of a deformable object automatically extracts features and tracks them through the sequence, estimates the non-rigid 3D structure and finally computes a surface triangulation. Also the camera motion is acquired. The object is supposed to deform according to a linear model, while the motion of the camera can be arbitrary. No domain specific prior of the object is required.
For the structure estimation a two-step approach is used, where we first obtain an initial estimate of the structure and motion, and then obtain an optimal solution via a non-linear optimization scheme. The triangulation is optimized to yield a non-rigid faceted surface that well approximates the true 3D surface.
Chapter PDF
References
H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Workshop on Vision and Modelling of Dynamic Scenes, ECCV’02, Copenhagen, Denmark, 2002.
H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Technical report, Centre for Mathematical Sciences, Lund University, January 2002.
H. Akaike. A new look at the statistical model identification. IEEE Trans. on Automatic Control, 19(6):716–723, 1974.
C. Bregler, A. Hertzmann, and H. Biermann. Recovering non-rigid 3d shape from image streams. Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), pages 690–6 vol.2, 2000.
T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models — their training and application. Computer Vision, Graphics and Image Processing, 61(1):38–59, January 1995.
J.D. Foley, A. van Dam, S.K. Feiner and J.F. Hughes Computer Graphics: Principles and Practice in C (2nd Edition). Addison-Wesley Pub Co., 1995.
R. Hartley and A. Zisserman. Multiple View Geometry. Cambridge University Press, The Edinburgh Building, Cambridge CB2 2RU, UK, 2000.
M. Irani. Multi-frame optical flow estimation using subspace constraints. IEEE International Conference on Computer Vision (ICCV), Corfu, September 1999
A. Lanitis, C.J. Taylor and T.F. Cootes. Automatic interpretation of human faces and hand gestures using flexible models. In International Workshop on Automatic Face-and Gesture-Recognition, 1995
B. Lucas and T. Kanade An iterative image registration technique with an application to stereo vision. Proceedings 7th International Joint Conference on Artificial Intelligence, 1981
D.D. Morris and T. Kanade. Image-consistent surface triangulation. IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000, vol 1, pp 332–338, 2000.
H. Sidenbladh, M. J. Black, and D. J. Fleet. Stochastic tracking of 3d human figures using 2d image motion. In European Conf, Computer Vision’2000, volume 2, pages 702–718, 2000.
C.C. Slama, editor. Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, VA, 4:th edition, 1984.
C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3d body tracking. In IEEE Conf. Computer Vision and Pattern Recognition’2001, volume I, pages 447–454, 2001.
C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: a factorization method. Int’l J. Computer Vision’92, 9(2):137–154, November 1992.
L. Torresani, D.B. Yang, E.J. Alexander, and C. Bregler. Tracking and modeling non-rigid objects with rank constraints. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, 1:493–500, 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Svensson, C., Aanæs, H., Kahl, F. (2003). Structure Estimation and Surface Triangulation of Deformable Objects. In: Bigun, J., Gustavsson, T. (eds) Image Analysis. SCIA 2003. Lecture Notes in Computer Science, vol 2749. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45103-X_94
Download citation
DOI: https://doi.org/10.1007/3-540-45103-X_94
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40601-3
Online ISBN: 978-3-540-45103-7
eBook Packages: Springer Book Archive