Skip to main content
Log in

Generalized Thin-Plate Spline Warps

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

The Thin-Plate Spline warp has been shown to be a very effective parameterized model of the optic flow field between images of various types of deformable surfaces, such as a paper sheet being bent. Recent work has also used such warps for images of a smooth and rigid surface. Standard Thin-Plate Spline warps are however not rigid, in the sense that they do not comply with the epipolar geometry. They are also intrinsically affine, in the sense of the affine camera model, since they are not able to simply model the effect of perspective projection.

We propose three types of warps based on the Thin-Plate Spline. The first one is a rigid flexible warp. It describes the optic flow field induced by a smooth and rigid surface, and satisfies the affine epipolar geometry constraint. The second and third proposed warps extend the standard Thin-Plate Spline warp and the proposed rigid flexible warp to the perspective camera model. The properties of these warps are studied in details and a hierarchy is defined. Experimental results on simulated and real data are reported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bartoli, A. (2008). Maximizing the predictivity of smooth deformable image warps through cross-validation. Journal of Mathematical Imaging and Vision, 31(2–3), 133–145.

    Article  MathSciNet  Google Scholar 

  • Bartoli, A. (2009). On computing the prediction sum of squares statistic in linear least squares problems with multiple parameter or measurement sets. International Journal of Computer Vision, 85(2), 133–142.

    Article  MathSciNet  Google Scholar 

  • Bartoli, A., & Zisserman, A. (2004). Direct estimation of non-rigid registrations. In British machine vision conference.

  • Blanz, V., & Vetter, T. (2003). Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9).

  • Bookstein, F. L. (1989). Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(6), 567–585.

    Article  MATH  Google Scholar 

  • Bregler, C., Hertzmann, A., & Biermann, H. (2000). Recovering non-rigid 3D shape from image streams. In International conference on computer vision and pattern recognition.

  • Brunet, F., Bartoli, A., Malgouyres, R., & Navab, N. (2009). NURBS warps. In British machine vision conference.

  • Chojnacki, W., Brooks, M. J., van den Hengel, A., & Gawley, D. (2003). Revisiting Hartley’s normalised eight-point algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9), 1172–1177.

    Article  Google Scholar 

  • Chui, H., & Rangarajan, A. (2003). A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding, 89(2), 114–141.

    Article  MATH  Google Scholar 

  • Cootes, T. F., Marsland, S., Twining, C. J., Smith, K., & Taylor, C. J. (2004). Groupwise diffeomorphic non-rigid registration for automatic model building. In European conference on computer vision.

  • Donato, G., & Belongie, S. (2002). Approximate thin-plate spline mappings. In European conference on computer vision.

  • Duchon, J. (1976). Interpolation des fonctions de deux variables suivant le principe de la flexion des plaques minces. RAIRO Analyse Numérique, 10, 5–12.

    MathSciNet  Google Scholar 

  • Gay-Bellile, V., Bartoli, A., & Sayd, P. (2009). Direct estimation of non-rigid registrations with image-based self-occlusion reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence. To appear.

  • Hartley, R. I., & Zisserman, A. (2003). Multiple view geometry in computer vision (2nd ed.). Cambridge: Cambridge University Press.

    Google Scholar 

  • Irani, M., Anandan, P., & Cohen, M. (1999). Direct recovery of planar-parallax from multiple frames. In Proceedings of the international workshop on vision algorithms: theory and practice.

  • Lee, S. Y., Chwa, K. Y., Hahn, J., & Shin, S. Y. (1996). Image morphing using deformation techniques. Journal of Visualization and Computer Animation, 7, 3–26.

    Article  Google Scholar 

  • Lim, J., & Yang, M.-H. (2005). A direct method for non-rigid motion with thin-plate spline. In International conference on computer vision and pattern recognition.

  • Luong, Q.-T., & Vieville, T. (1996). Canonic representations for the geometries of multiple projective views. Computer Vision and Image Understanding, 64(2), 193–229.

    Article  Google Scholar 

  • Masson, L., Dhome, M., & Jurie, F. (2005). Tracking 3D objects using flexible models. In British machine vision conference.

  • Moreno, A., Delso, G., Camara, O., & Bloch, I. (2006). Non-linear registration between 3D images including rigid objects: Application to CT and PET lung images with tumors. In Workshop on image registration in deformable environments (DEFORM) at BMVC.

  • Perriollat, M., & Bartoli, A. (2006). A single directrix quasi-minimal model for paper-like surfaces. In Workshop on image registration in deformable environments (DEFORM) at BMVC.

  • Pilet, J., Lepetit, V., & Fua, P. (2008). Fast non-rigid surface detection, registration and realistic augmentation. International Journal of Computer Vision, 76(2), 109–122.

    Article  Google Scholar 

  • Prasad, M., Zisserman, A., & Fitzgibbon, A. (2006). Single view reconstruction of curved surfaces. In International conference on computer vision and pattern recognition.

  • Salzmann, M., Pilet, J., Ilic, S., & Fua, P. (2007). Surface deformation models for nonrigid 3D shape recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(8), 1–7.

    Article  Google Scholar 

  • Schaefer, S., McPhail, T., & Warren, J. (2006). Image deformation using moving least squares. In SIGGRAPH.

  • Sederberg, T. W., & Parry, S. R. (1986). Free-form deformation of solid geometric models. In SIGGRAPH.

  • Terzopoulos, D. (1983). Multilevel computational processes for visual surface reconstruction. Computer Vision, Graphics and Image Processing, 24, 52–96.

    Article  Google Scholar 

  • Wills, J., & Belongie, S. (2004). A feature-based approach for determining dense long range correspondences. In European conference on computer vision.

  • Yang, A. Y., Rao, S., Wagner, A., & Ma, Y. (2005). Segmentation of a piece-wise planar scene from perspective images. In International conference on computer vision and pattern recognition.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adrien Bartoli.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bartoli, A., Perriollat, M. & Chambon, S. Generalized Thin-Plate Spline Warps. Int J Comput Vis 88, 85–110 (2010). https://doi.org/10.1007/s11263-009-0303-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-009-0303-4

Keywords

Navigation