Skip to main content
SpringerLink
Log in

Multiple structure recovery with maximum coverage

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

We present a general framework for geometric model fitting based on a set coverage formulation that caters for intersecting structures and outliers in a simple and principled manner. The multi-model fitting problem is formulated in terms of the optimization of a consensus-based global cost function, which allows to sidestep the pitfalls of preference approaches based on clustering and to avoid the difficult trade-off between data fidelity and complexity of other optimization formulations. Two especially appealing characteristics of this method are the ease with which it can be implemented and its modularity with respect to the solver and to the sampling strategy. Few intelligible parameters need to be set and tuned, namely the inlier threshold and the number of desired models. The summary of the experiments is that our method compares favourably with its competitors overall, and it is always either the best performer or almost on par with the best performer in specific scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. www.diegm.uniud.it/fusiello/demo/cov/.

References

  1. Magri, L., Fusiello, A.: Multiple models fitting as a set coverage problem. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3318–3326 (2016)

  2. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  3. Torr, P.H.S., Zisserman, A.: MLESAC: a new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78, 2000 (2000)

    Article  Google Scholar 

  4. Lebeda, K., Matas, J., Chum, O.: Fixing the locally optimized RANSAC–full experimental evaluation. In: British Machine Vision Conference, pp. 1–11 (2012)

  5. Choi, J., Medioni, G.G.: StaRSaC: Stable random sample consensus for parameter estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 675–682. IEEE (2009)

  6. Raguram, R., Chum, O., Pollefeys, M., Matas, J., Frahm, J.: USAC: a universal framework for random sample consensus. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 2022–2038 (2013)

    Article  Google Scholar 

  7. Zuliani, M., Kenney, C.S., Manjunath, B.S.: The multiRANSAC algorithm and its application to detect planar homographies. In: Proceedings of the IEEE International Conference on Image Processing, pp. III-153-6 (2005)

  8. Toldo, R., Fusiello, A.: Robust multiple structures estimation with J-Linkage. In: Proceedings of the European Conference on Computer Vision, pp. 537–547 (2008)

  9. Xu, L., Oja, E., Kultanen, P.: A new curve detection method: randomized Hough transform (RHT). Pattern Recognit. Lett. 11(5), 331–338 (1990)

    Article  MATH  Google Scholar 

  10. Subbarao, R., Meer, P.: Nonlinear mean shift for clustering over analytic manifolds. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1168–1175 (2006)

  11. Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  12. Zhang, W., Kosecká, J.: Nonparametric estimation of multiple structures with outliers. In: Workshop on Dynamic Vision, European Conference on Computer Vision 2006, vol. 4358 of Lecture Notes in Computer Science, pp. 60–74. Springer, Berlin (2006)

  13. Toldo, R., Fusiello, A.: Image-consistent patches from unstructured points with J-Linkage. Image Vis. Comput. 31(10), 756–770 (2013)

    Article  Google Scholar 

  14. Duin, R., Pekalska, E., Paclik, P., Tax, D.: The dissimilarity representation, a basis for domain based pattern recognition?. In: Pattern representation and the future of pattern recognition, ICPR 2004 Workshop Proceedings, pp. 43–56 (2004)

  15. Magri, L., Fusiello, A.: T-Linkage: a continuous relaxation of J-Linkage for multi-model fitting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3954–3961 (2014)

  16. Chin, T., Wang, H., Suter, D.: Robust fitting of multiple structures: the statistical learning approach. In: Proceedings of the International Conference on Computer Vision, pp. 413–420 (2009)

  17. Magri, L., Fusiello, A.: Multiple structure recovery via robust preference analysis. Image Vis Comput. 67, 1–15 (2017)

    Article  Google Scholar 

  18. Pham, T.-T., Chin, T.-J., Yu, J., Suter, D.: The random cluster model for robust geometric fitting. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1658–1671 (2014)

    Article  Google Scholar 

  19. Agarwal, S., Lim, J., Zelnik-manor, L., Perona, P., Kriegman, D., Belongie, S.: Beyond pairwise clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 838–845 (2005)

  20. Govindu, V.M.: A tensor decomposition for geometric grouping and segmentation. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 1, 1150–1157 (2005)

    Google Scholar 

  21. Jain, S., Govindu, V.M.: Efficient higher-order clustering on the grassmann manifold. In: Proceedings of the International Conference on Computer Vision, pp. 3511–3518 (2013)

  22. Zass, R., Shashua, A.: A unifying approach to hard and probabilistic clustering. In: Proceedings of the International Conference on Computer Vision, vol. 1, pp. 294–301 (2005)

  23. Isack, H., Boykov, Y.: Energy-based geometric multi-model fitting. Int. J. Comput. Vis. 97(2), 123–147 (2012)

    Article  MATH  Google Scholar 

  24. Gillis, N., Glineur, F.: Nonnegative factorization and the maximum edge biclique problem, arXiv preprint arXiv:0810.4225

  25. Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. Trans. Evol. Comput. 1(1), 67–82 (1997)

    Article  Google Scholar 

  26. Kleinberg, J.: An impossibility theorem for clustering. Adv. Neural Inf. Process. Syst. 463–470 (2003)

  27. Chin, T.-J., Yu, J., Suter, D.: Accelerated hypothesis generation for multistructure data via preference analysis. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 625–638

  28. Kanazawa, Y., Kawakami, H.: Detection of planar regions with uncalibrated stereo using distributions of feature points. In: British Machine Vision Conference, pp. 247–256 (2004)

  29. Karp, R.M.: Reducibility Among Combinatorial Problems. Springer, Berlin (1972)

    Book  MATH  Google Scholar 

  30. Feige, U.: A threshold of ln(n) for approximating set cover. J. ACM 45(4), 634–652 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  31. Vazirani, V.V.: Approximation Algorithms. Springer, Berlin (2013)

    Google Scholar 

  32. Torr, P.H., Murray, D.W.: Stochastic motion clustering. In: Proceedings of the European Conference on Computer Vision, pp. 328–337. Springer, Berlin (1994)

  33. Li, H.: Two-view motion segmentation from linear programming relaxation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

  34. Schindler, K., Suter, D.: Two-view multibody structure-and-motion with outliers through model selection. IEEE Trans. Pattern Anal. Mach. Intell. 28(6), 983–995 (2006)

    Article  Google Scholar 

  35. Lazic, N., Givoni, I.E., Frey, B.J., Aarabi, P.: FLoSS: Facility location for subspace segmentation. In: Proceedings of the International Conference on Computer Vision, pp. 825–832 (2009)

  36. Yu, J., Chin, T., Suter, D.: A global optimization approach to robust multi-model fitting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2041–2048 (2011)

  37. Delong, A., Veksler, O., Boykov, Y.: Fast fusion moves for multi-model estimation. In: Proceedings of the European Conference on Computer Vision, pp. 370–384 (2012)

  38. Pham, T.T., Chin, T.-J., Schindler, K., Suter, D.: Interacting geometric priors for robust multimodel fitting. IEEE Trans. Image Process. 23(10), 4601–4610 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  39. http://www.diegm.uniud.it/fusiello/demo/jlk/

  40. http://www.diegm.uniud.it/fusiello/demo/rpa/

  41. Soltanolkotabi, M., Elhamifar, E., Candès, E.J.: Robust subspace clustering. Ann. Stat. 42(2), 669–699 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  42. http://cs.adelaide.edu.au/~trung

  43. http://www.vision.jhu.edu/code/

  44. Denis, P., Elder, J.H., Estrada, F.J.: Efficient edge-based methods for estimating manhattan frames in urban imagery. In: Proceedings of the European Conference on Computer Vision, pp. 197–210 (2008)

  45. Tron, R., Vidal, R.: A benchmark for the comparison of 3-d motion segmentation algorithms. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007)

  46. Sugaya, Y., Matsushita, Y., Kanatani, K.: Removing mistracking of multibody motion video database Hopkins155. In: British Machine Vision Conference (2013)

  47. Skiena, S.: The Algorithm Design Manual. Springer, London (2009)

    MATH  Google Scholar 

  48. http://www.robots.ox.ac.uk/vgg/data/data-mview.html

  49. http://www.diegm.uniud.it/fusiello/demo/samantha

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, University of Milan, Via Saldini, 50, 20133, Milan, Italy

    Luca Magri

  2. DPIA - University of Udine, Via delle Scienze, 208, Udine, Italy

    Andrea Fusiello

Authors
  1. Luca Magri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrea Fusiello
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Fusiello.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Magri, L., Fusiello, A. Multiple structure recovery with maximum coverage. Machine Vision and Applications 29, 159–173 (2018). https://doi.org/10.1007/s00138-017-0883-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-017-0883-x

Keywords

Search

Navigation