Abstract
Much effort has been directed at algorithms for obtaining the highest probability (MAP) configuration in probabilistic (random field) models. In many situations, one could benefit from additional high-probability solutions. Current methods for computing the M most probable configurations produce solutions that tend to be very similar to the MAP solution and each other. This is often an undesirable property. In this paper we propose an algorithm for the Diverse M-Best problem, which involves finding a diverse set of highly probable solutions under a discrete probabilistic model. Given a dissimilarity function measuring closeness of two solutions, our formulation involves maximizing a linear combination of the probability and dissimilarity to previous solutions. Our formulation generalizes the M-Best MAP problem and we show that for certain families of dissimilarity functions we can guarantee that these solutions can be found as easily as the MAP solution.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Barbu, A., Zhu, S.-C.: Generalizing swendsen-wang to sampling arbitrary posterior probabilities. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1239–1253 (2005)
Barinova, O., Lempitsky, V., Kohli, P.: On detection of multiple object instances using hough transforms. In: CVPR, pp. 2233–2240 (2010)
Blaschko, M.: Branch and Bound Strategies for Non-maximal Suppression in Object Detection. In: Boykov, Y., Kahl, F., Lempitsky, V., Schmidt, F.R. (eds.) EMMCVPR 2011. LNCS, vol. 6819, pp. 385–398. Springer, Heidelberg (2011)
Bottou, L., Bousquet, O.: The tradeoffs of large scale learning. In: Adv. in NIPS, pp. 161–168 (2008)
Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press (March 2004)
Boykov, Y., Jolly, M.-P.: Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In: ICCV (2001)
Boykov, Y., Veksler, O., Zabih, R.: Efficient approximate energy minimization via graph cuts. PAMI 20(12), 1222–1239 (2001)
Emma Rollon, N.F., Dechter, R.: Inference schemes for m best solutions for soft csps. In: Proceedings of Workshop on Preferences and Soft Constraints (2011)
Fromer, M., Globerson, A.: An LP view of the m-best MAP problem. In: NIPS (2009)
Kohli, P., Kumar, M.P.: Energy minimization for linear envelope mrfs. In: CVPR, pp. 1863–1870 (2010)
Kohli, P., Torr, P.H.S.: Effciently solving dynamic markov random fields using graph cuts. In: ICCV, pp. 922–929 (2005)
Kohli, P., Torr, P.H.S.: Measuring uncertainty in graph cut solutions. CVIU 112(1), 30–38 (2008)
Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts? PAMI 26(2), 147–159 (2004)
Komodakis, N., Paragios, N.: Beyond pairwise energies: Efficient optimization for higher-order MRFs. In: CVPR (2009)
Ladickỳ, L., Russell, C., Kohli, P., Torr, P.H.S.: Associative hierarchical CRFs for object class image segmentation. In: ICCV (2009)
Ladicky, L., Russell, C., Kohli, P., Torr, P.H.S.: Graph Cut Based Inference with Co-occurrence Statistics. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part V. LNCS, vol. 6315, pp. 239–253. Springer, Heidelberg (2010)
Ladicky, L., Torr, P.H.: The automatic labelling environment, http://cms.brookes.ac.uk/staff/PhilipTorr/ale.html
Lawler, E.L.: A procedure for computing the k best solutions to discrete optimization problems and its application to the shortest path problem. Management Science 18, 401–405 (1972)
Li, F., Carreira, J., Sminchisescu, C.: Object recognition as ranking holistic figure-ground hypotheses. In: CVPR (2010)
Meltzer, T., Yanover, C., Weiss, Y.: Globally optimal solutions for energy minimization in stereo vision using reweighted belief propagation. In: ICCV, pp. 428–435 (2005)
Flerova, N., Rollon, E., Dechter, R.: Bucket and Mini-bucket Schemes for M Best Solutions over Graphical Models. In: Croitoru, M., Rudolph, S., Wilson, N., Howse, J., Corby, O. (eds.) GKR 2011. LNCS, vol. 7205, pp. 91–118. Springer, Heidelberg (2012)
Nilsson, D.: An efficient algorithm for finding the m most probable configurations in probabilistic expert systems. Statistics and Computing 8, 159–173 (1998), doi:10.1023/A:1008990218483
Nowozin, S., Lampert, C.: Global connectivity potentials for random field models. In: CVPR (2009)
Papandreou, G., Yuille, A.: Perturb-and-map random fields: Using discrete optimization to learn and sample from energy models. In: ICCV, pp. 193–200 (November 2011)
Park, D., Ramanan, D.: N-best maximal decoders for part models. In: ICCV (2011)
Porway, J., Zhu, S.-C.: C 4: Exploring multiple solutions in graphical models by cluster sampling. PAMI 33(9), 1713–1727 (2011)
Roth, S., Black, M.: Fields of experts. IJCV 82(2) (April 2009)
Rother, C., Kohli, P., Feng, W., Jia, J.: Minimizing sparse higher order energy functions of discrete variables. In: CVPR, pp. 1382–1389 (2009)
Rother, C., Kolmogorov, V., Blake, A.: “Grabcut”: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH (2004)
Seroussi, B., Golmard, J.: An algorithm directly finding the k most probable configurations in bayesian networks. Int. J. of Approx. Reasoning 11(3), 205–233 (1994)
Shor, N.: Minimization methods for non-differentiable functions. Springer Series in Computational Mathematics. Springer (1985)
Szeliski, R., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M., Rother, C.: A comparative study of energy minimization methods for markov random fields with smoothness-based priors. PAMI 30(6), 1068–1080 (2008)
Tarlow, D., Givoni, I.E., Zemel, R.S.: Hop-map: Efficient message passing with high order potentials. In: AISTATS, pp. 812–819 (2010)
Tsochantaridis, I., Joachims, T., Hofmann, T., Altun, Y.: Large margin methods for structured and interdependent output variables. JMLR 6, 1453–1484 (2005)
Tu, Z., Zhu, S.-C.: Image segmentation by data-driven markov chain monte carlo. IEEE Trans. Pattern Anal. Mach. Intell. 24, 657–673 (2002)
Werner, T.: A linear programming approach to max-sum problem: A review. PAMI 29(7), 1165–1179 (2007)
Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: CVPR, pp. 1385–1392 (2011)
Yanover, C., Weiss, Y.: Finding the m most probable configurations using loopy belief propagation. In: NIPS (2003)
Yue, Y., Joachims, T.: Predicting diverse subsets using structural SVMs. In: ICML, pp. 271–278 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Batra, D., Yadollahpour, P., Guzman-Rivera, A., Shakhnarovich, G. (2012). Diverse M-Best Solutions in Markov Random Fields. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7576. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33715-4_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-33715-4_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33714-7
Online ISBN: 978-3-642-33715-4
eBook Packages: Computer ScienceComputer Science (R0)