Abstract
Motion segmentation involves identifying regions of the image that correspond to independently moving objects. The number of independently moving objects, and type of motion model for each of the objects is unknown a priori.
In order to perform motion segmentation, the problems of model selection, robust estimation and clustering must all be addressed simultaneously. Here we place the three problems into a common Bayesian framework; investigating the use of model averaging-representing a motion by a combination of models—as a principled way for motion segmentation of images. The final result is a fully automatic algorithm for clustering that works in the presence of noise and outliers.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
H. Akaike. A new look at the statistical model identification. IEEE Trans. on Automatic Control, Vol. AC-19(6):716–723, 1974.
M. Armstrong, A. Zisserman, and R. Hartley. Self-calibration from image triplets. In Proc. 4th ECCV, pages 3–16. Springer-Verlag, 1996.
S. Ayer and H. Sawhney. Layered representation of motion video using robust maximum-likelihood estimation of mixture models and mdl encoding. In Proc. 5th ICCV, pages 777–784, 1995.
P. Beardsley, P. H. S. Torr, and A. Zisserman. 3D model aquisition from extended image sequences. In 4th ECCV, pages 683–695. Springer-Verlag, 1996.
A. Black and P. Anandan. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. CVIU, 63(1):75–104, 1996.
M. Brooks, L. Agapito, D. Huynh, and L. Baumela. Direct methods for self-calibration of a moving head. In Proc. 4th ECCV, pages 97–108. Springer-Verlag, 1996.
T. Darrell, S. Sclaroff, and A. Pentland. Segmentation by minimal description. In Proc. 3rd ICCV, pages 112–116. IEEE, 1990.
A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. J. R. Statist. Soc., 39 B:1–38, 1977.
D. Draper. Assessment and propagation of model uncertainty (with discussion). Journal of the Royal Statistical Society series B, 57:45–97, 1995.
O.D. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig? In G. Sandini, editor, Proc. 2nd ECCV, pages 563–578. Springer-Verlag, 1992.
R. A. Fisher Uncertain Inference Proc. Amer. Acad. Arts and Sciences, 71 245–258, 1936.
M. Fischler and R. Bolles. Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach., vol. 24:381–95, 1981.
E. FranÇois and P. Bouthemy. Multiframe based identification of mobile components of a scene with a moving camera. In Proc. CVPR., 1991.
E. Francois and P. Bouthemy. Derivation of qualitative information in motion analysis. IVC, vol. 8(4):279–287, Nov 1990.
H. Gu, S. Yoshiaki, and Asada M. MDL-based segementation and motion modeling in a long image sequence of scene with multiple independently moving objects. PAMI, 18:58–64, 1996.
C. Harris and M. Stephens. A combined corner and edge detector. In Proc. Alvey Conf., pages 189–192, 1987.
R. I. Hartley. Estimation of relative camera positions for uncalibrated cameras. In Proc. 2nd ECCV, pages 579–87. Springer-Verlag, 1992.
R. I. Hartley. Lines and points in three views — a unified approach. In ARPA Image Understanding Workshop, Monterey, 1994.
R. I. Hartley and P. Sturm. Triangulation. In American Image Understanding Workshop, pages 957–966, 1994.
J. S. Hodges. Uncertainty, policy analysis and statistics (with discussion). Statistical Science, 2:259–291, 1987.
H. Jeffreys. Theory of Probability. Clarendon Press, Oxford, third edition, 1961.
A. Jepson and M. Black. Mixture models for optical flow computation. In cvpr-93, pages 760–766. IEEE, 1993.
K. Kanatani. Automatic singularity test for motion analysis by an information criterion. In Proc. 4th ECCV, pages 697–708, Springer-Verlag, 1996.
K. Kanatani. Statistical Optimization for Geometric Computation: Theory and Practice. Elsevier Science, Amsterdam, 1996.
R. E. Kass and A. E. Raftery. Bayes factors. Journal of the American Statistical Association, 90:733–795, 1995.
M. Kendall and A. Stuart. The Advanced Theory of Statistics. Charles Griffin and Company, London, 1983.
E. E. Leamer. Specification searches: ad hoc inference with nonexperimental data. Wiley, New York, 1978.
D. Madigan and A. E. Raftery. Model selection and accounting for model uncertainty in graphical models using Occam's window. Journal of the American Statistical Association, 89:1535–1546, 1994.
G.I. McLachlan and K. Basford. Mixture models: inference and applications to clustering. Marcel Dekker. New York, 1988.
P. F. McLauchlan, I. Reid, and D. W. Murray. Coarse image motion for saccade control. In Proc. BMVC. Springer-Verlag, Sept 1992. Leeds.
P. F. McLauchlan, I. Reid, and D. W. Murray. Recursive affine structure and motion from image sequences. In Proc. 3rd ECCV, volume 1, pages 217–224, May 1994.
A. J. Miller. Selection of subsets of regression variables (with discussion). Journal of the Royal Statistical Society (Series A), 147:389–425, 1984.
B. R. Moulton. A Bayesian-approach to regression selection and estimation with application to a price-index for radio services. Journal of Econometrics, 49:169–193, 1991.
J. Mundy and A. Zisserman. Geometric Invariance in Computer Vision. MIT press, 1992.
R.C. Nelson. Qualitative detection of motion by a moving observer. IJCV, pages 33–46, 1991.
R. A. Redner and H. F. Walker. Mixture densities, maximum likelihood and the EM algorithm. SIAM Review, 26:195–239, 1984.
B. D. Ripley. Pattern recognition and neural networks. Cambridge University Press, Cambridge, 1996.
B. Russell. History of Western Philosophy. Routledge, 1961.
G. Schwarz. Estimating dimension of a model. Ann. Stat., 6:461–464, 1978.
G.A.F. Wild C. J. Seber. Non-Linear Regression. Wiley, New York, 1989.
L. S. Shapiro. Affine Analysis of Image Sequences. PhD thesis, Oxford University, 1993.
A. Shashua. Trilinearity in visual recognition by alignment. In Proc. 3rd ECCV, volume 1, pages 479–484, May 1994.
M. Spetsakis and J. Aloimonos. A multi-frame approach to visual motion perception. IJCV, 6:245–255, 1991.
C. V. Stewart. Minpran; a new robust estimator for computer vision. IEEE Trans. PAMI, vol.PAMI-17, no.10:925–938, 1995.
P. H. S. Torr. Outlier Detection and Motion Segmentation. PhD thesis, Dept. of Engineering Science, University of Oxford, 1995.
P. H. S. Torr and D. W. Murray. The development and comparison of robust methods for estimating the fundamental matrix. Int Journal of Computer Vision, 24(3):271–300, 1997.
P. H. S. Torr and A Zisserman. Robust parameterization and computation of the trifocal tensor. Image and Vision Computing, 15:591–607, 1997.
P. H. S. Torr, A Zisserman, and S. Maybank. Robust detection of degenerate configurations for the fundamental matrix. To Appear CVIU, 1998.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Torr, P.H.S., Zisserman, A. (1998). Concerning Bayesian motion segmentation, model averaging, matching and the trifocal tensor. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV'98. ECCV 1998. Lecture Notes in Computer Science, vol 1406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055687
Download citation
DOI: https://doi.org/10.1007/BFb0055687
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64569-6
Online ISBN: 978-3-540-69354-3
eBook Packages: Springer Book Archive