Abstract
By using mirror reflections of a scene, stereo images can be captured with a single camera (catadioptric stereo). In addition to simplifying data acquisition single camera stereo provides both geometric and radiometric advantages over traditional two camera stereo. In this paper, we discuss the geometry and calibration of catadioptric stereo with two planar mirrors. In particular, we will show that the relative orientation of a catadioptric stereo rig is restricted to the class of planar motions thus reducing the number of external calibration parameters from 6 to 5. Next we derive the epipolar geometry for catadioptric stereo and show that it has 6 degrees of freedom rather than 7 for traditional stereo. Furthermore, we show how focal length can be recovered from a single catadioptric image solely from a set of stereo correspondences. To test the accuracy of the calibration we present a comparison to Tsai camera calibration and we measure the quality of Euclidean reconstruction. In addition, we will describe a real-time system which demonstrates the viability of stereo with mirrors as an alternative to traditional two camera stereo.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Armstrong, M. 1996. Self-calibration from image sequences. Ph.D. Thesis, University of Oxford.
Armstrong, M., Zisserman, A., and Hartley, R. 1996. Self-calibration from image triplets. In Proceedings of the 1996 European Conference on Computer Vision.
Chaen, A., Yamazawa, K., Yokoya, N., and Takemura, H. 1997.Omnidirectional stereo vision using hyperomni vision. Technical Report 96-122, IEICE (in Japanese).
Faugeras, O. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Proceedings of the 1992 European Conference on Computer Vision. Springer-Verlag: Berlin pp. 563-578.
Faugeras, O. Hotz, B., Mathieu, H., Vieville, T., Zhang, Z., Fau, P., Theron, E., Moll, L., Berry, G., Vuillemin, J., Bertin, P., and Proy, C. 1993. Real-time correlation-based stereo: Algorithm, implementation and application. Technical Report 2013, INRIA Sophia Antipolis.
Gluckman, J., and Nayar, S.K. 1999. Planar catadioptric stereo: Geometry and calibration. In Proceedings of the 1999 Conference on Computer Vision and Pattern Recognition.
Gluckman, J., Nayar, S.K., and Thoresz, K.J. 1998. Real-time omnidirectional and panoramic stereo. In Proceedings of the 1998 DARPA Image Understanding Workshop.
Goshtasby A., and Gruver, W.A. 1993. Design of a single-lens stereo camera system. Pattern Recognition, 26(6):923-937.
Hartley, R.I. 1992. Estimation of relative camera positions for uncalibrated cameras. In Proceedings of the 1992 European Conference on Computer Vision.
Hartley, R.I. 1995. In defense of the 8-point algorithm. In Proceedings of the 5th International Conference on Computer Vision, pp. 1064-1070.
Hartley, R.I. and Gupta, R. 1993. Computing matched-epipolar projections. In Proceedings of the 1993 Conference on Computer Vision and Pattern Recognition.
Hecht, E. and Zajac, A. 1974. Optics. Addison-Wesley: Reading, MA.
Inaba, M., Hara, T. and Inoue, H. 1993. A stereo viewer based on a single camera with view-control mechanism. In Proceedings of the International Conference on Robots and Systems.July 1993.
Kanade, T., Yoshida, A., Oda, K., Kano, H., and Tanaka, M. 1996.A stereo machine for video-rate dense depth mapping and its new applications. In Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition.1996.
Kawanishi, T., Yamazawa, K., Iwasa, H., Takemura, H. and Yokoya, N. 1998. Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors. In International Conference on Pattern Recognition 1998.
Konolige, K. 1997. Small vision systems: Hardware and implementation. In 8th Int'l Symposium of Robotics Research, Hayama, Japan, Oct. 1997
Longuet-Higgins, H.C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133-135.
Mathieu, H. and Devernay, F. 1995. Systeme de miroirs pour la stereoscopie. Technical Report 0172, INRIA Sophia-Antipolis (in French).
Matthies, L. 1993. Stereo vision for planetary rovers: Stochastic modeling to near realtime implementation. International Journal of Computer Vision, 8(1):71-91.
Maybank, S.J. 1993. Theory of Reconstruction From Image Motion. Springer-Verlag: Berlin.
Mitsumoto, H., Tamura, S., Okazaki, K., Kajimi, N., and Fukui, Y. 1992.3d reconstruction using mirror images based on a plane symmetry recovery method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(9):941-945.
Murray, D.W. 1995. Recovering range using virtual multicamera stereo. Computer Vision and Image Understanding, 61(2): 285-291.
Nayar, S.K. 1988. Robotic vision system. United States Patent 4,893,183.
Nayar, S.K. and Baker, S. 1997. Catadioptric image formation. In Proceedings of the 1997 DARPA Image UnderstandingWorkshop, May 1997.
Nene, S.A. and Nayar, S.K. 1998. Stereo with mirrors. In Proceedings of the 6th International Conference on Computer Vision, Bombay, India, January 1998. IEEE Computer Society.
Nishimoto Y. and Shirai, Y. 1987.A feature-based stereo model using small disparities. In cvpr87, pp. 192-196.
Press, W., Teukolsky, S., Vetterlling, W., and Flannery, B. 1992.Numerical Recipes in C. Cambridge University Press.
Shashua, A. 1998. Omni-rig sensors: What can be done with a non-rigid vision platform? In Workshop on Applications of Computer Vision, 1998.
Southwell, D., Basu, A., Fiala, M., and Reyda, J. 1996. Panoramic stereo. In Proceedings of the Int'l Conference on Pattern Recognition, 1996.
Teoh, W. and Zhang, X.D. 1984. An inexpensive stereoscopic vision system for robots. In Proc. Int'l Conference on Robotics, pp. 186-189.
Triggs, B. 1997. Autocalibration and the absolute quadric. In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, 1997.
Tsai, R.Y. 1986. An efficient and accurate camera calibration technique for 3d machine vision.
Vieville, T. and Lingrand, D. 1995. Using singular displacements for uncalibrated monocular visual systems. Technical Report 2678, INRIA Sophia-Antipolis.
Xu, G. and Zhang, Z. 1996. Epipolar Geometry in Stereo, Motion and Object Recognition. Kluwer: Dordrecht.
Zeller, C. and Faugeras, O. 1996. Camera self-calibration from video sequences: The kruppa equations revisited.Technical Report 2793, INRIA, Sophia-Antipolis, France.
Zhang, Z., Deriche, R., Faugeras, O., and Luong, Q.T. 1995. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence Journal, 78
Zhang, Z.Y. and Tsui, H.T. 1998. 3d reconstruction from a single view of an object and its image in a plane mirror. In International Conference on Pattern Recognition, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gluckman, J., Nayar, S.K. Catadioptric Stereo Using Planar Mirrors. International Journal of Computer Vision 44, 65–79 (2001). https://doi.org/10.1023/A:1011172403203
Issue Date:
DOI: https://doi.org/10.1023/A:1011172403203