Skip to main content

Visual Guidance of an Active Handheld Microsurgical Tool

  • Chapter
  • First Online:
Surgical Robotics

Abstract

In microsurgery, a surgeon often deals with anatomical structures of sizes that are close to the limit of the human hand accuracy. Robotic assistants can help to push beyond the current state of practice by integrating imaging and robot-assisted tools. This paper demonstrates control of a handheld tremor reduction micromanipulator with visual servo techniques, aiding the operator by providing three behaviors: “snap-to”, motion scaling, and standoff regulation. A stereo camera setup viewing the workspace under high magnification tracks the tip of the micromanipulator and the object being manipulated. Individual behaviors are activated in task-specific situations when the micromanipulator tip is in the vicinity of the target. We show that the snap-to behavior can reach and maintain a position at a target with Root Mean Squared Error (RMSE) of 17.5 ± 0.4 µm between the tip and target. Scaling the operator’s motions and preventing unwanted contact with non-target objects also provides a larger margin of safety.

©2009 IEEE. Reprinted with permission, from Becker, B.C., Voros, S., MacLachlan, R.A., Hager, G.D., Riviere, C.N.: Active guidence of a handheld micromanipulator using visual servoing. In: IEEE International Conference on Robotics and Automation, pp. 339–344 (2009)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 229.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mitchell, B., Koo, J., Iordachita, I., Kazanzides, P., Kapoor, A., Handa, J., Hager, G., Taylor, R.: Development and application of a new steady-hand manipulator for retinal surgery. In: IEEE International Conference on Robotics and Automation, pp. 623–629 (2007)

    Google Scholar 

  2. Fleming, I., Voros, S., Vagvolgyi, B., Pezzementi, Z., Handa, J., Taylor, R., Hager, G.: Intraoperative visualization of anatomical targets in retinal surgery, In: IEEE Workshop on Applications of Computer Vision (2008)

    Google Scholar 

  3. Berger, J.W., Madjarov, B.: Augmented reality fundus biomicroscopy a working clinical prototype. Arch. Ophtalmol. 119, 1815–1818 (2001)

    Google Scholar 

  4. Li, X., Zong, G., Bi, S.: Development of global vision system for biological automatic micro-manipulation system. IEEE Int. Conf. Robot. Autom. 1, 127–132 (2001)

    Google Scholar 

  5. Yamamoto, H., Sano, T.: Study of micromanipulation using stereoscopic microscope. IEEE Trans. Instrum. Meas. 51, 182–187 (2002)

    Article  Google Scholar 

  6. Riviere, C.N., Ang, W.T., Khosla, P.K.: Toward active tremor canceling in handheld microsurgical instruments. IEEE Trans. Robot. Autom. 19, 793–800 (2003)

    Article  Google Scholar 

  7. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern. Anal. Mach. Intell. 1330–1334 (2000)

    Google Scholar 

  8. MacLachlan, R.A., Riviere, C.N.: High-speed microscale optical tracking using digital frequency-domain multiplexing. IEEE Trans. Instrum. Meas. 58(6), 1991–2001 (2008)

    Article  Google Scholar 

  9. Chaumette, F., Hutchinson, S.: Visual servo control, part I: basic approaches. IEEE Robot. Autom. Mag. 13, 82–90 (2006)

    Article  Google Scholar 

  10. Hutchinson, S., Hager, G.D., Corke, P.I.: A tutorial on visual servo control. IEEE Trans. Robot. Autom. 12, 651–670 (1996)

    Article  Google Scholar 

  11. Hespanha, J.P., Dodds, Z., Hager, G.D., Morse, A.S.: What tasks can be performed with an uncalibrated stereo vision system? Int. J. Comput. Vis. 35, 65–85 (1999)

    Article  Google Scholar 

  12. Ammi, M., Ferreira, A.: Involving the operator in the control strategy for intelligent tele-micromanipulation. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, p. 2 (2003)

    Google Scholar 

  13. Yang, M.H., Ahuja, N.: Gaussian mixture model for human skin color and its application in image and video databases. In: Proceedings of the SPIE Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 458–466 (1999)

    Google Scholar 

  14. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)

    Google Scholar 

  15. Hager, G.D.: A modular system for robust positioning using feedback from stereovision. IEEE Trans. Robot. Autom. 13, 582–595 (1997)

    Article  Google Scholar 

  16. Danuser, G.: Photogrammetric calibration of a stereo light microscope. J. Microsc. 193, 62–83 (1999)

    Article  Google Scholar 

  17. Elble, R.J., Koller, W.C.: Tremor. Johns Hopkins, Baltimore (1990)

    Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Institutes of Health (grant no. R21 EY016359), the American Society for Laser Medicine and Surgery, the ARCS Foundation, and a National Science Foundation Graduate Research Fellowship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cameron N. Riviere .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Becker, B.C., Voros, S., MacLachlan, R.A., Hager, G.D., Riviere, C.N. (2011). Visual Guidance of an Active Handheld Microsurgical Tool. In: Rosen, J., Hannaford, B., Satava, R. (eds) Surgical Robotics. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-1126-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-1126-1_15

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4419-1125-4

  • Online ISBN: 978-1-4419-1126-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics