Skip to main content

Planning of Needle Insertion for Robotic-Assisted Prostate Biopsy in Augmented Reality Using RGB-D Camera

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 540))

Abstract

Augmented Reality (AR) technologies are increasingly used in many areas. There is a vast research activity within the field of AR in medical applications. In this paper, an AR system using RGB-D camera is proposed to facilitate trajectory planning for a prostate biopsy robot. The advantage of the developed AR environment consists in the possibility to generate needle trajectories using a 3D virtual model of a specific patient directly in the robot workspace. It was shown from a test case that the generated biopsy needle trajectory reaches successfully the target area.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Buchs, N.C., Pugin, F., Volonté, F., Morel, P.: Learning tools and simulation in robotic surgery: state of the art. World J. Surg. 37(12), 2812–2819 (2013)

    Article  Google Scholar 

  2. Bernhardt, S., Nicolau, S.A., Agnus, V., Soler, L., Doignon, C., Marescaux, J.: Automatic localization of endoscope in intraoperative CT image: a simple approach to augmented reality guidance in laparoscopic surgery. Med. Image Anal. 30, 130–143 (2016)

    Article  Google Scholar 

  3. Chen, X., Xu, L., Wang, Y., Wang, H., Wang, F., Zeng, X., Wang, Q., Egger, J.: Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J. Biomed. Inform. 55, 124–131 (2015)

    Article  Google Scholar 

  4. Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G.: Augmented reality on large screen for interactive maintenance instructions. Comput. Ind. 65(2), 270–278 (2014)

    Article  Google Scholar 

  5. Gîrbacia, T., Gîrbacia, F., Duguleana, M., Butilă, E.: Augmented reality system for training robotic prostate biopsy needle guidance. In: The 10th International Conference on Virtual Learning, pp. 254–258 (2015)

    Google Scholar 

  6. Hallet, J., Soler, L., Diana, M., Mutter, D., Baumert, T.F., Habersetzer, F., Marescaux, J., Pessaux, P.: Trans-thoracic minimally invasive liver resection guided by augmented reality. J. Am. Coll. Surg. 220, 55–60 (2015)

    Article  Google Scholar 

  7. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 559–568. ACM (2011)

    Google Scholar 

  8. Kaye, D.R., Stoianovici, D., Han, M.: Robotic ultrasound and needle guidance for prostate cancer management: review of the contemporary literature. Curr. Opin. Urol. 24, 75–80 (2014)

    Article  Google Scholar 

  9. Lin, L., Shi, Y., Tan, A., Bogari, M., Zhu, M., et al.: Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms—a feasibility study. J. Cranio-Maxillofacial Surg. 44, 215–223 (2016)

    Article  Google Scholar 

  10. Malvezzi, M., Bertuccio, P., Rosso, T., Rota, M., Levi, F., La Vecchia, C., Negri, E.: European cancer mortality predictions for the year 2015: does lung cancer have the highest death rate in EU women? Ann. Oncol. 26(4), 779–786 (2015)

    Article  Google Scholar 

  11. Marescaux, J., Diana, M.: Next step in minimally invasive surgery: hybrid image-guided surgery. J. Pediatr. Surg. 50, 30–36 (2015)

    Article  Google Scholar 

  12. Morell-Gimenez, V., Saval-Calvo, M., Azorin-Lopez, J., Garcia-Rodriguez, J., Cazorla, M., Orts-Escolano, S., Fuster-Guillo, A.: A comparative study of registration methods for RGB-D video of static scenes. Sensors 14, 8547–8576 (2014)

    Article  Google Scholar 

  13. Nicolau, S., Soler, L., Mutter, D., Marescaux, J.: Augmented reality in laparoscopic surgical oncology. Surg. Oncol. 20, 189–201 (2011)

    Article  Google Scholar 

  14. Pîslă, D., Gherman, B., Gîrbacia, F., Vaida, C., Butnariu, S., Gîrbacia, T., Plitea, N.: Optimal planning of needle insertion for robotic-assisted prostate biopsy. In: Borangiu, T. (ed.) Advances in Robot Design and Intelligent Control. AISC, vol. 371, pp. 339–346. Springer, Heidelberg (2016). doi:10.1007/978-3-319-21290-6_34

    Chapter  Google Scholar 

  15. Tilak, G., Tuncali, K., Song, S.-E., Tokuda, J., Olubiyi, O., et al.: 3T MR-guided in-bore transperineal prostate biopsy: a comparison of robotic and manual needle-guidance templates. J. Magn. Reson. Imaging 42, 63–71 (2015)

    Article  Google Scholar 

  16. Torre, L.A., Bray, F., Siegel, R.L., Ferlay, J., Lortet-Tieulent, J., Jemal, A.: Global cancer statistics, 2012. CA Cancer J. Clin. 65, 87–108 (2015)

    Article  Google Scholar 

  17. Vaida, C., Pisla, D., Tucan, P., Plitea, N., Gherman, B.: Robot paralel pentru biopsia transperineală a prostatei. Patent pending: 00761/26.10.2015 (2015)

    Google Scholar 

  18. Volonté, F., Buchs, N.C., Pugin, F., Spaltenstein, J., Jung, M., Ratib, O., Morel, P.: Stereoscopic augmented reality for da Vincii™ robotic biliary surgery. Int. J. Surg. Case Rep. 4(4), 365–367 (2013)

    Article  Google Scholar 

  19. Wang, X., Habert, S., Ma, M., Huang, C.H., Fallavollita, P., Navab, N.: RGB-D/C-arm calibration and application in medical augmented reality. In: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, pp. 100–103. IEEE Computer Society (2015)

    Google Scholar 

  20. Wen, R., Tay, W.-L., Nguyen, B.P., Chng, C.-B., Chui, C.-K.: Hand gesture guided robot-assisted surgery based on a direct augmented reality interface. Comput. Methods Programs Biomed. 116, 68–80 (2014)

    Article  Google Scholar 

  21. Yacoub, J.H., Verma, S., Moulton, J.S., Eggener, S., Oto, A.: Imaging-guided prostate biopsy: conventional and emerging techniques. RadioGraphics 32, 819–837 (2012)

    Article  Google Scholar 

Download references

Acknowledgment

This paper was realized within the Partnership Programme in priority domains - PN-II, which runs with the financial support of MEN-UEFISCDI, Project no. 247/2014.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Florin Gîrbacia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gîrbacia, F., Boboc, R., Gherman, B., Gîrbacia, T., Pîsla, D. (2017). Planning of Needle Insertion for Robotic-Assisted Prostate Biopsy in Augmented Reality Using RGB-D Camera. In: Rodić, A., Borangiu, T. (eds) Advances in Robot Design and Intelligent Control. RAAD 2016. Advances in Intelligent Systems and Computing, vol 540. Springer, Cham. https://doi.org/10.1007/978-3-319-49058-8_56

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49058-8_56

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49057-1

  • Online ISBN: 978-3-319-49058-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics