Abstract
Augmented Reality (AR) technologies are increasingly used in many areas. There is a vast research activity within the field of AR in medical applications. In this paper, an AR system using RGB-D camera is proposed to facilitate trajectory planning for a prostate biopsy robot. The advantage of the developed AR environment consists in the possibility to generate needle trajectories using a 3D virtual model of a specific patient directly in the robot workspace. It was shown from a test case that the generated biopsy needle trajectory reaches successfully the target area.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Buchs, N.C., Pugin, F., Volonté, F., Morel, P.: Learning tools and simulation in robotic surgery: state of the art. World J. Surg. 37(12), 2812–2819 (2013)
Bernhardt, S., Nicolau, S.A., Agnus, V., Soler, L., Doignon, C., Marescaux, J.: Automatic localization of endoscope in intraoperative CT image: a simple approach to augmented reality guidance in laparoscopic surgery. Med. Image Anal. 30, 130–143 (2016)
Chen, X., Xu, L., Wang, Y., Wang, H., Wang, F., Zeng, X., Wang, Q., Egger, J.: Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J. Biomed. Inform. 55, 124–131 (2015)
Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G.: Augmented reality on large screen for interactive maintenance instructions. Comput. Ind. 65(2), 270–278 (2014)
Gîrbacia, T., Gîrbacia, F., Duguleana, M., Butilă, E.: Augmented reality system for training robotic prostate biopsy needle guidance. In: The 10th International Conference on Virtual Learning, pp. 254–258 (2015)
Hallet, J., Soler, L., Diana, M., Mutter, D., Baumert, T.F., Habersetzer, F., Marescaux, J., Pessaux, P.: Trans-thoracic minimally invasive liver resection guided by augmented reality. J. Am. Coll. Surg. 220, 55–60 (2015)
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 559–568. ACM (2011)
Kaye, D.R., Stoianovici, D., Han, M.: Robotic ultrasound and needle guidance for prostate cancer management: review of the contemporary literature. Curr. Opin. Urol. 24, 75–80 (2014)
Lin, L., Shi, Y., Tan, A., Bogari, M., Zhu, M., et al.: Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms—a feasibility study. J. Cranio-Maxillofacial Surg. 44, 215–223 (2016)
Malvezzi, M., Bertuccio, P., Rosso, T., Rota, M., Levi, F., La Vecchia, C., Negri, E.: European cancer mortality predictions for the year 2015: does lung cancer have the highest death rate in EU women? Ann. Oncol. 26(4), 779–786 (2015)
Marescaux, J., Diana, M.: Next step in minimally invasive surgery: hybrid image-guided surgery. J. Pediatr. Surg. 50, 30–36 (2015)
Morell-Gimenez, V., Saval-Calvo, M., Azorin-Lopez, J., Garcia-Rodriguez, J., Cazorla, M., Orts-Escolano, S., Fuster-Guillo, A.: A comparative study of registration methods for RGB-D video of static scenes. Sensors 14, 8547–8576 (2014)
Nicolau, S., Soler, L., Mutter, D., Marescaux, J.: Augmented reality in laparoscopic surgical oncology. Surg. Oncol. 20, 189–201 (2011)
Pîslă, D., Gherman, B., Gîrbacia, F., Vaida, C., Butnariu, S., Gîrbacia, T., Plitea, N.: Optimal planning of needle insertion for robotic-assisted prostate biopsy. In: Borangiu, T. (ed.) Advances in Robot Design and Intelligent Control. AISC, vol. 371, pp. 339–346. Springer, Heidelberg (2016). doi:10.1007/978-3-319-21290-6_34
Tilak, G., Tuncali, K., Song, S.-E., Tokuda, J., Olubiyi, O., et al.: 3T MR-guided in-bore transperineal prostate biopsy: a comparison of robotic and manual needle-guidance templates. J. Magn. Reson. Imaging 42, 63–71 (2015)
Torre, L.A., Bray, F., Siegel, R.L., Ferlay, J., Lortet-Tieulent, J., Jemal, A.: Global cancer statistics, 2012. CA Cancer J. Clin. 65, 87–108 (2015)
Vaida, C., Pisla, D., Tucan, P., Plitea, N., Gherman, B.: Robot paralel pentru biopsia transperineală a prostatei. Patent pending: 00761/26.10.2015 (2015)
Volonté, F., Buchs, N.C., Pugin, F., Spaltenstein, J., Jung, M., Ratib, O., Morel, P.: Stereoscopic augmented reality for da Vincii™ robotic biliary surgery. Int. J. Surg. Case Rep. 4(4), 365–367 (2013)
Wang, X., Habert, S., Ma, M., Huang, C.H., Fallavollita, P., Navab, N.: RGB-D/C-arm calibration and application in medical augmented reality. In: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, pp. 100–103. IEEE Computer Society (2015)
Wen, R., Tay, W.-L., Nguyen, B.P., Chng, C.-B., Chui, C.-K.: Hand gesture guided robot-assisted surgery based on a direct augmented reality interface. Comput. Methods Programs Biomed. 116, 68–80 (2014)
Yacoub, J.H., Verma, S., Moulton, J.S., Eggener, S., Oto, A.: Imaging-guided prostate biopsy: conventional and emerging techniques. RadioGraphics 32, 819–837 (2012)
Acknowledgment
This paper was realized within the Partnership Programme in priority domains - PN-II, which runs with the financial support of MEN-UEFISCDI, Project no. 247/2014.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Gîrbacia, F., Boboc, R., Gherman, B., Gîrbacia, T., Pîsla, D. (2017). Planning of Needle Insertion for Robotic-Assisted Prostate Biopsy in Augmented Reality Using RGB-D Camera. In: Rodić, A., Borangiu, T. (eds) Advances in Robot Design and Intelligent Control. RAAD 2016. Advances in Intelligent Systems and Computing, vol 540. Springer, Cham. https://doi.org/10.1007/978-3-319-49058-8_56
Download citation
DOI: https://doi.org/10.1007/978-3-319-49058-8_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49057-1
Online ISBN: 978-3-319-49058-8
eBook Packages: EngineeringEngineering (R0)