Abstract
In this study, we propose a system for assisting doctors with transsphenoidal surgery by understanding the positions of tumors during surgery. Transsphenoidal surgery requires examining endoscopic images to assess the situation depicted for surgery; determining the positions of tumors and organs is more difficult for transsphenoidal surgeries compared to other more general procedures. Under the proposed system, a three-dimensional (3D) model is created based on the patient’s preoperative MRIs, and a superimposed image is displayed in real time. This system is expected to assist the surgeon in understanding the situation around the operating field.
Markers are used to obtain the data necessary to create an image overlay. The markers are affixed to an operating table and to the end of an endoscope. The patient’s head is held in place during the intraoperative period. The positions of features within the patient’s cranium relative to the operating table marker are obtained through a camera installed on the operating table. The positions of tumors and organs are then estimated from the data obtained and the data from the 3D model created from the patient’s MRIs. The relative position from the marker at the end of the endoscope to the tip of the endoscope is obtained as well, allowing the position of the endoscope tip to be estimated even if the endoscope has been inserted into the body’s interior during the intraoperative period; the tip cannot be seen from the exterior. The relative position of the endoscope tip and the patient’s tumor is calculated, and a 3D model created from the MRI image combined with the current endoscopic image is displayed. The optimum number of simultaneous recognition markers for improving the accuracy of the measurements of the endoscope’s position and orientation was verified, and results of a trial run of the image overlay system conducted using a simplified model were reported.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Qian, K., Bai, J., Yang, X., Pan, J., Zhang, J.: Virtual reality based laparoscopic surgery simulation. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 69–78 (2015). https://doi.org/10.1145/2821592.2821599
Coles, T.R., Meglan, D., John, N.W.: The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans. Haptics 4(1), 51–66 (2011). https://doi.org/10.1109/TOH.2010.19
Shousen, W., Jun-Feng, L., Shang-Ming, Z., Jun-Jie, J., Liang, X.: A virtual reality model of the clivus and surgical simulation via transoral or transnasal route. Int. J. Clin. Exp. Med. 7, 3270–3279 (2014)
Li, L., et al.: A novel augmented reality navigation system for endoscopic sinus and skull base surgery: a feasibility study. PLoS ONE 11(1), e0146996 (2016). https://doi.org/10.1371/journal.pone.0146996
Onishi, K., Fumiyama, S., Miki, Y., Nonaka, M., Koeda, M., Noborio, H.: A study of camera tip position estimating methods in transnasal endoscopic surgery. In: Kurosu, M. (ed.) Human-Computer Interaction. Recognition and Interaction Technologies. LNCS, vol. 11567, pp. 534–543. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22643-5_42
Onishi, K., Fumiyama, S., Miki, Y., Nonaka, M., Koeda, M., Noborio, H.: Study on the development of augmented-reality navigation system for transsphenoidal surgery. In: Kurosu, M. (ed.) Human-Computer Interaction. Human Values and Quality of Life. LNCS, vol. 12183, pp. 623–638. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49065-2_43
Yano, D., et al.: Accuracy verification of knife tip positioning with position and orientation estimation of the actual liver for liver surgery support system. J. Bioinform. Neurosci. (JBINS) 3(3), 79–84 (2017)
Koeda, M., Yano, D., Doi, M., Onishi, K., Noborio, H.: Calibration of surgical knife-tip position with marker-based optical tracking camera and precise evaluation of its measurement accuracy. J. Bioinform. Neurosci. (JBINS) 4(1), 155–159 (2018)
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Medina-Carnicer, R.: Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recogn. 51, 481–491 (2015). https://doi.org/10.1016/j.patcog.2015.09.023
Romero Ramirez, F., Muñoz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 2016 (2018). https://doi.org/10.1016/j.imavis.2018.05.004
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Onishi, K., Fumiyama, S., Nonaka, M., Koeda, M., Noborio, H. (2021). Study on the Image Overlay Approach to AR Navigation System for Transsphenoidal Surgery. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2021. Lecture Notes in Computer Science(), vol 12763. Springer, Cham. https://doi.org/10.1007/978-3-030-78465-2_45
Download citation
DOI: https://doi.org/10.1007/978-3-030-78465-2_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78464-5
Online ISBN: 978-3-030-78465-2
eBook Packages: Computer ScienceComputer Science (R0)