Skip to main content

Advertisement

SpringerLink
Log in

An on-board surgical tracking and video augmentation system for C-arm image guidance

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Conventional tracker configurations for surgical navigation carry a variety of limitations, including limited geometric accuracy, line-of-sight obstruction, and mismatch of the view angle with the surgeon’s-eye view. This paper presents the development and characterization of a novel tracker configuration (referred to as “Tracker-on-C”) intended to address such limitations by incorporating the tracker directly on the gantry of a mobile C-arm for fluoroscopy and cone-beam CT (CBCT).

Methods

A video-based tracker (MicronTracker, Claron Technology Inc., Toronto, ON, Canada) was mounted on the gantry of a prototype mobile isocentric C-arm next to the flat-panel detector. To maintain registration within a dynamically moving reference frame (due to rotation of the C-arm), a reference marker consisting of 6 faces (referred to as a “hex-face marker”) was developed to give visibility across the full range of C-arm rotation. Three primary functionalities were investigated: surgical tracking, generation of digitally reconstructed radiographs (DRRs) from the perspective of a tracked tool or the current C-arm angle, and augmentation of the tracker video scene with image, DRR, and planning data. Target registration error (TRE) was measured in comparison with the same tracker implemented in a conventional in-room configuration. Graphics processing unit (GPU)-accelerated DRRs were generated in real time as an assistant to C-arm positioning (i.e., positioning the C-arm such that target anatomy is in the field-of-view (FOV)), radiographic search (i.e., a virtual X-ray projection preview of target anatomy without X-ray exposure), and localization (i.e., visualizing the location of the surgical target or planning data). Video augmentation included superimposing tracker data, the X-ray FOV, DRRs, planning data, preoperative images, and/or intraoperative CBCT onto the video scene. Geometric accuracy was quantitatively evaluated in each case, and qualitative assessment of clinical feasibility was analyzed by an experienced and fellowship-trained orthopedic spine surgeon within a clinically realistic surgical setup of the Tracker-on-C.

Results

The Tracker-on-C configuration demonstrated improved TRE (0.87 ± 0.25) mm in comparison with a conventional in-room tracker setup (1.92 ± 0.71) mm (p < 0.0001) attributed primarily to improved depth resolution of the stereoscopic camera placed closer to the surgical field. The hex-face reference marker maintained registration across the 180° C-arm orbit (TRE = 0.70 ± 0.32 mm). DRRs generated from the perspective of the C-arm X-ray detector demonstrated sub- mm accuracy (0.37 ± 0.20 mm) in correspondence with the real X-ray image. Planning data and DRRs overlaid on the video scene exhibited accuracy of (0.59 ± 0.38) pixels and (0.66 ± 0.36) pixels, respectively. Preclinical assessment suggested potential utility of the Tracker-on-C in a spectrum of interventions, including improved line of sight, an assistant to C-arm positioning, and faster target localization, while reducing X-ray exposure time.

Conclusions

The proposed tracker configuration demonstrated sub- mm TRE from the dynamic reference frame of a rotational C-arm through the use of the multi-face reference marker. Real-time DRRs and video augmentation from a natural perspective over the operating table assisted C-arm setup, simplified radiographic search and localization, and reduced fluoroscopy time. Incorporation of the proposed tracker configuration with C-arm CBCT guidance has the potential to simplify intraoperative registration, improve geometric accuracy, enhance visualization, and reduce radiation exposure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Sorensen S, Mitschke M, Solberg T (2007) Cone-beam CT using a mobile C-arm: a registration solution for IGRT with an optical tracking system. Phys Med Biol 52(12): 3389–3404

    Article  PubMed  CAS  Google Scholar 

  2. van de Kraats EB, Carelsen B, Fokkens WJ, Boon SN, Noordhoek N, Niessen WJ, van Walsum T (2005) Direct navigation on 3D rotational x-ray data acquired with a mobile propeller C-arm: accuracy and application in functional endoscopic sinus surgery. Phys Med Biol 50(24): 5769–5781

    Article  PubMed  Google Scholar 

  3. van de Kraats EB, van Walsum T, Kendrick L, Noordhoek NJ, Niessen WJ (2006) Accuracy evaluation of direct navigation with an isocentric 3D rotational X-ray system. Med Image Anal 10(2): 113–124

    Article  PubMed  Google Scholar 

  4. Feuerstein M, Mussack T, Heining SM, Navab N (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27(3): 355–369

    Article  PubMed  Google Scholar 

  5. Euler E, Heining S, Riquarts C, Mutschler W (2003) C-arm-based three-dimensional navigation: a preliminary feasibility study. Comput Aid Surg 8(1): 35–41

    Article  Google Scholar 

  6. Klein T, Benhimane S, Traub J, Heining SM, Euler E, Navab N (2007) Interactive guidance system for C-arm repositioning without radiation visual servoing for camera augmented mobile C-arm (CAMC). In: Horsch A, Deserno TM, Handels H, Meinzer H-P, Tolxdorff T (eds) Bildverarbeitung für die Medizin, vol 1. Informatik aktuell. Springer, Berlin, pp 21–25

    Google Scholar 

  7. Navab N, Wiesner S, Benhimane S, Euler E, Heining SM (2006) Visual servoing for intraoperative positioning and repositioning of mobile C-arms. In: medical image computing and computer-assisted intervention—MICCAI, vol 4190. Lecture Notes in Computer Science, 2007/03/16 edn. Springer, Berlin, Heidelberg, pp 551–560

  8. Dressel P, Wang L, Kutter O, Traub J, Heining S-M, Navab N (2010) Intraoperative positioning of mobile C-arms using artificial fluoroscopy. Proc SPIE 7625:762506

    Google Scholar 

  9. Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7): 1412–1423

    Article  PubMed  Google Scholar 

  10. Foley KT, Simon DA, Rampersaud YR (2001) Virtual fluoroscopy: computer-assisted fluoroscopic navigation. Spine 26(4): 347–351

    Article  PubMed  CAS  Google Scholar 

  11. Merloz P, Troccaz J, Vouaillat H, Vasile C, Tonetti J, Eid A, Plaweski S (2007) Fluoroscopy-based navigation system in spine surgery. Proc Inst Mech Eng H 221(7): 813–820

    PubMed  CAS  Google Scholar 

  12. Belei P, Skwara A, DeLa Fuente M, Schkommodau E, Fuchs S, Wirtz DC, Kamper C, Radermacher K (2007) Fluoroscopic navigation system for hip surface replacement. Comput Aid Surg 12(3): 160–167

    Google Scholar 

  13. Sießegger M, Schneider BT, Mischkowski RA, Lazar F, Krug B, Klesper B, Zöller JE (2001) Use of an image-guided navigation system in dental implant surgery in anatomically complex operation sites. J Cranio Maxillo Surg 29(5): 276–281

    Article  Google Scholar 

  14. Wong KC, Kumta SM, Chiu KH, Antonio GE, Unwin P, Leung KS (2007) Precision tumour resection and reconstruction using image-guided computer navigation. J Bone Joint Surg Br 89(7): 943–947

    Article  PubMed  CAS  Google Scholar 

  15. Marvik R, Lango T, Tangen GA, Andersen JO, Kaspersen JH, Ystgaard B, Sjolie E, Fougner R, Fjosne HE, Nagelhus Hernes TA (2004) Laparoscopic navigation pointer for three-dimensional image-guided surgery. Surg Endosc 18(8): 1242–1248

    Article  PubMed  CAS  Google Scholar 

  16. Hayashibe M, Suzuki N, Hattori A, Otake Y, Suzuki S, Nakata N (2006) Surgical navigation display system using volume rendering of intraoperatively scanned CT images. Comput Aid Surg 11(5): 240–246

    Google Scholar 

  17. Navab N, Bani-Kashemi A, Mitschke M (1999) Merging visible and invisible: two camera-augmented mobile C-arm (CAMC) applications. In: 2nd IEEE and ACM international workshop on augmented reality. pp 134–141

  18. Reaungamornrat S, Otake Y, Uneri A, Schafer S, Mirota DJ, Nithiananthan S, Stayman JW, Khanna AJ, Reh DD, Gallia GL, Taylor RH, Siewerdsen JH (2012) Tracker-on-C for Cone-Beam CT-guided surgery: evaluation of geometric accuracy and clinical applications. Proc SPIE 8316:831609–831611

    Google Scholar 

  19. Reaungamornrat S, Otake Y, Uneri A, Schafer S, Stayman JW, Zbijewski W, Mirota DJ, Yoo J, Nithiananthan S, Khanna AJ, Taylor RH, Siewerdsen JH (2011) Tracker-on-C: A novel tracker configuration for image-guided therapy using a mobile C-arm. Int J Comput Assist Radiol Surg 6(0): 134–135

    Google Scholar 

  20. Siewerdsen JH, Moseley DJ, Burch S, Bisland SK, Bogaards A, Wilson BC, Jaffray DA (2005) Volume CT with a flat-panel detector on a mobile, isocentric C-arm: Pre-clinical investigation in guidance of minimally invasive surgery. Med Phys 32(1): 241–254

    Article  PubMed  CAS  Google Scholar 

  21. Uneri A, Schafer S, Mirota D, Nithiananthan S, Otake Y, Reaungamornrat S, Yoo J, Stayman JW, Reh DD, Gallia GL, Khanna AJ, Hager G, Taylor RH, Kleinszig G, Siewerdsen JH (2011) Architecture of a high-performance surgical guidance system based on C-arm cone-beam CT: software platform for technical integration and clinical translation. Proc SPIE 7964: 796422–796427

    Article  Google Scholar 

  22. Uneri A, Schafer S, Mirota DJ, Nithiananthan S, Otake Y, Taylor RH, Siewerdsen JH (2012) TREK: an integrated system architecture for intraoperative cone-beam CT-guided surgery. Int J Comput Assist Radiol and Surg 7(1): 159–173

    Article  CAS  Google Scholar 

  23. Deguet A, Kumar R, Taylor RH, Kazanzides P (2008) The cisst libraries for computer assisted intervention systems. MICCAI Workshop. https://trac.lcsr.jhu.edu/cisst/

  24. Kazanzides P, Deguet A, Kapoor A (2008) An architecture for safe and efficient multi-threaded robot software. In: IEEE international conference on technologies for practical robot applications (TePRA), Nov. 10–11. pp 89–93

  25. Jung MY, Deguet A, Kazanzides P (2010) A component-based architecture for flexible integration of robotic systems. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Oct. 18–22. pp 6107–6112

  26. Pieper S, Halle M, Kikinis R (2004) 3D Slicer. In: Proceedings of IEEE international symposium on biomedical imaging, April 15–18. pp 632–635

  27. Pieper S, Lorenson B, Schroeder W, Kikinis R (2006) The NA-MIC kit: ITK, VTK, pipelines, grids, and 3D Slicer as an open platform for the medical image computing community. Proc IEEE Int Symp Biomed Imaging 1: 698–701

    Google Scholar 

  28. Arun KS, Huang TS, Blostein SD (1987) Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell 9(5): 698–700

    Article  PubMed  CAS  Google Scholar 

  29. Holly LT, Bloch O, Johnson JP (2006) Evaluation of registration techniques for spinal image guidance. J Neurosurg Spine 4(4): 323–328

    Article  PubMed  Google Scholar 

  30. Fitzpatrick JM, West JB (2001) The distribution of target registration error in rigid-body point-based registration. IEEE Trans Med Imaging 20(9): 917–927

    Article  PubMed  CAS  Google Scholar 

  31. Matinfar M, Baird C, Batouli A, Clatterbuck R, Kazanzides P (2007) Robot-assisted skull base surgery. In: IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), Oct. 29–Nov. 2. pp 865–870

  32. Boctor EM, Fichtinger G, Taylor RH, Choti MA (2003) Tracked 3D ultrasound in radio-frequency liver ablation. Proc SPIE 5035: 174–182

    Article  Google Scholar 

  33. Cho YB, Moseley DJ, Siewerdsen JH, Jaffray DA (2004) Geometric calibration of cone-beam computerized tomography system and medical linear accelerator. In: Proc XIV ICCR—Int Conf On the Use of Comp in Rad Ther, pp 482–485

  34. Daly MJ, Siewerdsen JH, Cho YB, Jaffray DA, Irish JC (2008) Geometric calibration of a mobile C-arm for intraoperative cone-beam CT. Med Phys 35(5): 2124–2136

    Article  PubMed  CAS  Google Scholar 

  35. Siddon RL (1985) Fast calculation of the exact radiological path for a three-dimensional CT array. Med Phys 12(2): 252–255

    Article  PubMed  CAS  Google Scholar 

  36. Forsyth DA, Ponce J (2002) Computer vision: a modern approach. Prentice Hall, NJ, USA

    Google Scholar 

  37. Trucco E, Verri A (1998) Introductory techniques for 3-D computer vision. 1 edn. Prentice Hall, Englewood Cliffs, NJ

    Google Scholar 

  38. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11): 1330–1334

    Article  Google Scholar 

  39. Shahidi R, Bax MR, Maurer CR Jr, Johnson JA, Wilkinson EP, Bai W, West JB, Citardi MJ, Manwaring KH, Khadem R (2002) Implementation, calibration and accuracy testing of an image-enhanced endoscopy system. IEEE Trans Med Imag 21(12): 1524–1535

    Article  Google Scholar 

  40. Zhengyou Z Flexible (1999) Camera Calibration by viewing a plane from unknown orientations. In: IEEE Intl. Conf. on Computer Vision (ICCV), pp 666–673

  41. Hamming NM, Daly MJ, Irish JC, Siewerdsen JH (2008) Effect of fiducial configuration on target registration error in intraoperative cone-beam CT guidance of head and neck surgery. Conf Proc IEEE Eng Med Biol Soc 2008: 3643–3648

    PubMed  Google Scholar 

  42. West JB, Fitzpatrick JM, Toms SA, Maurer CR Jr, Maciunas RJ (2001) Fiducial point placement and the accuracy of point-based, rigid body registration. Neurosurg 48(4):810–816; (discussion 816–817)

    Google Scholar 

  43. Labadie RF, Shah RJ, Harris SS, Cetinkaya E, Haynes DS, Fenlon MR, Juszczyk AS, Galloway RL, Fitzpatrick JM (2005) In vitro assessment of image-guided otologic surgery: submillimeter accuracy within the region of the temporal bone. J Otolaryngol Head Neck Surg 132(3): 435–442

    Article  Google Scholar 

  44. Strong EB, Rafii A, Holhweg-Majert B, Fuller SC, Metzger MC (2008) Comparison of 3 optical navigation systems for computer-aided maxillofacial surgery. Arch Otolaryngol Head Neck Surg 134(10): 1080–1084

    Article  PubMed  Google Scholar 

  45. Fried MP, Kleefield J, Gopal H, Reardon E, Ho BT, Kuhn FA (1997) Image-guided endoscopic surgery: results of accuracy and performance in a multicenter clinical study using an electromagnetic tracking system. Laryngoscope 107(5): 594–601

    Article  PubMed  CAS  Google Scholar 

  46. Schlaier J, Warnat J, Brawanski A (2002) Registration accuracy and practicability of laser-directed surface matching. Comput Aid Surg 7(5): 284–290

    Article  CAS  Google Scholar 

  47. Maier-Hein L, Tekbas A, Seitel A, Pianka F, Muller SA, Satzl S, Schawo S, Radeleff B, Tetzlaff R, Franz AM, Muller-Stich BP, Wolf I, Kauczor HU, Schmied BM, Meinzer HP (2008) In vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver. Med Phys 35(12): 5385–5396

    Article  PubMed  Google Scholar 

  48. Birkfellner W, Solar P, Gahleitner A, Huber K, Kainberger F, Kettenbach J, Homolka P, Diemling M, Watzek G, Bergmann H (2001) In-vitro assessment of a registration protocol for image guided implant dentistry. Clin Oral Implants Res 12(1): 69–78

    Article  PubMed  CAS  Google Scholar 

  49. Labadie RF, Shah RJ, Harris SS, Cetinkaya E, Haynes DS, Fenlon MR, Juscyzk AS, Galloway RL, Fitzpatrick JM (2004) Submillimetric target-registration error using a novel, non-invasive fiducial system for image-guided otologic surgery. Comput Aid Surg 9(4): 145–153

    Google Scholar 

  50. Maurer CR Jr, Fitzpatrick JM, Wang MY, Galloway RL Jr, Maciunas RJ, Allen GS (1997) Registration of head volume images using implantable fiducial markers. IEEE Trans Med Imag 16(4): 447–462

    Article  Google Scholar 

  51. Li Q, Zamorano L, Jiang Z, Gong JX, Pandya A, Perez R, Diaz F (1999) Effect of optical digitizer selection on the application accuracy of a surgical localization system—a quantitative comparison between the OPTOTRAK: and flashpoint tracking systems. Comput Aid Surg 4(6): 314–321

    CAS  Google Scholar 

  52. Blostein SD, Huang TS (1987) Error analysis in stereo determination of 3-D point positions. IEEE Trans Pattern Anal Mach Intell PAMI 9(6): 752–765

    Article  CAS  Google Scholar 

  53. Chang C, Chatterjee S (1992) Quantization error analysis in stereo vision. In: Conference record of the twenty-sixth asilomar conference on signals, systems and computers, Oct. 26–28. pp 1037–1041

  54. Gallup D, Frahm JM, Mordohai P, Pollefeys M (2008) Variable baseline/resolution stereo. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 23–28. pp 1–8

  55. Roth M, Lanza DC, Kennedy DW, Yousem D, Scanlan KA, Zinreich J (1995) Advantages and disadvantages of three-dimensional computed tomography intraoperative localization for functional endoscopic sinus surgery. Laryngoscope 105(12): 1279–1286

    Article  PubMed  CAS  Google Scholar 

  56. Goldsmith MM, Bucholz RD, Smith KR, Nitsche N (1995) Clinical applications of frameless stereotactic devices in neurotology: preliminary report. Am J Otol 16(4): 475–479

    PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Biomedical Engineering, Johns Hopkins University, Traylor Building, Room #726, 720 Rutland Avenue, Baltimore, MD, 21205-2109, USA

    S. Reaungamornrat, Y. Otake, A. Uneri, S. Schafer, D. J. Mirota, S. Nithiananthan & J. W. Stayman

  2. Siemens Healthcare XP Division, Erlangen, Germany

    G. Kleinszig

  3. Department of Biomedical Engineering, Johns Hopkins University, Good Samaritan Hospital, 5601 Loch Raven Blvd., Room G-1, Baltimore, MD, 21239, USA

    A. J. Khanna

  4. Department of Orthopaedic Surgery, Johns Hopkins University, Good Samaritan Hospital, 5601 Loch Raven Blvd., Room G-1, Baltimore, MD, 21239, USA

    A. J. Khanna

  5. Department of Computer Science, Johns Hopkins University, Computational Sciences and Engineering Building, Room #127, 3400 North Charles Street, Baltimore, Maryland, 21218, USA

    R. H. Taylor

  6. Department of Biomedical Engineering, Johns Hopkins University, Traylor Building, Room #718, 720 Rutland Avenue, Baltimore, MD, 21205-2109, USA

    J. H. Siewerdsen

Authors
  1. S. Reaungamornrat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. Otake
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Uneri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Schafer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. D. J. Mirota
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. S. Nithiananthan
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. J. W. Stayman
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. G. Kleinszig
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. A. J. Khanna
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. R. H. Taylor
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. J. H. Siewerdsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to J. H. Siewerdsen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Reaungamornrat, S., Otake, Y., Uneri, A. et al. An on-board surgical tracking and video augmentation system for C-arm image guidance. Int J CARS 7, 647–665 (2012). https://doi.org/10.1007/s11548-012-0682-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-012-0682-9

Keywords

Search

Navigation