Abstract
An automatic elastic registration method suited for vascularized organs is proposed. The vasculature in both the preoperative and intra-operative images is represented as a graph. A typical application of this method is the fusion of pre-operative information onto the organ during surgery, to compensate for the limited details provided by the intra-operative imaging modality (e.g. cone beam CT) and to cope with changes in the shape of the organ. Due to image modalities differences and organ deformation, each graph has a different topology and shape. The adaptive compliance graph matching (ACGM) method presented does not require any manual initialization, handles intra-operative nonrigid deformations of up to 65 mm and computes a complete displacement field over the organ from only the matched vasculature. ACGM is better than the previous biomechanical graph matching method (Garcia Guevara et al. IJCARS, 2018) (BGM) because it uses an efficient biomechanical vascularized liver model to compute the organ’s transformation and the vessels bifurcations compliance. This allows to efficiently find the best graph matches with a novel compliance-based adaptive search. These contributions are evaluated on 10 realistic synthetic and 2 porcine automatically segmented datasets. ACGM obtains better target registration error (TRE) than BGM, with an average TRE in the real datasets of 4.2 mm compared to 6.5 mm, respectively. It also is up to one order of magnitude faster, less dependent on the parameters used and more robust to noise.
Similar content being viewed by others
References
Cho, M., J. Lee, and K. M. Lee. Reweighted random walks for graph matching. In: Proceedings of the 11th European Conference on Computer Vision: Part V, ECCV’10. Berlin: Springer, 2010, pp. 492–505.
Duriez, C., S. Cotin, J. Lenoir, and P. Neumann. New approaches to catheter navigation for interventional radiology simulation. Comput. Aided Surg. 11:300–308, 2006.
Garcia Guevara, J., I. Peterlik, M.-O. Berger, and S. Cotin. Biomechanics-based graph matching for augmented ct-cbct. IJCARS , 2018.
Groher, M., T. F. Jakobs, N. Padoy, and N. Navab. Planning and intraoperative visualization of liver catheterizations: new CTA protocol and 2D-3D registration method. Acad. Radiol. 14:1325–1340, 2007.
Lange, T., N. Papenberg, S. Heldmann, J. Modersitzki, B. Fischer, H. Lamecker, and P. M. Schlag. 3D ultrasound–CT registration of the liver using combined landmark-intensity information. Int. J. Comput. Assist. Radiol. Surg. 4:79–88, 2009.
Leordeanu, M. and M. Hebert. A spectral technique for correspondence problems using pairwise constraints. In: International Conference of Computer Vision (ICCV), volume 2, pp. 1482–1489, 2005.
Martínez, J., J. Dumas, S. Lefebvre, and L.-Y. Wei. Structure and appearance optimization for controllable shape design. ACM Trans. Graph. 34:229:1–22911, 2015.
Matl, S., R. Brosig, M. Baust, N. Navab, and S. Demirci. Vascular image registration techniques: a living review. Med. Image Anal. 35:1 – 17, 2017.
Moriconi, S., M. Zuluaga, H. Rolf Jäger, P. Nachev, S. Ourselin, and M. Jorge Cardoso. Elastic registration of geodesic vascular graphs. In: MICCAI 2018, pp. 810–818, 2018.
Nesme, M., Y. Payan, and F. Faure. Efficient, physically plausible finite elements. In: Eurographics 2005, Short Papers, August 2005, edited by J. Dingliana and F. Ganovelli, 2005.
Oktay, O., L. Zhang, T. Mansi, P. Mountney, P. Mewes, S. Nicolau, L. Soler, and C. Chefd’hotel. Biomechanically driven registration of pre- to intra-operative 3D images for laparoscopic surgery. In: International Conference on MICCAI. Springer, 2013, pp. 1–9.
Peterlík, I., H. Courtecuisse, R. Rohling, P. Abolmaesumi, C. Nguan, S. Cotin, and S. Salcudean. Fast elastic registration of soft tissues under large deformations. Med. Image Anal. 45:24–40, 2018.
Peterlík, I., C. Duriez, and S. Cotin. Modeling and real-time simulation of a vascularized liver tissue. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 50–57, 2012.
Peters, T. and K. Cleary. Image-Guided Interventions: Technology and Applications. New York: Springer 2008.
Pinheiro, M. A. and J. Kybic. Incremental B-spline deformation model for geometric graph matching. In: ISBI, 2018.
Pinheiro, M. A., J. Kybic, and P. Fua. Geometric graph matching using Monte Carlo tree search. IEEE Trans. Pattern Anal. Mach. Intell. 39:2171–2185, 2017.
Plantefève, R., S. Kadoury, A. Tang, and I. Peterlik. Robust automatic graph-based skeletonization of hepatic vascular trees. In: Intravascular Imaging and Computer Assisted Stenting, and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pp. 20–28, 2017.
Plantefève, R., I. Peterlik, N. Haouchine, and S. Cotin. Patient-specific biomechanical modeling for guidance during minimally-invasive hepatic surgery. Ann. Biomed. Eng. 44:139–153, 2016.
Przemieniecki, J. S. Theory of Matrix Structural Analysis. New York: Dover, 1985.
Serradell, E., M. A. Pinheiro, R. Sznitman, J. Kybic, F. Moreno-Noguer, and P. Fua. Non-rigid graph registration using active testing search. IEEE Trans. Pattern Anal. Mach. Intell. 37:625–638, 2015.
Smistad, E., A. C. Elster, and F. Lindseth. GPU accelerated segmentation and centerline extraction of tubular structures from medical images. Int. J. Comput. Assist. Radiol. Surg. 9:561–575, 2014.
Sotiras, A., C. Davatzikos, and N. Paragios. Deformable medical image registration: a survey. IEEE Trans. Med. Imaging 32:1153–1190, 2013.
Tacher, V., A. Radaelli, M. Lin, and J.-F. Geschwind. How I do it: cone-beam CT during transarterial chemoembolization for liver cancer. Radiology 274:320–334, 2015.
Xue, H., C. Malamateniou, L. Srinivan, J. Hajnal, and D. Rueckert. Automatic extraction and matching of neonatal cerebral vasculature. In: ISBI 2006, pp. 810–818, 2006.
Zhou, F. and F. D. la Torre Frade. Factorized graph matching. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015.
Acknowledgments
The authors are grateful for the support from Inria, the MIMESIS and MAGRIT Teams, and IHU Strasbourg. Jaime Garcia Guevara is supported by the Grand Est region and Inria.
Conflict of interest
We declare that this article is free from conflicts of interest.
Author information
Authors and Affiliations
Corresponding author
Additional information
Associate Editor Elena S. Di Martino oversaw the review of this article.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Garcia Guevara, J., Peterlik, I., Berger, MO. et al. Elastic Registration Based on Compliance Analysis and Biomechanical Graph Matching. Ann Biomed Eng 48, 447–462 (2020). https://doi.org/10.1007/s10439-019-02364-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10439-019-02364-4