Abstract
Precise detection and surgical resection of the tumors during an operation greatly increases the chance of the overall procedure efficacy. Emerging experimental in-vivo imaging technologies such as Confocal Laser Endomicroscopy (CLE), could potentially assist surgeons to examine brain tissues on histological scale in real-time during the operation. However, it is a challenging task for neurosurgeons to interpret these images in real-time, primarily due to the low signal to noise ratio and variability in the patterns expressed within these images by various examined tissue types. In this paper, we present a comprehensive computational framework capable of automatic brain tumor classification in real-time. Specifically, our contributions include: (a) an end-to-end computational pipeline where a variety of the feature extraction methods, encoding schemes, and classification algorithms can be readily deployed, (b) thorough evaluation of state-of-the-art low-level image features and popular encoding techniques in context of CLE imagery, and finally, (c) A highly optimized feature pooling method based on codeword proximity. The proposed system can effectively classify two types of commonly diagnosed brain tumors in CLE sequences captured in real-time with close to 90% accuracy. Extensive experiments on a dataset of 117 videos demonstrate the efficacy of our system.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bleeker, F.E., et al.: Recent advances in the molecular understanding of glioblastoma. Journal of Neuro-Oncology 108(1), 11–27 (2012)
Lee, J.H., Sade, B.: Meningiomas of the central neuraxis: unique tumors. In: Meningiomas, pp. 157–162 (2009)
Lee, E.J., et al.: Two primary brain tumors, meningioma and glioblastoma multiforme, in opposite hemispheres of the same patient. Journal of Clinical Neuroscience 9(5), 589–591 (2002)
Paull, P.E., et al.: Confocal laser endomicroscopy: a primer for pathologists. Arch. Pathol. Lab. Med. 135(10), 1343–1348 (2011)
André, B., Vercauteren, T., Perchant, A., Buchner, A.M., Wallace, M.B., Ayache, N.: Introducing space and time in local feature-based endomicroscopic image retrieval. In: Caputo, B., Müller, H., Syeda-Mahmood, T., Duncan, J.S., Wang, F., Kalpathy-Cramer, J. (eds.) MCBR-CDS 2009. LNCS, vol. 5853, pp. 18–30. Springer, Heidelberg (2010)
Andre, B., et al.: A smart atlas for endomicroscopy using automated video retrieval. Med. Image. Anal. 15(4), 460–476 (2011)
Csurka, G., Bray, C., Dance, C., Fan, L.: Visual categorization with bags of keypoints. In: Workshop ECCV, pp. 1–22 (2004)
Bauer, S., Nolte, L.-P., Reyes, M.: Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part III. LNCS, vol. 6893, pp. 354–361. Springer, Heidelberg (2011)
Couceiro, S., Barreto, J.P., Freire, P., Figueiredo, P.: Description and classification of confocal endomicroscopic images for the automatic diagnosis of inflammatory bowel disease. In: Wang, F., Shen, D., Yan, P., Suzuki, K. (eds.) MLMI 2012. LNCS, vol. 7588, pp. 144–151. Springer, Heidelberg (2012)
Kohandani Tafresh, M., Linard, N., André, B., Ayache, N., Vercauteren, T.: Semi-automated query construction for content-based endomicroscopy video retrieval. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014, Part I. LNCS, vol. 8673, pp. 89–96. Springer, Heidelberg (2014)
Yang, J., Yu, K., Gong, Y., Huang, T.S.: Linear spatial pyramid matching using sparse coding for image classification. In: IEEE CVPR, pp. 1794–1801 (2009)
F., Perronnin, Y.L., Sanchez, J., Poirier, H.: Large-scale image retrieval with compressed fisher vectors. In: IEEE VPR, pp. 3384–3391, June 2010
Arandjelović, R., Zisserman, A.: All about VLAD. In: IEEE CVPR (2013)
Ojala, T., et al.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE TPAMI 24(7), 971–987 (2002)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: An efficient alternative to sift or surf. In: ICCV, pp. 2564–2571, November 2011
Ortiz, R.: Freak: Fast retina keypoint. In: IEEE CVPR, pp. 510–517 (2012)
Wang, J., et al.: Locality-constrained linear coding for image classification. In: IEEE CVPR (2010)
Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: IEEE CVPR, pp. 2161–2168 (2006)
Hoffman, A., et al.: Confocal laser endomicroscopy: technical status and current indications. Endoscopy 38, 1275–1283 (2006)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Prentice-Hall, Inc., Upper Saddle River (2008)
Chang, C.-C., Lin, C.-J.: LIBSVM: A library for support vector machines. ACM Trans. on Intel. Sys. and Tech. 2, 27:1–27:27 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wan, S. et al. (2015). Towards an Efficient Computational Framework for Guiding Surgical Resection through Intra-operative Endo-microscopic Pathology. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds) Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science(), vol 9349. Springer, Cham. https://doi.org/10.1007/978-3-319-24553-9_52
Download citation
DOI: https://doi.org/10.1007/978-3-319-24553-9_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24552-2
Online ISBN: 978-3-319-24553-9
eBook Packages: Computer ScienceComputer Science (R0)