Abstract
In digital pathology, cancer grading has been widely studied by utilizing hand-crafted features and advanced machine learning and deep learning methods. In most of such studies, cancer grading has been formulated as a multi-class categorical classification problem, likely overlooking the relationship among different cancer grades. Herein, we propose a ranking-based deep neural network for cancer grading in pathology images. Utilizing deep neural networks, pathology images are mapped into a latent space. Built based upon a triplet loss, a ranking loss is devised to maximize the inter-class distance among cancer grades in the latent space with respect to the aggressiveness of cancer, leading to the correct ordering or rank of pathology images. To evaluate the proposed method, a number of colorectal pathology images have been employed. The experimental results demonstrate that the proposed approach is capable of predicting cancer grades with high accuracy, outperforming the deep neural networks without the ranking loss.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bray, F., Ferlay, J., Soerjomataram, I., Siegel, R.L., Torre, L.A., Jemal, A.: Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 68, 394–424 (2018)
Berglund, R.K., Jones, J.S.: A practical guide to prostate cancer diagnosis and management. Clevel. Clin. J. Med. 78, 321 (2011)
Elmore, J.G., et al.: Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA 313, 1122–1132 (2015)
Williams, B.J., Bottoms, D., Treanor, D.: Future-proofing pathology: the case for clinical adoption of digital pathology. J. Clin. Pathol. 70, 1010–1018 (2017)
Niazi, M.K.K., Parwani, A.V., Gurcan, M.N.: Digital pathology and artificial intelligence. Lancet Oncol. 20, e253–e261 (2019)
Kwak, J.T., Hewitt, S.M., Sinha, S., Bhargava, R.: Multimodal microscopy for automated histologic analysis of prostate cancer. BMC Cancer 11, 62 (2011)
Doyle, S., Feldman, M.D., Shih, N., Tomaszewski, J., Madabhushi, A.: Cascaded discrimination of normal, abnormal, and confounder classes in histopathology: Gleason grading of prostate cancer. BMC Bioinformatics 13, 282 (2012)
Doyle, S., Feldman, M., Tomaszewski, J., Madabhushi, A.: A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies. IEEE Trans. Biomed. Eng. 59, 1205–1218 (2010)
Kwak, J.T., Hewitt, S.M.: Multiview boosting digital pathology analysis of prostate cancer. Comput. Methods Prog. Biomed. 142, 91–99 (2017)
Wang, X., et al.: Machine learning models for multiparametric glioma grading with quantitative result interpretations. Front. Neurosci. 12, 1046 (2019)
Xu, Y., et al.: Multi-label classification for colon cancer using histopathological images. Microsc. Res. Techniq. 76, 1266–1277 (2013)
Vu, Q.D., Kwak, J.T.: A dense multi-path decoder for tissue segmentation in histopathology images. Comput. Methods Prog. Biomed. 173, 119–129 (2019)
Hou, L., et al.: Sparse autoencoder for unsupervised nucleus detection and representation in histopathology images. Pattern Recogn. 86, 188–200 (2019)
Graham, S., et al.: Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images. Med. Image Anal. 58, 101563 (2019)
Litjens, G., et al.: Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci. Rep. 6, 26286 (2016)
Hou, L., Agarwal, A., Samaras, D., Kurc, T.M., Gupta, R.R., Saltz, J.H.: Robust histopathology image analysis: to label or to synthesize? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8533–8542 (2019)
Arvaniti, E., et al.: Automated Gleason grading of prostate cancer tissue microarrays via deep learning. Sci. Rep. 8, 1–11 (2018)
Aresta, G., et al.: Bach: Grand challenge on breast cancer histology images. Med. Image Anal. 56, 122–139 (2019)
Ertosun, M.G., Rubin, D.L.: Automated grading of gliomas using deep learning in digital pathology images: a modular approach with ensemble of convolutional neural networks. In: AMIA Annual Symposium Proceedings, p. 1899. American Medical Informatics Association
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.-C.: Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510–4520
Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823
Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification (2017). https://arxiv.org/abs/1703.07737
Tan, M., Le, Q.V.: Efficientnet: rethinking model scaling for convolutional neural networks (2019). https://arxiv.org/abs/1905.11946
Jurman, G., Riccadonna, S., Furlanello, C.: A comparison of MCC and CEN error measures in multi-class prediction. PLoS One 7, e41882 (2012)
Acknowledgements
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No.NRF-2021R1A4A1031864).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Le Vuong, T.T., Kim, K., Song, B., Kwak, J.T. (2021). Ranking Loss: A Ranking-Based Deep Neural Network for Colorectal Cancer Grading in Pathology Images. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12908. Springer, Cham. https://doi.org/10.1007/978-3-030-87237-3_52
Download citation
DOI: https://doi.org/10.1007/978-3-030-87237-3_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87236-6
Online ISBN: 978-3-030-87237-3
eBook Packages: Computer ScienceComputer Science (R0)