Abstract
Deep learning-based approaches are attracting increasing attention in medicine. Applying deep learning models to specific tasks in the medical field is very useful for early disease detection. In this study, the problem of detecting pancreatic cancer by classifying CT images was solved using the provided deep learning-based framework. The choice of the optimal cut-off point is particularly important for an effective assessment of the results of the classification. In order to investigate the capabilities of the deep learning-based framework and to maximise pancreatic cancer diagnostic performance through the selection of optimal cut-off points, experimental studies were carried out using open-access data. Four classification accuracy metrics (Youden index, closest-to-(0,1) criterion, balanced accuracy, g-mean) were used to find the optimal cut-off point in order to balance sensitivity and specificity. This study compares different approaches for finding the optimal cut-off points and selects those that are most clinically relevant.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Berrar, D.: Performance measures for binary classification. In: Ranganathan, S., Gribskov, M., Nakai, K., Schönbach, C. (eds.) Encyclopedia of Bioinformatics and Computational Biology, pp. 546–560. Academic Press, Oxford (2019). https://doi.org/10.1016/B978-0-12-809633-8.20351-8
Cardobi, N., et al.: An overview of artificial intelligence applications in liver and pancreatic imaging. Cancers 13(9), 2162 (2021). https://doi.org/10.3390/cancers13092162
Chen, F.M., Ni, J.M., Zhang, Z.Y., Zhang, L., Li, B., Jiang, C.J.: Presurgical evaluation of pancreatic cancer: a comprehensive imaging comparison of CT versus MRI. Am. J. Roentgenol. 206(3), 526–535 (2016). https://doi.org/10.2214/AJR.15.15236
Chen, P.T., et al.: Pancreatic cancer detection on CT scans with deep learning: a nationwide population-based study. Radiology 220152 (2022). https://doi.org/10.1148/radiol.220152
Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26(6), 1045–1057 (2013). https://doi.org/10.1007/s10278-013-9622-7
Coffin, M., Sukhatme, S.: Receiver operating characteristic studies and measurement errors. Biometrics 823–837 (1997)
Cubuk, C., et al.: Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes. Genet. Med. 23(11), 2096–2104 (2021). https://doi.org/10.1038/s41436-021-01265-z
Fluss, R., Faraggi, D., Reiser, B.: Estimation of the Youden index and its associated cutoff point. Biom. J. 47(4), 458–472 (2005). https://doi.org/10.1002/bimj.200410135
Kumar, H., DeSouza, S.V., Petrov, M.S.: Automated pancreas segmentation from computed tomography and magnetic resonance images: a systematic review. Comput. Methods Programs Biomed. 178, 319–328 (2019). https://doi.org/10.1016/j.cmpb.2019.07.002
Liu, K.L., et al.: Deep learning to distinguish pancreatic cancer tissue from non-cancerous pancreatic tissue: a retrospective study with cross-racial external validation. Lancet Digit. Health 2(6), e303–e313 (2020). https://doi.org/10.1016/S2589-7500(20)30078-9
Mazurowski, M.A., Buda, M., Saha, A., Bashir, M.R.: Deep learning in radiology: an overview of the concepts and a survey of the state of the art with focus on MRI. J. Magn. Reson. Imaging 49(4), 939–954 (2019). https://doi.org/10.1002/jmri.26534
Perkins, N.J., Schisterman, E.F.: The inconsistency of “optimal’’ cutpoints obtained using two criteria based on the receiver operating characteristic curve. Am. J. Epidemiol. 163(7), 670–675 (2006). https://doi.org/10.1093/aje/kwj063
Redondo, A.R., Navarro, J., Fernández, R.R., de Diego, I.M., Moguerza, J.M., Fernández-Muñoz, J.J.: Unified performance measure for binary classification problems. In: Analide, C., Novais, P., Camacho, D., Yin, H. (eds.) IDEAL 2020. LNCS, vol. 12490, pp. 104–112. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-62365-4_10
Roth, H.R., Farag, A., Turkbey, E., Lu, L., Liu, J., Summers, R.M.: Data from pancreas-CT. The cancer imaging archive (2016). https://doi.org/10.7937/K9/TCIA.2016.tNB1kqBU
Youden, W.J.: Index for rating diagnostic tests. Cancer 3(1), 32–35 (1950). https://doi.org/10.1002/1097-0142(1950)3:1\(<\)32::aid-cncr2820030106\(>\)3.0.co;2-3
Zhang, Y., et al.: A deep learning framework for pancreas segmentation with multi-atlas registration and 3D level-set. Med. Image Anal. 68, 101,884 (2021). https://doi.org/10.1016/j.media.2020.101884
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dzemyda, G. et al. (2024). Optimal Cut-Off Points for Pancreatic Cancer Detection Using Deep Learning Techniques. In: Rocha, A., Adeli, H., Dzemyda, G., Moreira, F., Colla, V. (eds) Information Systems and Technologies. WorldCIST 2023. Lecture Notes in Networks and Systems, vol 799. Springer, Cham. https://doi.org/10.1007/978-3-031-45642-8_54
Download citation
DOI: https://doi.org/10.1007/978-3-031-45642-8_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-45641-1
Online ISBN: 978-3-031-45642-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)