Skip to main content
  • Research article
  • Open access
  • Published:

Using ultrasound features and radiomics analysis to predict lymph node metastasis in patients with thyroid cancer

Abstract

Background

Lymph node metastasis (LNM) is an important factor for thyroid cancer patients’ treatment and prognosis. The aim of this study was to explore the clinical value of ultrasound features and radiomics analysis in predicting LNM in thyroid cancer patients before surgery.

Methods

The characteristics of ultrasound images of 150 thyroid nodules were retrospectively analysed. All nodules were confirmed as thyroid cancer. Among the assessed patients, only one hundred and twenty-six patients underwent lymph node dissection. All patients underwent an ultrasound examination before surgery. In the radiomic analysis, the area of interest was identified from selected ultrasound images by using ITK-SNAP software. The radiomic features were extracted by using Ultrosomics software. Then, the data were classified into a training set and a validation set. Hypothetical tests and bagging were used to build the model. The diagnostic performance of different ultrasound features was assessed, a radiomic analysis was conducted, and a receiver operating characteristic (ROC) curve analysis was performed to explore the diagnostic accuracy.

Results

Regarding the prediction of LNM, the ROC curves showed that the area under the curve (AUC) values of an irregular shape and microcalcification were 0.591 (P = 0.059) and 0.629 (P = 0.007), respectively. In the radiomics analysis, in the training set, the AUC value of LNM was 0.759, with a sensitivity of 0.90 and a specificity of 0.860. In the verification set, the AUC was 0.803, with a sensitivity of 0.727 and a specificity of 0.800.

Conclusions

Microcalcification and an irregular shape are predictors of LNM in thyroid carcinoma patients. In addition, radiomics analysis has promising value in screening meaningful ultrasound features in thyroid cancer patients with LNM. Therefore, the prediction of LNM based on ultrasound features and radiomic features is useful for making appropriate decisions regarding surgery and interventions before thyroid carcinoma surgery.

Peer Review reports

Background

Thyroid nodules are frequently found by clinicians, but thyroidectomy is needed for only a subset of thyroid nodules. Most types of thyroid cancer are described as indolent carcinomas that have a good prognosis [1]. However, recurrence and metastasis are still unavoidable, especially in undifferentiated thyroid cancer. Cervical lymph node metastasis (LNM), which occurs in regions of the neck, is a common type of metastasis of thyroid cancer, with a frequency of 30% to 90% in papillary thyroid cancer [2]. In addition, LNM is an important factor for recurrence [3,4,5,6]. The revised American Thyroid Association management guidelines indicate that LNM in the central region of the neck is considered a risk factor in thyroid cancer [7]. In addition, LNM has an important reference value in the determination of surgical plans.

Ultrasonography, including greyscale ultrasonography, colour Doppler ultrasonography, ultrasound elastography, contrast-enhanced ultrasound and ultrasound-guided fine-needle aspiration biopsy (FNAB), has been widely applied to screen thyroid nodules and LNM. Studies have reported that suspicious ultrasound features are associated with LNM [8, 9]. However, the sensitivity of LNM detection by ultrasound is low at approximately 41.3%-61% [10,11,12]. FNAB is an invasive method used to identify nodules and is unnecessary in most patients [13]. Therefore, identifying an effective and noninvasive way to detect lymph nodes by radiologists is necessary.

Radiomics analysis was first reported by Lambin P in 2012 [14]. This analysis is mainly applied to extract and analyse imaging features from medical images, such as computed tomography (CT) and magnetic resonance images, to quantitatively evaluate diseases [15]. Studies have shown that image feature-based radiomics extraction has objective characteristics and great value in predicting clinical outcomes [14]. Radiomics analysis has been applied in various diseases, such as thyroid cancer [16], lung cancer [17], liver cancer [18] and breast cancer [19]. Therefore, the use of ultrasound radiomics analysis to predict lymph node metastasis before surgery may have an important clinical value.

The purpose of our study was to explore the correlations between ultrasound features and LNM and further develop a radiomics analysis method for the prediction of LNM in thyroid cancer before surgery.

Methods

Patients

This retrospective study was approved by the Ethics Committee of the First Affiliated Hospital of Guangxi Medical University. One hundred and fifty patients were confirmed to have thyroid cancer, and lymph node sections were obtained in our hospital from August 2016 to December 2018. Only one hundred and twenty-six patients were included in the radiomic analysis. These 126 patients included 94 females and 32 males. The mean age was 38.06 years (range, 17–82 years). All patients signed an informed consent form discussing the use of the patients’ information for scientific research to the full extent of the law before they were admitted to the hospital. The inclusion criteria were as follows: patients who underwent surgical resection within 2 weeks after a neck ultrasound examination; patients with pathologically confirmed thyroid cancer; patients who underwent lymph node resection; and patients with a confirmed lymph node state. The exclusion criteria were as follows: patients who underwent preoperative radiotherapy or radiation therapy and patients who had unclear ultrasound images.

Greyscale ultrasonography examination

All included patients underwent an ultrasound examination before surgery. The ultrasound examination was performed using a GE LOGIQ E9 ultrasound system with a 6-15L linear array probe, and the frequency was set to 11–13 MHz. An Esaote system (MYLAB CLASS C) with an 11-L4 linear array probe was also used to detect the thyroid nodules, and the frequency was set to 5–8 MHz. Each patient was placed in the supine position while lying on the examination bed. Then, the neck was fully extended, and the patient was told to breathe calmly. The thyroid gland and its surrounding tissues and lymph nodes were examined. The number of nodules and the size, boundary, internal structure, internal echo, calcification and status of the lymph nodes was observed and recorded. Nodules that were solid, hypoechogenic, irregularly shaped, or taller than wide or contained microcalcification were considered suspicious for malignancy [20, 21]. According to the American Head and Neck Society and the American Academy of Otolaryngology-Head and Neck Surgery, the cervical lymph nodes were divided into six levels [22], and the abnormal lymph nodes were recorded by an ultrasound report.

Radiomics analysis

The ultrasound images were exported from our imaging system, and the images were converted from jpg format to Digital Imaging and Communications in Medicine format. Then, we used ITK-SNAP software (http://www.itksnap.org/pmwiki/pmwiki.php) to draw an outline of the area of interest (ROI). The ROI was delineated by two ultrasound radiologists with more than 5 years of experience in thyroid nodules in the largest size of the thyroid nodule. Ultrosomics (GE healthcare, version 1.1) was used to extract the radiomics features and build and evaluate the models. In total, 1079 radiomics features were extracted. Before analysing the radiomics features, the patients were randomly divided into the training and validation groups. Then, the collinearity feature was used to process the radiomics features. Then, hypothesis testing, the least absolute shrinkage and selection operator method and a principal component analysis were used to reduce the dimensionality of the radiomics features. Then, a decision tree, naive Bayes, KNN, a logistics regression, SVM, bagging, random forest, extremely randomized trees, AdaBoost and a gradient boosting decision tree were used to build the models. Fifty models were built, and a receiver operating characteristic (ROC) curve was applied to evaluate the models. The closer to 1 the area under the curve (AUC), the better the model.

Statistical analysis

The statistical analysis was performed using SPSS 23.0 (SPSS Inc., Chicago, IL, USA). The continuous quantitative data are shown as the mean ± standard deviation. An independent two-sample Student’s t-test was conducted to compare the data displaying a normal distribution. The categorical variables are shown as percentages, and a chi-square analysis or Fisher`s exact test was applied, as appropriate, to compare the results. A P-value < 0.05 indicated a significant difference.

Results

Correlation between ultrasound features and LNM

The relationship between the ultrasound features and LNM was analysed. Thyroid carcinoma with LNM tended to be irregularly shaped (P = 0.025) or contain microcalcifications (P = 0.004) (Table 1). However, other factors, such as solid-state, hypoechogenicity, and taller-than-wide features, did not significantly differ between the thyroid cancers with or without LNM. For the diagnosis of LNM, the ROC curve analysis suggested that the AUCs of the irregular shape and microcalcification were 0.591 (P = 0.059) and 0.629 (P = 0.007), respectively (Fig. 1).

Table 1 The relationships between LNM and ultrasound characteristics of thyroid cancer patients
Fig. 1
figure 1

ROC curve analysis of the ultrasound characteristics of LNM in thyroid cancer patients. The AUC values of an irregular shape and microcalcification were 0.591 (P = 0.059) and 0.629 (P = 0.007), respectively

Evaluation of LNM of thyroid cancer by radiomics analysis

In total, 1079 parameters were obtained by Ultrosomics software, and only 690 parameters were included in the following step of the analysis after the non-colinear feature processing. A model built by hypothesis testing and bagging was selected to evaluate LNM. In addition, 91 radiomics features were included in this model. Significant differences were observed between LNM and the radiomics features. In the training set, the AUC value of LNM was 0.759, with a sensitivity of 0.90 and a specificity of 0.860. In the verification set, the AUC was 0.803, with a sensitivity of 0.727 and a specificity of 0.800 (Fig. 2).

Fig. 2
figure 2

ROC curve analysis of the radiomics analysis of LNM in thyroid cancer patients. In the training set, the AUC value of LNM was 0.759. In the validation set, the AUC was 0.803

Discussion

Among all imaging methods, ultrasound is considered the most convenient method for assessing the characteristics of thyroid nodules and LNM. However, it is difficult to diagnose LNM involving small and nontypical lymph nodes in thyroid cancer in daily practice. Therefore, in this study, we focused on the clinical value of ultrasound features and radiomics analysis in the prediction of LNM in thyroid cancer. The current study showed that ultrasound features can predict LNM in thyroid cancer, but the meaningful features only included microcalcification and an irregular shape. In the present study, microcalcification and an irregular shape were associated with LNM, which is consistent with the results of previous studies [23, 24].

Although ultrasound is a recommended method for the detection of thyroid nodules and lymph nodes in clinical practice, it also has limitations. Radiomics analysis has great value in medicine in diagnosis and prognosis. Additionally, models built based on imaging can be used to predict LNM in many types of cancers. For example, a nomogram incorporating the radiomics signature and CA19-9 level can preoperatively predict LNM in patients with intrahepatic cholangiocarcinoma [25]. In other types of cancer, dynamic contrast-enhanced magnetic resonance imaging can also preoperatively predict sentinel LNM in breast cancer [26]. In addition, radiomics analysis based on 18 arterial-phase CT images has favourable predictive accuracy in LNM in patients with bladder cancer [27]. Therefore, the above studies highlight the feasibility of applying radiomics to assess malignant ultrasound features to predict LNM in thyroid cancer.

A meta-analysis demonstrated the value of ultrasound in the prediction of LNM in thyroid cancer with a sensitivity of 71% and specificity of 85% [28]. In this study, we used a radiomics analysis to predict LNM in patients with thyroid cancer on ultrasound. The findings of our study showed that the model had high sensitivity and specificity in predicting LNM, even higher than that of ultrasound [28], suggesting that radiomic analysis has great success in predicting LNM in thyroid cancer. Studies have demonstrated that radiomics analysis based on ultrasound is a promising way to assess the risk of LNM in thyroid cancer [16, 29]. In addition, a study showed that computer-aided diagnosis of the localization and differentiation of LNM from thyroid cancer on ultrasound had an accuracy of 83.0%, a sensitivity of 79.5% and specificity of 87.5% [30]. In addition to the application of ultrasound imaging radiomics, deep learning with CT can be used to predict LNM in thyroid cancer. A deep learning-based computer-aided diagnosis system had high accuracy in detecting LNM on preoperative CT in patients with thyroid cancer [31]. Based on this information, radiomics analysis has promising value in the prediction of LNM in thyroid cancer by ultrasound.

However, the present study has several limitations. This study was a retrospective study. In addition, the sample size of the population was small. The patients in this study were recruited from a single centre. In the future, large, multi-centre clinical studies are needed to further confirm the findings of this study.

Conclusions

In conclusion, in thyroid carcinoma, microcalcification and an irregular shape are reliable predictors of LNM. Radiomics analysis has promising value in screening meaningful ultrasound features in thyroid cancer patients with LNM. Therefore, the prediction of LNM based on malignant ultrasound features and radiomic features is useful for making appropriate surgical decisions before surgery in clinical practice.

Availability of data and materials

The datasets analysed during the current study are available from the corresponding author on reasonable request. The confidential patient data should not be shared.

Abbreviations

LNM:

Lymph node metastasis

FNAB:

Fine-needle aspiration biopsy

CT:

Computed tomography

ROC:

Receiver operating characteristic

AUC:

Area under the curve

ROI:

Area of interest

References

  1. Hundahl SA, Fleming ID, Fremgen AM, Menck HR: A National Cancer Data Base report on 53,856 cases of thyroid carcinoma treated in the U.S., 1985–1995 [see commetns]. Cancer 1998, 83(12):2638–2648.

  2. Choi YJ, Yun JS, Kook SH, Jung EC, Park YL. Clinical and imaging assessment of cervical lymph node metastasis in papillary thyroid carcinomas. World J Surg. 2010;34(7):1494–9.

    Article  Google Scholar 

  3. Machens A, Hinze R, Thomusch O, Dralle H. Pattern of nodal metastasis for primary and reoperative thyroid cancer. World J Surg. 2002;26(1):22–8.

    Article  Google Scholar 

  4. Zheng CM, Ji YB, Song CM, Ge MH, Tae K. Number of metastatic lymph nodes and ratio of metastatic lymph nodes to total number of retrieved lymph nodes are risk factors for recurrence in patients with clinically node negative papillary thyroid carcinoma. Clin Exp Otorhinolaryngol. 2018;11(1):58–64.

    Article  Google Scholar 

  5. Maksimovic S, Jakovljevic B, Gojkovic Z. Lymph node metastases papillary thyroid carcinoma and their importance in recurrence of disease. Med Arch. 2018;72(2):108–11.

    Article  Google Scholar 

  6. Kim SY, Kwak JY, Kim EK, Yoon JH, Moon HJ. Association of preoperative US features and recurrence in patients with classic papillary thyroid carcinoma. Radiology. 2015;277(2):574–83.

    Article  Google Scholar 

  7. American Thyroid Association Guidelines Taskforce on Thyroid N, Differentiated Thyroid C, Cooper DS, Doherty GM, Haugen BR, Kloos RT, Lee SL, Mandel SJ, Mazzaferri EL, McIver B et al: Revised American Thyroid Association management guidelines for patients with thyroid nodules and differentiated thyroid cancer. Thyroid 2009, 19(11):1167–1214.

  8. Cho E, Kim EK, Moon HJ, Yoon JH, Park VY, Kwak JY. High suspicion US pattern on the ATA guidelines, not cytologic diagnosis, may be a predicting marker of lymph node metastasis in patients with classical papillary thyroid carcinoma. Am J Surg. 2018;216(3):562–6.

    Article  Google Scholar 

  9. Liu C, Xiao C, Chen J, Li X, Feng Z, Gao Q, Liu Z. Risk factor analysis for predicting cervical lymph node metastasis in papillary thyroid carcinoma: a study of 966 patients. BMC Cancer. 2019;19(1):622.

    Article  Google Scholar 

  10. Kim E, Park JS, Son KR, Kim JH, Jeon SJ, Na DG. Preoperative diagnosis of cervical metastatic lymph nodes in papillary thyroid carcinoma: comparison of ultrasound, computed tomography, and combined ultrasound with computed tomography. Thyroid. 2008;18(4):411–8.

    Article  CAS  Google Scholar 

  11. Jeong HS, Baek CH, Son YI, Choi JY, Kim HJ, Ko YH, Chung JH, Baek HJ. Integrated 18F-FDG PET/CT for the initial evaluation of cervical node level of patients with papillary thyroid carcinoma: comparison with ultrasound and contrast-enhanced CT. Clin Endocrinol. 2006;65(3):402–7.

    Article  Google Scholar 

  12. Roh JL, Park JY, Kim JM, Song CJ. Use of preoperative ultrasonography as guidance for neck dissection in patients with papillary thyroid carcinoma. J Surg Oncol. 2009;99(1):28–31.

    Article  Google Scholar 

  13. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, Pacini F, Randolph GW, Sawka AM, Schlumberger M, et al. 2015 American thyroid association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the american thyroid association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid. 2016;26(1):1–133.

    Article  Google Scholar 

  14. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, Zegers CM, Gillies R, Boellard R, Dekker A, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48(4):441–6.

    Article  Google Scholar 

  15. Kumar V, Gu Y, Basu S, Berglund A, Eschrich SA, Schabath MB, Forster K, Aerts HJ, Dekker A, Fenstermacher D, et al. Radiomics: the process and the challenges. Magn Reson Imaging. 2012;30(9):1234–48.

    Article  Google Scholar 

  16. Liu T, Zhou S, Yu J, Guo Y, Wang Y, Zhou J, Chang C. Prediction of lymph node metastasis in patients with papillary thyroid carcinoma: a radiomics method based on preoperative ultrasound images. Technol Cancer Res Treatment. 2019;18:1533033819831713.

    Google Scholar 

  17. Lee G, Lee HY, Park H, Schiebler ML, van Beek EJR, Ohno Y, Seo JB, Leung A. Radiomics and its emerging role in lung cancer research, imaging biomarkers and clinical management: State of the art. Eur J Radiol. 2017;86:297–307.

    Article  Google Scholar 

  18. Feng ST, Jia Y, Liao B, Huang B, Zhou Q, Li X, Wei K, Chen L, Li B, Wang W, et al. Preoperative prediction of microvascular invasion in hepatocellular cancer: a radiomics model using Gd-EOB-DTPA-enhanced MRI. Eur Radiol. 2019;29(9):4648–59.

    Article  Google Scholar 

  19. Li H, Mendel KR, Lan L, Sheth D, Giger ML. Digital mammography in breast cancer: additive value of radiomics of breast parenchyma. Radiology. 2019;291(1):15–20.

    Article  Google Scholar 

  20. Kim EK, Park CS, Chung WY, Oh KK, Kim DI, Lee JT, Yoo HS. New sonographic criteria for recommending fine-needle aspiration biopsy of nonpalpable solid nodules of the thyroid. AJR Am J Roentgenol. 2002;178(3):687–91.

    Article  Google Scholar 

  21. Moon HJ, Kwak JY, Kim MJ, Son EJ, Kim EK. Can vascularity at power Doppler US help predict thyroid malignancy? Radiology. 2010;255(1):260–9.

    Article  Google Scholar 

  22. Robbins KT, Clayman G, Levine PA, Medina J, Sessions R, Shaha A, Som P, Wolf GT, American H, Neck S, et al. Neck dissection classification update: revisions proposed by the American Head and Neck Society and the American Academy of Otolaryngology-Head and Neck Surgery. Arch Otolaryng Head Neck Surg. 2002;128(7):751–8.

    Article  Google Scholar 

  23. Liu J, Zheng D, Li Q, Tang X, Luo Z, Yuan Z, Gao L, Zhao J. A predictive model of thyroid malignancy using clinical, biochemical and sonographic parameters for patients in a multi-center setting. BMC Endocrine Disorders. 2018;18(1):17.

    Article  Google Scholar 

  24. Watanabe K, Igarashi T, Ashida H, Ogiwara S, Ohta T, Uchiyama M, Ojiri H: Diagnostic value of ultrasonography and TI-201/Tc-99m dual scintigraphy in differentiating between benign and malignant thyroid nodules. Endocrine 2018.

  25. Ji GW, Zhu FP, Zhang YD, Liu XS, Wu FY, Wang K, Xia YX, Zhang YD, Jiang WJ, Li XC, et al. A radiomics approach to predict lymph node metastasis and clinical outcome of intrahepatic cholangiocarcinoma. Eur Radiol. 2019;29(7):3725–35.

    Article  Google Scholar 

  26. Liu C, Ding J, Spuhler K, Gao Y, Serrano Sosa M, Moriarty M, Hussain S, He X, Liang C, Huang C. Preoperative prediction of sentinel lymph node metastasis in breast cancer by radiomic signatures from dynamic contrast-enhanced MRI. J Magn Reson Imaging. 2019;49(1):131–40.

    Article  Google Scholar 

  27. Wu S, Zheng J, Li Y, Yu H, Shi S, Xie W, Liu H, Su Y, Huang J, Lin T. A radiomics nomogram for the preoperative prediction of lymph node metastasis in bladder cancer. Clin Cancer Res. 2017;23(22):6904–11.

    Article  CAS  Google Scholar 

  28. Suh CH, Baek JH, Choi YJ, Lee JH. Performance of CT in the preoperative diagnosis of cervical lymph node metastasis in patients with papillary thyroid cancer: a systematic review and meta-analysis. Am J Neuroradiol. 2017;38(1):154–61.

    Article  CAS  Google Scholar 

  29. Abbasian Ardakani A, Reiazi R, Mohammadi A. A clinical decision support system using ultrasound textures and radiologic features to distinguish metastasis from tumor-free cervical lymph nodes in patients with papillary thyroid carcinoma. J Ultrasound Med. 2018;37(11):2527–35.

    Article  Google Scholar 

  30. Lee JH, Baek JH, Kim JH, Shim WH, Chung SR, Choi YJ, Lee JH. Deep learning-based computer-aided diagnosis system for localization and diagnosis of metastatic lymph nodes on ultrasound: a pilot study. Thyroid. 2018;28(10):1332–8.

    Article  Google Scholar 

  31. Lee JH, Ha EJ, Kim JH. Application of deep learning to the diagnosis of cervical lymph node metastasis from thyroid cancer with CT. Eur Radiol. 2019;29(10):5452–7.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by funding from the Guangxi Scientific Research and Technology Development Plan (1598011-4). The funders had no role in the study design, data collection and analysis, decision to publish or preparation of the paper.

Author information

Authors and Affiliations

Authors

Contributions

LF, PDH, CJQ and YH contributed to the data curation, analysis, investigation and writing of the manuscript. HY, WYQ, PJB and YH performed and analysed the ultrasound examinations of the patients. LF, LJH and WY performed the operation of the patients. CJQ and YH also reviewed, edited the writing and validated the whole analysis process. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Hong Yang or Junqiang Chen.

Ethics declarations

Ethics approval and consent to participate

This research was performed in accordance with Declaration of Helsinki and was approved by the Ethics Committee of the First Affiliated Hospital of Guangxi Medical University (No. 2015(KY-E-018)). Written informed consent for publication was obtained from the patients and/or their legal guardians for publication. The patients’ clinical and imaging information are the patient’s private data, which are protected by Chinese laws. Therefore, the data and materials cannot be uploaded and shared with the public.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, F., Pan, D., He, Y. et al. Using ultrasound features and radiomics analysis to predict lymph node metastasis in patients with thyroid cancer. BMC Surg 20, 315 (2020). https://doi.org/10.1186/s12893-020-00974-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12893-020-00974-7

Keywords