https://orcid.org/0000-0001-9795-692X
Figures
Abstract
Breast cancer is the most common invasive cancer and the second leading cause of cancer death in women. and regrettably, this rate is increasing every year. One of the aspects of all cancers, including breast cancer, is the recurrence of the disease, which causes painful consequences to the patients. Moreover, the practical application of data mining in the field of breast cancer can help to provide some necessary information and knowledge required by physicians for accurate prediction of breast cancer recurrence and better decision-making. The main objective of this study is to compare different data mining algorithms to select the most accurate model for predicting breast cancer recurrence. This study is cross-sectional and data gathering of this research performed from June 2018 to June 2019 from the official statistics of Ministry of Health and Medical Education and the Iran Cancer Research Center for patients with breast cancer who had been followed for a minimum of 5 years from February 2014 to April 2019, including 5471 independent records. After initial pre-processing in dataset and variables, seven new and conventional data mining algorithms have been applied that each one represents one kind of data mining approach. Results show that the C5.0 algorithm possibly could be a helpful tool for the prediction of breast cancer recurrence at the stage of distant recurrence and nonrecurrence, especially in the first to third years. also, LN involvement rate, Her2 value, Tumor size, free or closed tumor margin were found to be the most important features in our dataset to predict breast cancer recurrence.
Citation: Mosayebi A, Mojaradi B, Bonyadi Naeini A, Khodadad Hosseini SH (2020) Modeling and comparing data mining algorithms for prediction of recurrence of breast cancer. PLoS ONE 15(10): e0237658. https://doi.org/10.1371/journal.pone.0237658
Editor: Bryan C. Daniels, Arizona State University & Santa Fe Institute, UNITED STATES
Received: March 24, 2020; Accepted: July 30, 2020; Published: October 15, 2020
Copyright: © 2020 Mosayebi et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Cancer refers to any one of a large number (over 100 diverse diseases) of diseases characterized by the development of abnormal cells that divide uncontrollably due to genetic mutation in DNA and can infiltrate and destroy normal body tissue. What is similar among all is the deficiency in the regulating mechanisms of the cells' natural growth, proliferation, and death. The cancerous cells can invade the tissues nearby and spread to other parts of the body eventually and is the second-leading cause of death in the world [1, 2].
Breast cancer is the most common cancer among women all over the world, and it is increasing 2 percent annually [1, 3–5]. Although the average age of breast cancer is 40–50 years, it has also occurred in 25-year-olds, and the age of onset is declining annually. Concerning the high incidence and prevalence of the disease, and also its high treatment cost, and disease occurrence among young women who are socially and economically generative, this disease can be one of the most remediable diseases if an early diagnosis takes place [6–8]. So, the significance of the prediction and treatment of cancer is more obvious than before [9–11]. The disease occurs when people are exposed to carcinogen materials by inhaling, eating, drinking, and exposing at the workplace and environment. Cancer is a multifactorial disease and beside genetic factors, personal lifestyle, smoking, and diet play impressive effects in the etiology of cancer. There is always a balance among the amount of proliferation, the cell senescence, and the differentiation in a healthy organism, this balance is lost during cancer formation [12–14].
On the other hand, 207 million new cases of breast cancer are likely to be diagnosed in 2030, among which 60% cases are diagnosed in under-developed countries [4, 14, 15]. Moreover, the number of cancer incidence is increasing in these countries.
Breast cancer is one of the most common diseases among Iranian women. Oncological studies show that the prevalence of breast cancer among Iranian women is increasing, and the age of onset of this disease is decreasing with more disease intensity [8, 16]. On the other hand, different factors influence the deterioration of the disease and its overall survival. Because it is complicated to control the causes of breast cancer, early diagnosis along with a suitable treatment is an important strategy for prognosis improvement [11, 17].
In Iran, due to the population growth, the increase of life expectancy, the relative increase of old population, the annual increase of cancer and the acceleration of change among influential factors in the escalation of cancer prevalence such as the prevalence and the development of the cancer risk factors, the rate of cancer development is predicted to rise and it will be doubled during the next two decades [8, 16]. Therefore, this disease and programs to control are of utmost importance. International studies suggest that about 30% of women will develop recurrence after the primary treatment for breast cancer, figures for the early-stage disease being lower [18, 19].
Also, it is the most common malignancy among Iranian women and the focus of attention. In recent years, the prevalence of the disease has been increasing, and data suggest that the survival rate of patients up to five years and ten years after diagnosis was 88% and 80%, respectively. In reality, not all tumors are cancerous, but they may be benign or malignant [6, 13, 20, 21].
Routine follow-up protocols currently are based on two hypotheses: (i) that most recurrences are diagnosed at an earlier stage through follow up; and (ii) that the previous treatment of recurrences offers a better chance of cure, more prolonged survival, or improvement in the quality of life. However, current data suggest that neither of these hypotheses is correct and that postoperative follow up of patients with breast cancer is costly and time-consuming and does not significantly extend survival [18, 22, 23].
Despite considerable effort to detect recurrent disease early, the evidence suggests that only a minority of recurrences are detected at an asymptomatic stage [5, 24–26].
It has also been found that most patients with recurrence have signs or symptoms as the first indicator of recurrence and that history and physical examination generally provide the first clues to recurrence [27, 28].
Furthermore, most recurrences present at unscheduled appointments and not as a consequence of routine follow up ones [29]. Predicting breast cancer recurrence is one of the most popular measures taken for developing data mining approaches.
Physicians make decisions on clinical scenarios (about diagnosis, investigation, and management) every day of their working lives, based on the balance of probabilities [30].
Although randomized trials of intensive surveillance testing such as more frequent clinical examinations, biannual chest x-rays, and bone scans have shown no mortality benefit, there has been a continued rise in financial cost and resource utilization devoted to developing more effective follow-up strategies to detect early recurrences. It's necessary to the application of a multidisciplinary approach to help physicians to make better decisions in the detection of breast cancer recurrent [31].
Data mining methods may help reduce the number of false positives and false-negative results in physicians' decision-making [12, 32]. Accordingly, new approaches, such as knowledge discovery in databases (KDD), including data mining algorithms, have become increasingly popular and a desirable research tool for medical science researchers. Using them, researchers can identify patterns and relationships among a large number of variables, and using the data available in databases has made it feasible to predict the results of a disease [33].
Many studies have been carried out about difficulties in predicting the survival of patients through using statistical methods and artificial neural networks; nevertheless, only a few studies have been conducted in the field of cancer recurrence using data mining methods. Hence, this study compares the prediction of breast cancer recurrence in Iran using data mining methods and suggests a reasonable model for help to predict between several proposed models. According to the importance of the subject, the main purpose of the present study is to assist clinicians and decision-makers in the field of breast cancer for prediction of recurrence using seven data mining algorithms. Therefore, first, the used dataset is introduced. Next, all algorithms and their findings are presented separately. the results of the algorithms are compared to provide recommendations to physicians and decision-makers. And finally, the best features based on data mining algorithms extracted.
Materials and methods
This study is cross-sectional and data gathering of this research performed from June 2018 to June 2019 from the official statistics of Ministry of Health and Medical Education and the Iran Cancer Research Center for patients with breast cancer who had been followed for a minimum of 5 years from February 2014 to April 2019, including 5471 independent records. for limitation in our dataset (we had only 16 complete information about patients that their relapse occurred after 10 years), we have analyzed only patients with shorter than 5 years.
(early stages of N +, N0, T2, T1) is eligible for inclusion in this study. All patients are confirmed with a pathologic type of ductal carcinoma (Infiltrating ductal carcinoma). Patients presenting with distant metastases (stage IV) and T4 (tumors of any size directly invading the chest wall or skin) at the time of presentation are patients with other histopathologic findings of breast cancer, patients with information in their records. It is incomplete, and Patients who had not undergone lymph node surgery (NX) are excluded.
Also, required data are collected from patients' records, including the status of ER, PR, HER-2 receptors, patient age, tumor size, lymph node involvement status, tumor grade, etc. The condition of the receptors is evaluated by immunohistochemistry.
In the present study, at the first step, the chi-square test is used to evaluate the relation of each of the features on the recurrence of breast cancer, and P <0.05 is considered significant. Also, to develop predictive models and predict breast cancer recurrence, Multilayer Perceptron artificial neural network, Bayesian Neural Network, LVQ neural network, KPCA-SVM, Random Forest, and C5.0 are employed using the above-mentioned database.
Data mining methods
The process of extraction of the unknown, correct, and potentially useful data is called data mining. The data mining methods can be considered as unsupervised and supervised learning. In this study, seven different types of neural networks are exploited for the recurrence of breast cancer prediction. the number of inputs to the network is 17 key variables extracted from 23 variables, which is shown in Table 1. Fig 1 represents the algorithm used in the current study. According to the depicted algorithm, first, the data are grouped into test and train data; the results are compared and finally, the best features are selected.
The accuracy of the model is the percentage of the number of times the test samples are successfully categorized. If the model accuracy is acceptable, the model can be used to classify data whose categories are not specified. In this research, we use a nested 5-fold cross-validation approach to train (four folds) and test (one fold) the models. Patients meeting the inclusion criteria are randomly assigned to one of the five outer folds. To ensure that the important feature set is generated from real patients with breast cancer and the importance of the features is not emphasized by duplicating minor cases, we choose the under-sampling approach to build the model. We randomly select 20 sets of controls in each round of cross-validation, matching the number of cases, and generated 80 training datasets by using one set of controls and all cases. In each training step, we use 5-fold inner cross-validation to tune the models. this method is used but for preventing of exceeding machine learning analysis. Also, to assess the performance of disease classification methods, a confusion matrix used. This matrix is for the accuracy of the obtained model is calculated. The following formula applies to calculate efficiency, sensitivity, and specificity. The results show the numerical values obtained from the calculations performed by the software and its final analysis. Models performance is evaluated according to the following criteria:
- Feature. Probability of correctly predicting non-recurrence by true negative algorithms divided by false-positive + true negative.
- TP. The number of samples that are correctly identified as positive
- TN. The number of samples that are correctly diagnosed as negative.
- FP. The number of samples that incorrectly detected positive
- FN. The number of samples that incorrectly detected negative
- Confusion matrix. The relationship between the actual classes and the predicted classes is called the confusion matrix.
Sensitivity.
The probability of correctly predicting recurrence by true positive algorithms divided by false-negative + true positive.
Specificity. Measures a test’s ability to correctly generate a negative result for people who don’t have the condition that’s being tested for (also known as the “true negative” rate).
ROC.
The method based on the receiver operating characteristic curve [9, 34, 35] is used to evaluate the performance of different discriminant models. The area under the ROC curve (AUC) can objectively reflect the overall performance of different algorithms.
F-score.
In the statistical analysis of binary classification, the F1 score (also F-score or F-measure) is a measure of a test's accuracy. It considers both the precision) p and the recall) r of the test to compute the score: p is the number of correct positive results divided by the number of all positive results returned by the classifier. R is the number of accurate positive results divided by the number of all relevant samples (all samples that should have been specified as positive). The F1 score is the harmonic mean of the precision and recall, where an F1 reaches its best value at 1 (perfect precision and recall) and its worst at 0.
Ethics statement
All data were fully anonymized before we accessed them and the Ministry of Health and Medical Education and the Iran Cancer Research Center are informed consent. All the private information of patients is eliminated from our dataset and only clinical and required data is used and presented.
Results
In the present study, seven data mining algorithms based on the accuracy, Sensitivity, Specificity, F-measure, area under the ROC curve of the models, etc. are compared. The final goal is to achieve a model with the highest performance. So, insufficient and defective data is identified and eliminated from the database. Concerning the elimination of variables, variables either overlapped with the results or that among 10337 records available, their information on these variables was eliminated. Working on the documents is began after deleting the variables according to the abovementioned two modes (overlapping with other variables or lacking maximum record information from this variable). For patients with no data or data limited to 2–3 cases, we eliminate the record inevitably. The remaining documents with fewer missing variables are replaced by expectation-maximization.
After the elimination of records with missing values, 5471 records remained. For the best prediction, data mining classification techniques including Multilayer Perceptron artificial neural network, Bayesian Neural Network, LVQ neural network, KPCA-SVM, C5.0, and Random Forest are applied. Additionally, several parameters are randomly selected and investigated.
In this study, breast cancer is classified into four groups based on IHC profile ER/PR and Her2/neu expression, positive (+), and/or negative (−). The groups are:
ER/PR+, Her2+ = ER+/PR+, Her2+; ER−/PR+, Her2+; ER+/PR−, Her2+
ER/PR+, Her2− = ER+/PR+, Her2−; ER−/PR+, Her2−; ER+/PR−, Her2−
ER/PR−, Her2+ = ER−/PR−, Her2+
ER/PR−, Her2− = ER−/PR−, Her2−
The IHC classification correlates well with intrinsic gene expression microarray categorization: ER/PR+, Her2+ with Luminal B; ER/PR+, Her2− with Luminal A; ER/PR−, Her2+, and ER/PR−, Her2− with triple-negative/basal-like tumors. Apart from lending itself to subtype analyses of tumors when fresh tissue is not available, the IHC classification has prognostic and therapeutic implications, is inexpensive and readily available.
According to [11, 26] studies, and available data of Ministry of Health and Medical Education and the Iran Cancer Research Center's, patients classified in four segments: Local Recurrence, Regional recurrence, Distant recurrence, Local and Distant recurrence, Reginal and Distant recurrence and No recurrence. The number of patients in each category is 607, 82, 1975, 339, and 65.
The demographic and clinical characteristics of the units under study are shown in Table 2 and Table 3. The mean and standard deviation of the age is 46.86 ± 10.397 years, and the age group, 41–50 years with 42.8%, had the highest frequency. The mean tumor diameter is 3.63 ± 1.86 cm. The rate of demographic and clinical factors in the studied patients is depicted in Table 2.
Some characteristic of patients are presented in Table 4 and Table 5. The median local recurrence time of patients is 16 months and the median metastasis time is 22 months. The most common sites of bone metastases (46.6%) are with a preference for the spine, especially the lumbar vertebrae. The median survival time from illness was 36 months. The overall treatment rate of the disease in the fifth year is 45%. This rate is 85% in the first stage of the disease and 5% in the fourth stage.
Variables relating to the recurrence of breast cancer based on various studies as well as interviews with specialists in the field of breast cancer are obtained as Table 1. also, the relationship of each factor with the recurrence of breast cancer in our dataset is evaluated by using Chi-Squared test. factors with a p-value of less than 0.05 are considered as the most relating factors.
Based on this Table, the most relating factors include Tumor size, LN involvement rate, the result of biopsy of pathology, type of surgery, free or closed tumor margin, Chemotherapy, Radiotherapy, and Hormone therapy.
By refining the results and discarding the treatment and diagnosis methods, 3 factors of Tumor size, LN involvement rate, and free or closed tumor margin are considered as the most important factors affecting the recurrence of breast cancer in our dataset.
Then, to the prediction of breast cancer recurrence, by discarding 6 factors and of Chemotherapy, Type of chemotherapy, Radiotherapy, Hormone therapy, and Result of biopsy of pathology, other features are considered as the inputs of machine learning algorithms.
Modeling using multilayer perceptron neural network
In the first step, a multilayer perceptron (MLP) neural network is used, which is one of the purest and most potent structures for modeling.
The output layer function is defined by (1), in which o and h represent the hidden layer and output layer, respectively, and w is the weights of the layers.
In this equation, sgm is a sigmoid function defined as:
(2)
The first modeling method is a multilayer perceptron neural network with backpropagation error algorithm for training, which is used for classification (recurrence and non-recurrence of breast cancer), and all of the eight risk factors are fed to the network. Also, different network architectures are evaluated to acquire the best classification performance. Table 6 shows some of the best structures of the multilayer perceptron neural network, and the confusion matrix related to the best architecture (among almost 100 different architectures).
Modeling using learning vector quantization
Learning Vector Quantization (LVQ) neural network consists of a competitive layer and a linear layer. The competitive layer learns to classify the input vectors, and the linear layer maps the competitive classes on the target category, which is determined by the user.
In this study, 10 LVQ neural networks, with different architectures, are used to find the optimum network architecture for disease Recurrence. Table 7 shows the performance of the various neural networks over the changes in the number of neurons in the competitive layer.
Modeling using Bayesian network
The Bayesian network is a decision-making system and has a strong ability to model the cause and effect relationship. Note that it is not necessary a Bayesian neural network that has precise information and a complete history of an event, and it can reach a convincing estimate of the current or future condition of a system even with incomplete and not precise information. Therefore, in this paper, the Bayesian neural network is exploited as the third method for disease classification. The distribution of the weights is defined by (3).
Where and
are the weights of the first and second layers, respectively, i, j, and k are the indexes of input, hidden layer, and output, respectively, and
is the bias for the jth hidden unit. M is the number of hidden units; d is the number of input units. The function fouter(.) is linear, and finner(.) is a hyperbolic tangent function. In the Bayesian method, Eq (3) used weight distribution, and the network weights are computed by (5).
Where p(w) is the probability distribution function in the weight space without data, which is a primary function. P(W|D) is the probability function of weights that is a probability distribution function observed after the train of the data. P(D|W) and P(D) is the probability distribution function and the second probability distribution function, respectively.
Different structures are tested to find the best number of neurons in the competitive layer. Some of them are shown in Table 8. According to the table, the first four architectures have two hidden layers. Increasing the number of hidden layers from two to three (the last two rows of the table) does not have a significant effect on error performance (only 0.3% improvement).
Modeling using KPCA- SVM
To further improve the discrimination accuracy, combining kernel principal component analysis and support vector machine (KPCA-SVM) is proposed in this study. After preprocessing, the dataset is analyzed with the model of KPCA-SVM. The results show that the model can achieve excellent results.
For KPCA, by introducing the kernel function, the original dataset can be mapped into a high-dimensional space [60–62]. Record the original spatial dimension as Rn, the number of samples is m, and the dimension is n, then the total sample is X = [x1,x2,…,xm], xi = [xi1,xi2,…,xim], i = 1,2,…,m. Defining has a high-dimensional Hilbert space, all the samples are mapped from the original space to the high-dimensional space, which is expressed as:
(6)
The kernel function is defined as
(7)
Which needs to satisfy the Mercer condition
(8)
After nonlinear mapping, the corresponding covariance matrix is
(9)
Denote the eigenvalues and eigenvectors as λ and V, respectively
(10)
Where V is the subspace generated by {Φ(x1),Φ(xi),…,Φ(xm)}.
Then there exists α = {α1α2…αm} making
(11)
The following transformation is made for Eq (10), when K = 1,2,…,m
(12)
Mixing Eqs (9), (11) and (12), we get
(13)
When we substitute Eqs (8) and (9) into Eq (15), yield
(15)
Thereby the eigenvalues and eigenvectors of the K matrix can be obtained.
Modeling using support vector machines
Support Vector Machines (SVM) has unique advantages and has been widely used in the field of pattern recognition, especially in dealing with classification problems.
For the two-category problem, set the given training sample set as {(x1,y1),(x2,y2)…,(xn,yn)},
Which yiϵ{+1, −1}(i = 1,2,…,n) is the category the sample belongs to Construct a cost function that satisfies the constraint as
(16)
Where ξ is the introduced slack variable to measure the misclassification degree of the model, C is the penalty constant, which should be selected appropriately, ω and b are the weight vector and threshold of the classification function, respectively. Lagrangian function is
(17)
Where αi and βi are Lagrangian operators. According to Karush-Kuhn-Tucher conditions, we have
(18)
(19)
Where αi > 0 is a support vector. The discriminant function is
(20)
where K is the selected kernel function.
Fig 2 shows the workflow of the Raman spectral discrimination model of KPCA-SVM.
Modeling using random forest
Random forest is a combination of learning trees that each tree in the forest is built from a random vector called Q. The Qk vector describes the method of constructing the kth tree. For example, it may specify whether some features are randomly used in the construction of each tree, or whether the training data set is randomly selected. Each tree constructed with h (x, Qk) is represented. This vector is given to all trees to classify the input x,h (x, Qk), k = 1,…, k, and is the final class of which with the most trees to vote on.
Suppose h1 (x),…, hk (x) are some classifiers. Suppose Y is the output vector of the training data, and X is a random vector drawn from the training data. Now the boundary function of this set of classifiers is defined as follows:
(21)
Formula 22 Calculates the Class Boundary Function
Where I (-) is the marker function. This relation shows that if the data X is given as an input to the k cluster, it is the number of classifications performed by the k cluster correctly, more or less than the other classifications performed.
If mg (X, Y)> 0, the set of classifiers will be correctly sorted. If mg (X X, Y) <0, then the classification is incorrect.
The generalization error is defined as follows:
(22)
In the random forest i.e. h (x x, ((Q_k)) k = 1,…, k it is shown in [57] study that when a random forest grows and k tends to infinity:
(23)
Formula 24 Classification General Error When k→∞
It indicates that the generalization error tends to be above the limit. Therefore, it does not over-fit the data.
Modeling using decision tree C5.0
A Decision tree is a powerful method among classification algorithms whose popularity is increasing with the growth of data mining. Decision trees classify samples by sorting them in the tree from the root node to the leaf node. The specimens are grouped in such a way that they grow from the root downwards and eventually reach the leaf nodes. Each inner or non-leaf node is specified with a property. This feature raises a question about the input example. There are many possible answers to this question in each internal node as it's specified by its value. The leaves of this tree are characterized by a class or a bunch of answers. The reason for naming it with the decision tree is that it represents the decision-making process for classifying an input instance. The decision tree is used to solve problems that can be presented in a single answer in the name of a class or category. It is also appropriate for problems where the training examples are specified in pairs (value-specificity). The target function has output with discrete values. For example, each sample should be marked with a yes or no or require a seasonal descriptor. The decision tree consists of several algorithms such as C5.0, C4.5, ID3, and classification that used the C5.0 method in this research. The decision tree is used to approximate discrete functions.
It is resistant to input noise. It is useful for high volume data hence in data mining. The tree can be represented as an if-then rule that is understandable for use. It allows the combination of (AND) and seasonal (OR) hypotheses. It is also applicable when tutorials lack all the features.
Feature importance analysis
We evaluate the importance of features by two methods. First, as shown in Table 1, variables relating the recurrence of breast cancer extracted with chi-square and after refining the results and discarding the treatment and diagnosis methods, 3 factors of Tumor size, LN involvement rate and free or closed tumor margin were considered as the most important factors affecting the recurrence of breast cancer in our dataset.
Second, in data mining algorithms we apply forward feature selection method to validate most influencing factors that affect the recurrence of breast cancer. Forward selection is an iterative method in which we start with having no feature in the model. In each iteration, we keep adding the feature which best improves our model till an addition of a new variable does not improve the performance of the model.
Performance metrics
The performance of the Seven Methods is evaluated by accuracy, sensitivity, specificity, AUC, PPV, NPV (Table 9). Also, a graphical comparison of the efficiency measures is shown in Fig 3.
As seen in Table 9 and Fig 3, almost all the methods except MLP, Bayesian, and LVQ generate relatively high Sensitivity (more than 70%). Also, the highest Accuracy in our experiments is obtained with C5.0 and KPCA-SVM. Thus, the C5.0 and KPCA-SVM approach appears to perform better than the other five data mining methods. The results indicate that all of the seven methods exceptions for MLP, Bayesian, and LVQ can predict the recurrence of breast cancer, and it is realized that despite adding the new methods to the model, the C5.0 and KPCA-SVM is the best approximation method.
According to the confusion matrix, the final number of patients with recurrence of breast cancer, as well as the patients with no recurrence of the disease, in comparison with the predictions made by different algorithms, is presented in Table 10.
Because the occurrence of errors in classes and forecasting models is inevitable, so the errors in the system should be recognized and investigated. In this study, the confusion matrix has been used to address this important issue. This matrix was generated for all classification models. However, only four confusion matrix for high-precision classifiers are shown below:
Based on the Table 11, the prediction accuracy in each of the following is as follows: The results of Table 12 show that the predictive accuracy of distant recurrence (0.87) and nonrecurrent (0.88) are the most. Also, considering that distant recurrence is in step 7 of the TNM rating, it can be concluded that in this stage, the present research model provides better help to prediction rather than other data mining algorithms.
There is also a general increase in the probability of disease-free survival in the first to fifth years after initial treatment in patients with breast cancer.
According to the results of Table 13, in the first to third years, the further we go in the third year, the more accurate the probability of the disease-free survival becomes, but after the third year, this rate decreases. Therefore, it can be stated that the model presented in this study has higher accuracy in the first three years.
Important features for breast cancer metastasis prediction
Table 14 represents the results of applying the Forward Selection algorithm on the Ministry of Health and Medical Education and the Iran Cancer Research Center dataset. The most important features affecting the diagnosis of breast cancer recurrence were then identified.
Since the LN involvement rate is the most accurate one in the recurrence of breast cancer detection, the rest of the features are eliminated, the LN involvement rate is selected, and the remaining features are added to it, and the accuracy of the models is measured. In the next step, the set of two features with the highest accuracy are selected and the remaining features are added to them and the accuracy of the model is measured. Then the set of three features with the highest accuracy are selected and the remaining features are added to them and the accuracy of the model is measured.
In the next step, the set of four features with the highest accuracy are selected and the remaining features are added to them and the accuracy of the model is measured. As observed in Table 14, since the accuracy has not increased in all models by adding new features to the set of four features obtained in the previous step, the tests are not continued and it is recognized that in the C5.0 with four properties of {LN involvement rate, Her2 value, Tumor size, free or closed tumor margin} can better help rather than other data mining algorithms to the prediction of breast cancer recurrence on the Ministry of Health and Medical Education and the Iran Cancer Research Center dataset may be made.
As observed in the results of Table 14, in addition to identifying the most important features, the same or better performance was achieved with fewer features than all other features. In machine learning methods, achieving similar or better results using fewer features is important.
The results are consistent with that showed in Table 14, about three factors, and the machine learning method considers a Her2 value factor as an important factor, In addition to those factors, for better accuracy. Therefore, it is recommended that all four factors be considered for better prediction of breast cancer recurrence.
Conclusion and discussion
Numerous tests for breast cancer often increase the stress on the patient and his family, reducing control over the disease and impairing her quality of life. Therefore, the data mining algorithm possibly could be a helpful tool for physicians to help with early diagnosis and prevention of recurrence of cancer before engaging in the surgical process of treating the disease as well as incurring high costs for the patient. Of course, these methods are not definitive in medicine, but they can be helpful. So, the main aim of this study is to help the prediction of the recurrence of breast cancer disease using some data mining algorithms mainly based on neural networks. disease forecasting tools and mechanisms along with physicians' experience, can play a helpful role in the correct diagnosis and treatment choice be it and also a matter of increasing confidence in the accurate diagnosis of the disease both the physician and the patient favorably increased. On the other hand, how the diagnosis will determine the next steps for the patient. So, if it is of low accuracy, it affects one's survival and it is vital to have excellent and acceptable accuracy of forecasting models.
A model that evaluated by examining different criteria, accuracy, and sensitivity is the best, and the higher the forecast, the more reliable it will be.
The current incidence of breast cancer is high and early detection of primary tumors and the strict use of adjuvant therapy not only result in more prolonged survival but also lengthen the disease-free interval. Thus, increasing the number of patients requiring follow-up.
So, help in predicting the recurrence of breast cancer is essential for many reasons. For instance, in the case of patients who have only one tumor or one the breasts entirely removed, if the likelihood of recurrence of breast cancer is high, it can be predicted before the spread of cancer did uniquely to other parts of the body. Predictive models can be helpful and beneficial in this regard. But It should be noted that in the field of evaluation of medical prediction models, at least two features of the model and sensitivity of the model has to be considered because Considering one of them alone can be misleading.
Besides, special attention should be paid to the value of false-negative. It is essential because the patient is mistakenly considered healthy and it can have hazardous consequences.
for limitation in our dataset (we had only 16 complete information about patients that their relapse occurred after 10 years), we have analyzed only patients with shorter than 5 years.
Artificial neural networks are modern disease diagnosis methods that have excited the attention of researchers in recent years. Therefore, seven new and conventional data mining algorithms neural networks: MLP, LVQ, Bayesian Neural Network, KPCA-SVM, C5.0, and Random forest have been used. This study clearly shows the effect of neural networks technology in the recurrence of breast cancer classification. Artificial neural networks can be used as a diagnostic method with high sensitivity and specificity to detect prediction of recurrence of breast cancer tumors, besides other non-invasive diagnostic methods (such as mammography and radiography). The importance of this result is that maybe it can help to prevent patients, who do not need any invasive diagnostic methods (sampling and surgery), from such operations. In addition to the decrease in the costs, faster and more precise diagnostic of prediction of recurrence of breast cancer may increase the treatment chance.
Results show that the C5.0 and the KPCA-SVM have shown better performance in terms of accuracy, true negative, Sensitivity, Specificity, Geometric mean of sensitivity and specificity, PPV, NPV, Geometric mean of PPV and NPV, F-measure, Area under ROC curve in comparison to other methods.
Except for MLP, Bayesian, and LVQ, in terms of area under the ROC curve, the performance of methods is appropriate (more than 0.7). In terms of accuracy, the C5.0 and KPCA-SVM outperformed all other methods; however, other methods Except MLP, Bayesian, and LVQ, also achieved high efficiency (more than 0.70).
Sensitivity ranged from a minimum of 0.509 (MLP) to a maximum of 0.869 (C5.0). Considering that having Recurrence of Breast Cancer is the critical prediction in this biomedical application, a method with higher sensitivity is desired; therefore, methods such as MLP are inappropriate for prediction of Recurrence of Breast Cancer. However, C5.0 showed the best sensitivity result.
Given the nature of the present data and generally, in the field of breast health and cancer research, among the reasons for choosing the decision tree method for prediction, it can be mentioned for breast cancer recurrence data behavior, the decision tree is capable of working with continuous and discrete data (Other methods can only work with one type). Unnecessary comparisons are eliminated in this structure, different properties are used for different samples, no estimation of the distribution function is needed data preparation for a decision tree is unnecessary or straightforward (other methods often require data normalization or deletion of empty values or the creation of null variables). Decision tree structures are dominant for analyzing big data in a short time, finding unexpected or unknown relationships, also this method can adapt to inadequate data. In conclusion, we may be able to facilitate the prediction of breast cancer recurrence by designing suitable machine learning algorithms. In the current study, we found the C5.0 algorithm possibly, could be a helpful tool for predicting by physicians and health care policymakers in breast cancer recurrence prediction at the stage of distant recurrence and nonrecurrence, especially in the first to third years. And also, LN involvement rate, Her2 value, Tumor size, free or closed tumor margin were found to be the most important features in our dataset. This may results in more sustainable health for the patients and, consequently, a lower psychological, social, and economic burden on society.
References
- 1. Jurisevic M., et al., The organic ester O,O'-diethyl-(S,S)-ethylenediamine-N,N'-di-2-(3-cyclohexyl)propanoate dihydrochloride attenuates murine breast cancer growth and metastasis. Oncotarget, 2018. 9(46): p. 28195–28212. pmid:29963272
- 2. Uen Y., et al., Mining of potential microRNAs with clinical correlation—regulation of syndecan-1 expression by miR-122-5p altered mobility of breast cancer cells and possible correlation with liver injury. Oncotarget, 2018. 9(46): p. 28165–28175. pmid:29963269
- 3. Tong C.W.S., et al., Recent Advances in the Treatment of Breast Cancer. Front Oncol, 2018. 8: p. 227. pmid:29963498
- 4. Yang Y. and Hendrix C.C., Cancer-Related Cognitive Impairment in Breast Cancer Patients: Influences of Psychological Variables. Asia Pac J Oncol Nurs, 2018. 5(3): p. 296–306.
- 5. Yi M. and Hwang E., Pain and Menopause Symptoms of Breast Cancer Patients with Adjuvant Hormonal Therapy in Korea: Secondary Analysis. Asia Pac J Oncol Nurs, 2018. 5(3): p. 262–269. pmid:29963588
- 6. Gao S., et al., miR-202 acts as a potential tumor suppressor in breast cancer. Oncol Lett, 2018. 16(1): p. 1155–1162. pmid:29963190
- 7. Mishra R., et al., Activating HER3 mutations in breast cancer. Oncotarget, 2018. 9(45): p. 27773–27788. pmid:29963236
- 8. Nejati-Azar A. and Alivand M.R., miRNA 196a2(rs11614913) & 146a(rs2910164) polymorphisms & breast cancer risk for women in an Iranian population. Per Med, 2018. 15(4): p. 279–289. pmid:29965793
- 9. Fernandes A.W., Wu B., and Turner R.M., Brain metastases in non-small cell lung cancer patients on epidermal growth factor receptor tyrosine kinase inhibitors: symptom and economic burden. J Med Econ, 2017. 20(11): p. 1136–1147. pmid:28758857
- 10. Petrou P., A systematic review of economic evaluations of tyrosine kinase inhibitors of vascular endothelial growth factor receptors, mammalian target of rapamycin inhibitors and programmed death-1 inhibitors in metastatic renal cell cancer. Expert Rev Pharmacoecon Outcomes Res, 2018. 18(3): p. 255–265. pmid:29448845
- 11. Rautenberg T., et al., Economic outcomes of sequences which include monoclonal antibodies against vascular endothelial growth factor and/or epidermal growth factor receptor for the treatment of unresectable metastatic colorectal cancer. J Med Econ, 2014. 17(2): p. 99–110. pmid:24215550
- 12. Brett E.A., et al., Breast cancer recurrence after reconstruction: know thine enemy. Oncotarget, 2018. 9(45): p. 27895–27906. pmid:29963246
- 13. Fu M.R., et al., Machine learning for detection of lymphedema among breast cancer survivors. Mhealth, 2018. 4: p. 17. pmid:29963562
- 14. Maañón J., et al., High serum vascular endothelial growth factor C predicts better relapse-free survival in early clinically node-negative breast cancer. Oncotarget, 2018. 9(46): p. 28131–28140. pmid:29963266
- 15. Leone J.P., et al., Treatment Patterns and Survival of Elderly Patients With Breast Cancer Brain Metastases. Am J Clin Oncol, 2019. 42(1): p. 60–66. pmid:29965807
- 16. Yazdani A., et al., Investigation of Prognostic Factors of Survival in Breast Cancer Using a Frailty Model: A Multicenter Study. Breast Cancer (Auckl), 2019. 13: p. 1178223419879112.
- 17. Kondo M., et al., Economic evaluation of the 70-gene prognosis-signature (MammaPrint®) in hormone receptor-positive, lymph node-negative, human epidermal growth factor receptor type 2-negative early stage breast cancer in Japan. Breast Cancer Res Treat, 2012. 133(2): p. 759–68. pmid:22315134
- 18. Rosner D. and Lane W.W., Predicting recurrence in axillary-node negative breast cancer patients. Breast Cancer Res Treat, 1993. 25(2): p. 127–39. pmid:8347845
- 19. Wapnir I.L., et al., Prognosis after ipsilateral breast tumor recurrence and locoregional recurrences in five National Surgical Adjuvant Breast and Bowel Project node-positive adjuvant breast cancer trials. J Clin Oncol, 2006. 24(13): p. 2028–37. pmid:16648502
- 20. Dieci M.V., et al., Patterns of Fertility Preservation and Pregnancy Outcome After Breast Cancer at a Large Comprehensive Cancer Center. J Womens Health (Larchmt), 2019. 28(4): p. 544–550.
- 21. Xiao Y., et al., Integrin α5 down-regulation by miR-205 suppresses triple negative breast cancer stemness and metastasis by inhibiting the Src/Vav2/Rac1 pathway. Cancer Lett, 2018. 433: p. 199–209. pmid:29964204
- 22. Muss H.B., McNamara M.J., and Connelly R.A., Follow-up after stage II breast cancer: a comparative study of relapsed versus nonrelapsed patients. Am J Clin Oncol, 1988. 11(4): p. 451–5. pmid:3407624
- 23. Schapira D.V., Breast cancer surveillance—a cost-effective strategy. Breast Cancer Res Treat, 1993. 25(2): p. 107–11. pmid:8347842
- 24. Chen Z., et al., Differential expression and function of CAIX and CAXII in breast cancer: A comparison between tumorgraft models and cells. PLoS One, 2018. 13(7): p. e0199476. pmid:29965974
- 25. Pourzand A., et al., Erratum: Associations between Dietary Allium Vegetables and Risk of Breast Cancer: A Hospital-Based Matched Case-Control Study. J Breast Cancer, 2018. 21(2): p. 231. pmid:29963121
- 26. Zapater-Moros A., et al., Probabilistic graphical models relate immune status with response to neoadjuvant chemotherapy in breast cancer. Oncotarget, 2018. 9(45): p. 27586–27594. pmid:29963222
- 27. Bray F., et al., Global cancer transitions according to the Human Development Index (2008–2030): a population-based study. Lancet Oncol, 2012. 13(8): p. 790–801. pmid:22658655
- 28. Loong S., et al., The effectiveness of the routine clinic visit in the follow-up of breast cancer patients: analysis of a defined patient cohort. Clin Oncol (R Coll Radiol), 1998. 10(2): p. 103–6.
- 29. Churn M. and Kelly V., Outpatient Follow-up After Treatment for Early Breast Cancer: Updated Results After 5 Years. Clinical Oncology, 2001. 13(3): p. 187–194. pmid:11527293
- 30. Vaughn A.E., et al., Using a social marketing approach to develop Healthy Me, Healthy We: a nutrition and physical activity intervention in early care and education. Transl Behav Med, 2019. 9(4): p. 669–681. pmid:30107586
- 31. Schneble E.J., et al., Future directions for the early detection of recurrent breast cancer. J Cancer, 2014. 5(4): p. 291–300. pmid:24790657
- 32. Hastings G. and Saren M., The Critical Contribution of Social Marketing: Theory and Application. Marketing Theory, 2003. 3(3): p. 305–322.
- 33. Karabatak M. and Ince M.C., An expert system for detection of breast cancer based on association rules and neural network. Expert Systems with Applications, 2009. 36(2, Part 2): p. 3465–3469.
- 34. Komoike Y., et al., Ipsilateral breast tumor recurrence (IBTR) after breast-conserving treatment for early breast cancer: risk factors and impact on distant metastases. Cancer, 2006. 106(1): p. 35–41. pmid:16333848
- 35. Li D., et al., Interactions of Family History of Breast Cancer with Radiotherapy in Relation to the Risk of Breast Cancer Recurrence. J Breast Cancer, 2017. 20(4): p. 333–339. pmid:29285037
- 36. Menarche, menopause, and breast cancer risk: individual participant meta-analysis, including 118 964 women with breast cancer from 117 epidemiological studies. The Lancet Oncology, 2012. 13(11): p. 1141–1151. pmid:23084519
- 37. Bai Y., et al., Raman spectroscopy-based biomarker screening by studying the fingerprint characteristics of chronic lymphocytic leukemia and diffuse large B-cell lymphoma. Journal of Pharmaceutical and Biomedical Analysis, 2020. 190: p. 113514. pmid:32827998
- 38. Yu W., Kim J.K., and Park T., Estimation of Area Under the ROC Curve under nonignorable verification bias. Stat Sin, 2018. 28(4): p. 2149–2166. pmid:31367164
- 39. La Vecchia C., et al., Original article: The role of age at menarche and at menopause on breast cancer risk: Combined evidence from four case-control studies. Annals of Oncology, 1992. 3(8): p. 625–629. pmid:1450044
- 40. Effects of radiotherapy and of differences in the extent of surgery for early breast cancer on local recurrence and 15-year survival: an overview of the randomised trials. The Lancet, 2005. 366(9503): p. 2087–2106.
- 41. Wittkowski K.M., et al., Complex polymorphisms in endocytosis genes suggest alpha-cyclodextrin as a treatment for breast cancer. PLoS One, 2018. 13(7): p. e0199012. pmid:29965997
- 42. de Pedro M., Otero B., and Martín B., Fertility preservation and breast cancer: a review. Ecancermedicalscience, 2015. 9: p. 503. pmid:25729416
- 43. Lopresti M., Rizack T., and Dizon D.S., Sexuality, fertility and pregnancy following breast cancer treatment. Gland Surg, 2018. 7(4): p. 404–410. pmid:30175056
- 44. Zhou W., et al., Risk of breast cancer and family history of other cancers in first-degree relatives in Chinese women: a case control study. BMC Cancer, 2014. 14: p. 662. pmid:25212775
- 45. Lafourcade A., et al., Factors associated with breast cancer recurrences or mortality and dynamic prediction of death using history of cancer recurrences: the French E3N cohort. BMC Cancer, 2018. 18(1): p. 171. pmid:29426294
- 46. Neri A., et al., Breast cancer local recurrence: risk factors and prognostic relevance of early time to recurrence. World J Surg, 2007. 31(1): p. 36–45. pmid:17180474
- 47. Mauguen A., et al., Dynamic prediction of risk of death using history of cancer recurrences in joint frailty models. Stat Med, 2013. 32(30): p. 5366–80. pmid:24030899
- 48. Voogd A.C., et al., Differences in risk factors for local and distant recurrence after breast-conserving therapy or mastectomy for stage I and II breast cancer: pooled results of two large European randomized trials. J Clin Oncol, 2001. 19(6): p. 1688–97. pmid:11250998
- 49. Vinh-Hung V. and Verschraegen C., Breast-conserving surgery with or without radiotherapy: pooled-analysis for risks of ipsilateral breast tumor recurrence and mortality. J Natl Cancer Inst, 2004. 96(2): p. 115–21. pmid:14734701
- 50. Soerjomataram I., et al., An overview of prognostic factors for long-term survivors of breast cancer. Breast Cancer Res Treat, 2008. 107(3): p. 309–30. pmid:17377838
- 51. Yu Y., et al., Label-free detection of nasopharyngeal and liver cancer using surface-enhanced Raman spectroscopy and partial lease squares combined with support vector machine. Biomed Opt Express, 2018. 9(12): p. 6053–6066. pmid:31065412
- 52. Candelaria R.P., et al., Analysis of stereotactic biopsies performed on suspicious calcifications identified within 24 months after completion of breast conserving surgery and radiation therapy for early breast cancer: Can biopsy be obviated? The American Journal of Surgery, 2018. 215(4): p. 693–698. pmid:28712671
- 53. Svensson S., et al., CCL2 and CCL5 Are Novel Therapeutic Targets for Estrogen-Dependent Breast Cancer. Clin Cancer Res, 2015. 21(16): p. 3794–805. pmid:25901081
- 54. Lega F., Developing a marketing function in public healthcare systems: a framework for action. Health Policy, 2006. 78(2–3): p. 340–52. pmid:16360236
- 55. Martin-Castillo B., et al., Basal/HER2 breast carcinomas: integrating molecular taxonomy with cancer stem cell dynamics to predict primary resistance to trastuzumab (Herceptin). Cell Cycle, 2013. 12(2): p. 225–45. pmid:23255137
- 56. Lei J., et al., Assessment of variation in immunosuppressive pathway genes reveals TGFBR2 to be associated with prognosis of estrogen receptor-negative breast cancer after chemotherapy. Breast Cancer Res, 2015. 17(1): p. 18.
- 57. Coles C.E., et al., Partial-breast radiotherapy after breast conservation surgery for patients with early breast cancer (UK IMPORT LOW trial): 5-year results from a multicentre, randomised, controlled, phase 3, non-inferiority trial. The Lancet, 2017. 390(10099): p. 1048–1060.
- 58. Eccles S.A., et al., Critical research gaps and translational priorities for the successful prevention and treatment of breast cancer. Breast Cancer Res, 2013. 15(5): p. R92. pmid:24286369
- 59. te Boekhorst D.S., et al., Periodic follow-up after breast cancer and the effect on survival. Eur J Surg, 2001. 167(7): p. 490–6. pmid:11560382
- 60. Kim I., et al., Erratum: Development of a Nomogram to Predict N2 or N3 Stage in T1-2 Invasive Breast Cancer Patients with No Palpable Lymphadenopathy. J Breast Cancer, 2018. 21(2): p. 232. pmid:29963122
- 61. Pautenberg T., et al., Economic outcomes of sequences which include monoclonal antibodies against vascular endothelial growth factor and/or epidermal growth factor receptor for the treatment of unresectable metastatic colorectal cancer. J Med Econ, 2014. 17(2): p. 99–110. pmid:24215550
- 62. Zapater-Moros A., et al., Probabilistic graphical models relate immune status with response to neoadjuvant chemotherapy in breast cancer. Oncotarget, 2018. 9(45): p. 27586–27594. pmid:29963222