The Influence of Different Knowledge-Driven Methods on Landslide Susceptibility Mapping: A Case Study in the Changbai Mountain Area, Northeast China

Landslides are one of the most frequent geomorphic hazards, and they often result in the loss of property and human life in the Changbai Mountain area (CMA), Northeast China. The objective of this study was to produce and compare landslide susceptibility maps for the CMA using an information content model (ICM) with three knowledge-driven methods (the artificial hierarchy process with the ICM (AHP-ICM), the entropy weight method with the ICM (EWM-ICM), and the rough set with the ICM (RS-ICM)) and to explore the influence of different knowledge-driven methods for a series of parameters on the accuracy of landslide susceptibility mapping (LSM). In this research, the landslide inventory data (145 landslides) were randomly divided into a training dataset: 70% (81 landslides) were used for training the models and 30% (35 landslides) were used for validation. In addition, 13 layers of landslide conditioning factors, namely, altitude, slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, normalized difference vegetation index (NDVI), topographic wetness index (TWI), plan curvature, and profile curvature, were taken as independent, causal predictors. Landslide susceptibility maps were developed using the ICM, RS-ICM, AHP-ICM, and EWM-ICM, in which weights were assigned to every conditioning factor. The resultant susceptibility was validated using the area under the ROC curve (AUC) method. The success accuracies of the landslide susceptibility maps produced by the ICM, RS-ICM, AHP-ICM, and EWM-ICM methods were 0.931, 0.939, 0.912, and 0.883, respectively, with prediction accuracy rates of 0.926, 0.927, 0.917, and 0.878 for the ICM, RS-ICM, AHP-ICM, and EWM-ICM, respectively. Hence, it can be concluded that the four models used in this study gave close results, with the RS-ICM exhibiting the best performance in landslide susceptibility mapping.


Introduction
Landslides are one of the most frequent geomorphic hazards, and they have considerable economic and ecological consequences [1][2][3]. To mitigate these social and economic losses, it is valuable and essential to assess the landslide susceptibility in a region. Therefore, in recent years, the assessment of landslide susceptibility, which refers to the likelihood of a landslide occurring in an area on the basis of the local terrain and environmental conditions, has become a topic of major interest [4,5]. Landslide susceptibility mapping (LSM) is considered in the decision-making process

Data Collection
Extensive field investigations and observations were identified and mapped in the CMA to produce a detailed and reliable landslide inventory map. In all, 116 landslides were identified and mapped in the study area by aerial photos supported by field investigation from 2012 to 2015. The landslides in the study area are characterized by two modes: slump-tensile rupture and creep-tensile rupture, both of them eventually leading to landslide instability. Of these landslides, 70% (81 landslides) were randomly selected for model training and the remaining 30% (35 landslides) were selected for validation. A series of field investigations were undertaken to identify the relationship between landslide occurrence and environmental factors. Figure 2 illustrates some typical landslides that destroyed railways and roads. The topography is diverse, including valleys, basins, hills, and steep slopes. The overall trend of the terrain is centered on Baiyun Mountain and gradually reduced to the surrounding area, characterized by large height, deep cutting, and steep slopes. The highest point of the CMA is Baiyun Mountain, with an elevation of 2694 m. The lowest point is northwest of the Songhua River, with an elevation of 276 m.
The tectonic pattern of the area is dominated by NSS-and NNS-trending fault zones supplemented by SW-, SN-and NW-trending faults. The main faults include the Shulan-Yitong graben fault, the Dunhua-Mishan graben, and the Tumenjiang fault [57].
Extensive tectonic fragmentation, frequent volcanic activity, steep slopes, a dense drainage and road network, and extensive human activity, including North Korea's nuclear testing and other factors, constitute a study area that is particularly prone to landslide phenomena.

Data Collection
Extensive field investigations and observations were identified and mapped in the CMA to produce a detailed and reliable landslide inventory map. In all, 116 landslides were identified and mapped in the study area by aerial photos supported by field investigation from 2012 to 2015. The landslides in the study area are characterized by two modes: slump-tensile rupture and creep-tensile rupture, both of them eventually leading to landslide instability. Of these landslides, 70% (81 landslides) were randomly selected for model training and the remaining 30% (35 landslides) were selected for validation. A series of field investigations were undertaken to identify the relationship Thirteen layers of landslide conditioning factors, namely, altitude, slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, normalized difference vegetation index (NDVI), topographic wetness index (TWI), plan curvature, and profile curvature, were taken as independent, causal predictors for producing LSM. The selection of 13 predictors was based on the works of previous researchers, collection of data availability and the experience and knowledge about landslide activities in the study area [24,58]. The continuous predictors, such as altitude, slope gradient, slope aspect, distance to faults, distance to roads, distance to rivers, NDVI, TWI, plan curvature, and profile curvature, were classified according to natural break classes and the previous study, and the discrete predictors, including lithology, annual precipitation, and land type, were classified based on the existing classification. The spatial database for the study area is shown in Table 1. The details about the data collection procedure and the preparation of the thematic layers are as follows: The altitude map, slope gradient, slope aspect, plan curvature, and profile curvature were produced using the digital elevation model (DEM) with a grid size of 30 m × 30 m. In the present study area, the altitude ranges from 276 to 2694 m and is reclassified into five categories using  Thirteen layers of landslide conditioning factors, namely, altitude, slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, normalized difference vegetation index (NDVI), topographic wetness index (TWI), plan curvature, and profile curvature, were taken as independent, causal predictors for producing LSM. The selection of 13 predictors was based on the works of previous researchers, collection of data availability and the experience and knowledge about landslide activities in the study area [24,58]. The continuous predictors, such as altitude, slope gradient, slope aspect, distance to faults, distance to roads, distance to rivers, NDVI, TWI, plan curvature, and profile curvature, were classified according to natural break classes and the previous study, and the discrete predictors, including lithology, annual precipitation, and land type, were classified based on the existing classification. The spatial database for the study area is shown in Table 1. The details about the data collection procedure and the preparation of the thematic layers are as follows: The altitude map, slope gradient, slope aspect, plan curvature, and profile curvature were produced using the digital elevation model (DEM) with a grid size of 30 m × 30 m. In the present Lithology, annual precipitation, land type, rivers, faults, and road feature maps were obtained from the China Geology survey. The distance to faults was classified into five classes: 0-500, 500-1000, 1000-1500, 1500-2000, and >2000 m. In the case of distance to rivers, there are five classes with 100 m intervals. For distance to roads, there are six classes: 0-500, 500-1000, 1000-1500, 1500-2000, and >2000 m.
The hydrological factor TWI was calculated using Equation (1). The TWI can be used as an estimate of spatial patterns for soil moisture, since topography controls the hydrological conditions of surface runoff and groundwater flow: where A s is the specific catchment area and β is the slope gradient (in degrees). In the current study, TWI is divided into five classes: <9, 9-11, 11-14, 14-18, and >18. The NDVI is a standardized index for generating an image displaying greenness, and it was prepared using Landsat-7 images based on the following equation: where NIR(band 4) and RED(band 3) are the infrared and red bands of the electromagnetic spectrum, respectively. This index outputs values between −1.0 and 1.0, mostly representing greenness, where any negative values are mainly generated from clouds, water, and snow, and values near zero are mainly generated from rock and bare soil [1]. In this study, the NDVI map was divided into five classes: <0.1, 0.1-0.3, 0.3-0.5, 0.5-0.7, and >0.7.

The Rough Set Model
RS theory was proposed by Pawlak as a mathematical framework for approximate reasoning that considers uncertainty and vagueness in decision-making processes [59,60]. A rough set is used to modify the index weight of factor layers, which can make the distribution more reasonable. The operation steps are as follows: Formally, a quaternion S = (U, A, V, f ) is an information system, where U = {x 1 , x 1 , · · · , x m } is the non-empty finite set of objects called the universe;A is the non-empty finite set of attributes; where V a is the range of attributes; and f : U × A → V is called an information function such that f (x, a) ∈ V a for ∀a ∈ A, ∀x ∈ U, where A = C ∪ D and C ∩ D = Φ; C denotes the condition attribute set; and D is the decision attribute set. The knowledge expression system, with both condition and decision attributes, is a decision table.
The significance of different condition attribute sets for the decision attribute set is different, and some attributes are redundant. Rough set theory, by mining the potential relationship between the condition and the decision attribute sets in the knowledge system, obtains the weight values of Entropy 2019, 21, 372 6 of 24 different condition attributes. In decision-making systems, the importance sig(C i ) of the conditional attribute C i can be calculated as: where γ C (D) reflects the dependency degree of the decision attribute set D on conditional set C, so 0 ≤ sig(C i ) ≤ 1, sig(C i ) = 0 means that D does not depend on C i ; 0 < sig(C i ) < 1 means that D partly depends on C i ; sig(C i ) = 1 means that D totally depends on C i , and the dependency γ C (D) is calculated using Equation (4). If C i is deleted from the conditional attribute set C, the dependency γ C−C i (D) of the decision attribute set D to set C − C i is calculated using Equation (5): where |U| is the number of samples in set U. Then, the index weight vector [α 1 , α 2 , · · · , α i , · · · , α n ] can be obtained using Equation (6)"

The Analytic Hierarchy Process
The analytic hierarchy process (AHP), as a multi-criteria decision analysis method, was proposed by Saaty [61], and have been widely used in LSM [23,24]. The weights can be derived by taking the principal eigenvector of a square reciprocal matrix of pairwise comparisons between the criteria. The pairwise comparison of the 9-point rating scale is shown in Table 2. This approach can be described in four steps as follows [51,62,63]: Table 2. Pair-wise comparison of 9-point rating scale.

Importance Definition
Moderate prevalence of one over another 5 Strong or essential prevalence 7 Very strong or demonstrated prevalence 9 Extremely high prevalence 2, 4, 6, 8 Intermediate values Step 1: Establish the hierarchical tree model for landslide susceptibility mapping; Step 2: Build the judgement matrix based on pairwise comparison; Step 3: Calculate the weights or the level of influence for each element based on the minimum of squares, the logarithmic minimum of squares, the special vector, or approximation methods; Step 4: Check the consistency of the weights, called the consistency ratio (CR). The CR must be equal to or less than 10%; otherwise, the pairwise comparison values have to be recalculated.

The Entropy Weight Method
The entropy method is an objective method for calculating the weight of evaluation predictors based on measured values [19,40,[64][65][66]. The operation steps are as follows: Step 1: Establish matrix X = (x ij ) m×n (i = 1, 2, · · · , m; j = 1, 2, · · · , n) of the original evaluation data according to the evaluation objects and indicators, where m is the number of evaluation objects, and n is the number of evaluation indicators.
For the cost type, the larger the better: For the efficiency type, the smaller the better: The standardization process yields the standard-grade matrix Y = (y ij ) m×n .
Step 3: Calculate the entropy value H i : where Step 4: Calculate the weight of each indicator based on the entropy values:

The Information Content Model
The information content model (ICM), as a statistical analysis method that has been used with good results for landslide susceptibility assessment [67], was introduced by C.E Shannon and derived from information theory. The ICM is used to calculate the effects of various engineering geological environments on landslides. The calculation procedure is as follows: Step 1: Calculate the information content I(X i , H) for each factor X i that influences landslide occurrence: where P(X i , H) is the probability of occurrence of X i in the landslide area and P(X i ) is the probability of occurrence of X i in the study area; where N is the number of landslides in the study area, S is the total number of pixels in the study area, N i is the number of pixels for factor X i in the landslide area, and S i is the number of pixels for factor X i in the study area.
Step 2: Calculate the total information content for each factor X i : where I i is the total information content for factor X i and n is the total number of predictors. The greater the value, the more likely the landslide will occur.

The Landslide Susceptibility Assessment
Based on the ICM and combining with AHP, RS, and EWM, the information weight for each factor can be obtained using the following formula: where W i are the weights for landslide conditioning predictors calculated by the AHP, RS, and EWM, and I iw is the comprehensive index of the landslide sensitivity.

Performance Evaluation
To assess the performance and measure the spatial consistency of the four models, the Cohen's kappa index, a different measure of the reliability of a classification model, was used [68][69][70]. The Cohen's kappa index is obtained as: where P c = In our case, a k value close to 0 means that the agreement is no better than chance, whereas a k value close to 1 indicates a perfect agreement.

LSM using the ICM
The information content (IC) for causative predictors was calculated with Equations (11), (12), and (13), and the results are listed in Table 3. The final thirteen-factor landslide susceptibility map obtained by the ICM is shown in Figure 3.

LSM using the ICM
The information content (IC) for causative predictors was calculated with Equations (11), (12), and (13), and the results are listed in Table 3. The final thirteen-factor landslide susceptibility map obtained by the ICM is shown in Figure 3.  It is clear that the landslide occurrence increases with the slope gradient. The slope gradient class >45 • has the highest IC value, and the lowest IC value is −0.76 for slope class 0-8 • .
In the case of slope aspect, the IC value is positive from south to east, with the maximum value (0.89) at southeast-facing slopes followed by south-facing (0.36) slopes.
In terms of altitude, the IC values indicate they are positive for the ranges of 276-715 and 1507-2694, with the highest value for altitudes between 276-715 m.
For the lithology groups, Hard rock class is associated with a higher IC value, whereas the Extra-hard rock determines a lower IC value.
The plan and profile curvature IC values are negative only for the range of −0.5-0.5 and at −0.24 and −0.46, respectively. The concave (>0.5) and convex (<−0.5) slopes are positive for landslide susceptibility in the study area.
As for land types, Cultivation and River are more susceptible to landslides.
The relation between TWI landslide probabilities showed that >18 has the highest value of IC, and class 0.5-0.7 has the lowest NDVI value.
In terms of distance to faults, the highest and lowest IC values are located in the intervals of 1000-1500 m and >2000 m, respectively.
In the case of distance to roads, the interval <500 m has the highest IC value, which means that the landslide susceptibility is higher in this area.
The river incision can cause instability of slopes by changing groundwater level and toe erosion. Generally, with the increase of the distance to rivers the IC values decrease, and the IC value is positive only for the class >400 m.
In the case of annual precipitation, the landslides are mainly distributed within 700-800 mm and >1000 mm, and their IC values are all 0.33.
The final ICM method landslide susceptibility map is shown in Figure 4.

LSM Using the RS-ICM Method
The following predictors were selected as indices for LSM: slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, NDVI, TWI, plan curvature, and profile curvature. The 13 causative predictors were classified into grades 1, 2, 3, 4, 5, 6, 7, 8, and 9 according to landslide density as shown in Table 4. In ArcGIS software (version 10.2, Esri Co. Ltd., California, CA, USA), the value of all evaluation factor layers is extracted into landslides, and the results are used as condition attributes. We generated landslide density maps ( Figure 5) based on the landslide distribution. The landslides were divided into six levels, 1, 2, 3, 4, 5, and 6, using natural break classification according to the landslide density, and the results were used as decision attributes. The initial decision table, with 85 rows and 8 columns, was established by defining the density of landslides as the decision attribute set. The weights of 13 predictors were calculated using the rough set method, as shown in Table 5. The final landslide RS-ICM susceptibility map is shown in Figure 6. The following predictors were selected as indices for LSM: slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, NDVI, TWI, plan curvature, and profile curvature. The 13 causative predictors were classified into grades 1, 2, 3, 4, 5, 6, 7, 8, and 9 according to landslide density as shown in Table 4. In ArcGIS software (version 10.2, Esri Co. Ltd., California, CA, USA), the value of all evaluation factor layers is extracted into landslides, and the results are used as condition attributes. We generated landslide density maps ( Figure 5) based on the landslide distribution. The landslides were divided into six levels, 1, 2, 3, 4, 5, and 6, using natural break classification according to the landslide density, and the results were used as decision attributes. The initial decision table, with 85 rows and 8 columns, was established by defining the density of landslides as the decision attribute set. The weights of 13 predictors were calculated using the rough set method, as shown in Table 5. The final landslide RS-ICM susceptibility map is shown in Figure 6.

LSM Using the AHP-ICM Method
In the study area, the 13 layers of landslide conditioning predictors were compared with each other to determine their relative importance using the analytic hierarchy process (AHP) mentioned above. The judgement matrix for these evaluation predictors is shown in Table 6. The CR = 0.0183, which is <0.1, indicates that the calculated weights are reasonable. The final landslide susceptibility map of the AHP-ICM method is shown in Figure 7.

LSM Using the EWM-ICM Method
The weights of causative predictors based on EWM were calculated according to the principles of entropy weighted theory and are listed in Table 7. At first, the IC values were multiplied by the weights in Table 4 and all the weighted factor maps were then aggregated. Finally, the maps were reclassified to produce the EWM-ICM-generated LSM (Figure 8).

Validation
To determine the statistical reliability of the results, it is essential to perform validation of the four models. To perform this validation, the ROC curve was constructed, and the area under the ROC curve (AUC) was used for the quantitative comparison of the four models.
The comparison results are shown in Figure 9. The success rate (Figure 9a) comes from the training dataset (70%, 81 landslides), and the prediction rate (Figure 9b) comes from the validation dataset (30%, 35 landslides). As shown in Figure 9, the ICM, RS-ICM, AHP-ICM, and EWM-ICM success rates were 0.931, 0.939, 0.912, and 0.883, and their prediction accuracy rates were 0.926, 0.927, 0.917, and 0.878, respectively. The Cohen's kappa indexes were 0.721, 0.743, 0.720, and 0.663 for the ICM, RS-ICM, AHP-ICM, and EWM-ICM. It indicates a substantial agreement between the observed and the predicted values for all four models.
The susceptibility maps were classified as low, moderate, high, and very high based on a natural break approach. Table 8 displays the total area and ratios of low, moderate, high and very high susceptibility for the four models. The ICM, RS-ICM, and AHP-ICM methods with better LSM performance in the CMA have approximately the same result in area ratio of different landslide susceptibility classes, and they have relatively large differences compared to EWM-ICM.  6. Discussion

Spatial Consistency of the Four Models
The Cohen's kappa indexes were calculated to measure the spatial consistency of the four models. The results of their spatial consistency are shown in Table 9, which indicates a substantial agreement between the ICM and AHP-ICM, and a moderate agreement between the RS-ICM and AHP-ICM and between the ICM and RS-ICM. For the RS-ICM and EWM-ICM, the Cohen's kappa index was estimated to be equal to 0.140, characterizing with slight agreement. It should be noted that the Cohen's kappa indexes between EWM-ICM, which has the lowest performance for LSM in the CMA, and the other three models are very small, which indicates that they have relatively large differences in spatial consistency compared to EWM-ICM, and the ICM, RS-ICM, and AHP-ICM methods yield similar results. Table 9. Cohen's kappa index between two models.

Predisposing Factors Analysis of Information
The ICM is a simple and effective tool in landslide susceptibility assessment, and the information values represent the contribution ratio of different predictor classes to landslide occurrence.
With the increase of slope gradient, the landslides increase. The reason for this is that the slope gradient not only affects the stress distribution inside the slope masses but also affects weathering layer depth and slope surface runoff [58]. However, the landslides are mainly concentrated in the altitude range of 276-715, which is due to the fact that the catchment areas are mainly concentrated in this range.
It should be noted that landslides primarily developed within the hard rock lithology group rather than soft rock. The hard rock group is mainly composed of basalt and trachyte, which are prone to rock fall, and the landslides in the study area are characterized by two modes: slump-tensile rupture and creep-tensile rupture, which are related to the development of rock fall. The landslides develop in the weak layer of the high-steep slope of the hard rock lithology group. Once the rock fall occurs at the front edge of the slope, the trailing edge will break through the weak layer along the weak edge and gradually form a connecting slip surface, forming a stepped rock fall-landslide, with conditions that are consistent with the occurrence conditions of landslide disasters.
In the case of distance to faults, distance to roads, and distance to rivers, there was a decreasing tendency with the increase in distance. The reasons for this phenomenon can be summed up as follows: (a) With strong weathering and a well-developed rock structure plane in a fault zone, it provides favorable conditions for a landslide occurrence; (b) Roads increase stress and strain on the back of the slope, resulting in slope disturbance and failure; (c) The strength of degree of surface incision is directly related to the development of drainages. The closer to the rivers, the more severe erosion, and the more landslides.
For slope aspect, the slope aspects in the south direction (south, southeast, and southwest) were more prone to landslides. The reason for this is that these direction slopes are exposed to more sunlight or affected by the orientation of discontinuities controlling the landslides, which is the same as the conclusion proposed by Du [58].
Annual precipitation is one of the major initiating factors of landslides [71]. It is accepted that with the increase of rainfall, the probability of landslide occurrence increases, but the results show that the IC values in the intervals of 800-900 and 900-1000 are negative, mainly because the two intervals are distributed in the Extra-hard rock group that is not prone to landslides.
It is generally accepted that Land type plays a crucial role in the landslide distribution [36]. The landslides are primarily developed with Cultivation and Residential in the study area, which are the most dramatic locations of human activity.

Comparative Analysis of Three Knowledge-Driven Methods
The ICM, an objective evaluation method commonly applied for statistical analysis, is suitable for the evaluation of LSM [24]. Four landslide susceptibility maps were produced based on the ICM with three knowledge-driven methods to mitigate the social and economic losses induced by landslides in the CMA. In the comprehensive evaluation process, the key issue is to determine the weight of each predictor, which reflects the relative importance of each evaluation indicator. It should be noted that the LSM is completely dependent on the value of the weight when the evaluation object and evaluation indicators are determined. Hence, the reasonable choice of the weighting method directly affects the rationality and credibility of the landslide-prone partition evaluation results. In this study, three knowledge-driven methods, including subjective evaluation and objective evaluation, were used to produce landslide susceptibility maps. The RS theory is an effective tool in dealing with vagueness and uncertainty information. Peng et al. [60] mentioned that the RS theory is an attribute reduction tool to identify the significant environmental parameters of a landslide. Liu et al. [72] used RS theory to clarify the relationship between landslide and environmental factors in the Qinggan River of the Three Gorges area. The AHP is an expert-based evaluation method that is often applied in landslide susceptibility assessment and mapping [63]. However, it should be noted that the AHP has been criticized for its inability to adequately handle the ambiguity and imprecision associated with the conversion of linguistic labels attached to the ratio scale, to crisp numbers used in the comparison matrix [73]. The EWM is an objective weighting method, which determines the criteria weights by solving mathematical models without any consideration of the decision maker's preferences. However, it is sometimes contrary to the actual situation, and it is difficult to give a clear explanation for the obtained results. According to the results in the success accuracy section, the RS-ICM (AUC = 0.939) had the best effect for LSM in the CMA, and the ICM (AUC = 0.931) with AHP-ICM (AUC = 0.912) performed better than EWM-ICM (AUC = 0.883).

Importance of Predictors
The weight assignment of landslide conditioning predictors is the basis of LSM. This paper focuses on the influence of different knowledge-driven methods for a series of parameters on the accuracy of LSM. Figure 10 displays the weights of the RS, AHP, and EWM methods. According to the results, lithology (0.1585), land type (0.1829), and plan curvature (0.1220) had the highest weights using RS. Slope gradient (0.1386), lithology (0.1832), and land type (0.1221) had the highest weights by AHP, and slope gradient (0.3) and distance to roads (0.25) had the highest weights using EWM. The results show that lithology and land type are crucial predictors for LSM in the CMA for RS-ICM (AUC = 0.939) and AHP-ICM (0.912), which have better performance than EWM-ICM (0.878). However, Chen et al. [52] found that slope gradient, altitude, and rainfall had the highest importance in landslide occurrence. Kawabata and Bandibas [74] mentioned that geology is the most important factor. Meinhardt, et al. [75] reported that slope gradient, lithology, and precipitation increase have higher importance in landslide occurrence. Pham, et al. [76] mentioned that distance to roads, slope gradient, elevation, and rainfall have higher importance on landslide occurrence, which is consistent with the results of Youssef et al. [77]. It can be found that slope gradient, lithology, distance to roads, and land type are the four most important predictors affecting the susceptibility of landslides in the CMA. The weight assignment of landslide conditioning predictors is the basis of LSM. This paper focuses on the influence of different knowledge-driven methods for a series of parameters on the accuracy of LSM. Figure 10 displays the weights of the RS, AHP, and EWM methods. According to the results, lithology (0.1585), land type (0.1829), and plan curvature (0.1220) had the highest weights using RS. Slope gradient (0.1386), lithology (0.1832), and land type (0.1221) had the highest weights by AHP, and slope gradient (0.3) and distance to roads (0.25) had the highest weights using EWM. The results show that lithology and land type are crucial predictors for LSM in the CMA for RS-ICM (AUC = 0.939) and AHP-ICM (0.912), which have better performance than EWM-ICM (0.878).
However, Chen et al. [52] found that slope gradient, altitude, and rainfall had the highest importance in landslide occurrence. Kawabata and Bandibas [74] mentioned that geology is the most important factor. Meinhardt, et al. [75] reported that slope gradient, lithology, and precipitation increase have higher importance in landslide occurrence. Pham, et al. [76] mentioned that distance to roads, slope gradient, elevation, and rainfall have higher importance on landslide occurrence, which is consistent with the results of Youssef et al. [77]. It can be found that slope gradient, lithology, distance to roads, and land type are the four most important predictors affecting the susceptibility of landslides in the CMA.

Conclusions
Landslides are one of the most frequent geomorphic hazards that often result in loss of property and human life in the CMA. In this research, 13 layers of landslide conditioning predictors, namely, altitude, slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, NDVI, TWI, plan curvature, and profile curvature, were taken as independent, causal predictors, and three knowledge-driven methods, that is, RS, AHP, and EWM, were applied to produce CMA landslide susceptibility maps and their performance was compared.

Conclusions
Landslides are one of the most frequent geomorphic hazards that often result in loss of property and human life in the CMA. In this research, 13 layers of landslide conditioning predictors, namely, altitude, slope gradient, slope aspect, lithology, distance to faults, distance to roads, distance to rivers, annual precipitation, land type, NDVI, TWI, plan curvature, and profile curvature, were taken as independent, causal predictors, and three knowledge-driven methods, that is, RS, AHP, and EWM, were applied to produce CMA landslide susceptibility maps and their performance was compared.
The influence of different knowledge-driven methods for a series of parameters on the accuracy of LSM was explored. The results demonstrate that the four models are good at predicting landslide susceptibility, and the RS-ICM had the best effect for LSM in the CMA; the next best were ICM and AHP-ICM, as their accuracies were slightly higher than that of EWM-ICM. In addition, the importance of different predictors in landslide occurrence was investigated. It was concluded that lithology and land type are crucial predictors for LSM in the CMA.
The four landslide susceptibility maps illustrated that the high-susceptibility areas were mainly composed of three parts: the region with a radius of 13,000 m around the Tianchi volcanic cone and mountain area in southwest Changbaishan Tianchi, the hard rock group area, and the surrounding area of roads. The outcome of this research is useful for general planned development activities and disaster management in the future and for engineers to reduce losses caused by existing and future landslides using prevention, mitigation, and avoidance.