Abstract

In an open environment, the demands of users are diverse and dynamic because users can participate in product design from beginning to end. Owing to this, the disorderly and unplanned participation of users will greatly increase the complexity of multi-attribute decision-making (MADM) in the product design process. In order to ensure the smooth development of the open design process, the decision support model and method need to repeatedly provide decision makers (DMs) with necessary decision support information in a relatively short period of time, which can realize the evaluation of the scheme and improve the utilization efficiency of community resources. However, the process of eliciting preference information is complex, exhausting, inefficient, and time-consuming in existing methods, which will result in a poor decision-making. With the purpose of optimizing the eliciting process in MADM, a rule-based decision support method is proposed in this paper, where the process of eliciting preference information and decision-making are synchronized and guided by pre-extracted decision rules. The rules are deduced from comparison relations on attributes and their outcomes through the combination of variable precision rough set approach (VPRS) and stochastic multi-objective acceptability analysis (SMAA). With the concept of attribute reduction and approximation accuracy in rough set theory, the extracted rules could eliminate redundant attributes and assign the relative priority of preference information. Based on the extracted rules, the multi-attribute decision-making process could be carried out step by step in an orderly manner. In each step, DMs only need to provide partial preference information by non-quantitative statements according to extracted rules. Once the decision result is reliable enough, the eliciting and decision-making process can be terminated promptly. In order to validate the proposed approach, experiments of decision rule extraction are implemented, and the results show that the proposed approach is effective both in the weak rule extraction and the strong rule extraction.

1. Introduction

Multi-attribute decision-making (MADM), also referred to as multi-objective decision-making, is an important component of modern decision science [1]. It refers to the problem of evaluating and prioritizing a finite set of alternatives based on a collection of attributes. The theory and methods of MADM have been extensively applied to the fields of society, economy, management, military, engineering design, and so on. Generally, the process of solving MADM problems can be divided into two steps. One step is to collect decision information, thus determining attribute values and weights. The other step is to synthesize the collected decision information through a proper aggregation operator (e.g., the simple averaging operator and the ordered weighted averaging operator). The ranking of alternatives can be obtained according to their synthesized values.

The complexity of MADM is mainly due to the difficulty of assessing the relative importance of different attributes. In MADM problems, attributes are assigned different weight values to indicate their relative importance. Depending on the information provided, the methods of determining attribute weights are divided into subjective methods and objective methods [2]. In subjective methods, attribute weights are derived from value judgments about attributes given by decision makers (DMs), including eigenvector-based method [36], weighted averaging or least square method [710], AHP or ANP-based method [11, 12], and D-TOPSIS method [13]. And the objective methods determine attribute weights according to objective information (e.g., the information in the decision matrix), such as principal component analysis method [14], entropy method [15, 16], and multi-objective programming model-based method [17, 18]. Either way, the process of determining attribute weights is not easy. Especially in subjective methods, attribute weights reflect the group preference of DMs. Therefore, the first thing to address is to collect and aggregate DMs’ preference information through proper means. In the study of most subjective methods, the process of eliciting preference information highly depends on frequent and deep involvement of DMs. For example, the Delphi method uses multiple rounds of surveys to collect and aggregate preference information through a series of data collection and analysis techniques interspersed with feedback [19]. In each round, DMs (experts) need to do a series of questionnaires focusing on problems, opportunities, solutions, or forecasts until an agreement is reached. In AHP and ANP-based methods, a complete pairwise comparison matrix is the prerequisite. Many research studies point out that it is hard to ensure the consistency of the pairwise comparison matrix, especially when the number of attributes is large [20, 21]. In addition, for various reasons, the comparison relation between attributes could not be given by DMs precisely and completely. Predictably, the process of eliciting preference information based on these methods would be very time-consuming and exhausting when the number of attributes and DMs is large. In order to the uncertainty and fuzziness of MADM, Ning et al. [22] proposed a novel probabilistic dual hesitant fuzzy-enabled MADM technique. Wang et al. [23] proposed a multi-objective particle swarm optimization-enabled approach to optimize park-level integrated energy systems with multi-attribute decision analysis frameworks. Li et al. [24] proposed a data-driven approach to solve the problem of personalized individual semantics under the background of MADM, and the experiment showed that the proposed approach can obtain personalized numerical scales of linguistic terms for a decision maker. In order to solve the problem of the AC transmission systems appropriate placement, Chinda et al. [25] proposed a novel MADM approach combined with a particle mobility honey bee algorithm, which can maximize efficiency of the energy planning. Rahman et al. [26] proposed a MADM approach combined with AND OR operations, which can effectively deal with the uncertainties of possibility neutrosophic hypersoft set. Zhang et al. [27] proposed a bisimulation-based generalized fuzzy variable precision rough set model to solve the problem of the decision-making, which can effectively tackle complicated problems including the attribute and the relational data. Ye et al. [28] proposed a fuzzy rough sets-enabled decision-making approach, which can effectively tackle the uncertainty and imprecision problem in MADM. Jiang et al. [29] proposed a rough sets-enabled risk decision-making approach, which not only consider the decision risk but also offer instructions to select the appropriate semantic explanation. Sarwar [30] proposed a rough D-TOPSIS method to manipulate the subjectiveness and vagueness of MADM, which unites the competency to analyze changeable and ambiguous information without additional assumptions. Fei et al. [31] proposed a rough D-TOPSIS method to solve the problem of the human resources selection, and an effectual method was applied by authors to describe the changeable data and information called D-numbers. Lin et al. [32] proposed a rough ELECTRE-II method to deal with the selection problem of the edge nodes, and an entropy measure is devised to measure the uncertainty degree. Akram et al. [33] proposed a rough ELECTRE-II method with the specific structure, through which the diverse opinions of decision experts can be well handled. Kuncova et al. [34] proposed a fuzzy rough PROMETHEE method which can evaluate the order of 14 regions of the Czech Republic in regard to economic indices. Liu et al. [35] proposed a fuzzy rough PROMETHEE method to accomplish the process for optimal alternative selection.

However, existing methods prefer to solve MADM problems through a “top-down” way, in which organizers collect preference information based on the essential characteristics of the problem. For example, in plant location selection (PLS) problem, alternatives are usually evaluated based on environmental index, economic index, social index, and geological index [36, 37]. However, in some cases, alternatives may be similar in some attributes. The relative importance of such attributes, which are called redundant attributes, have no effect on the final ranking result. The existing method cannot eliminate redundant attributes from the perspective of the attribute value. Therefore, it is necessary to clarify which attribute should be involved and which weight should be given priority.

In order to fill in the above research gaps, a rule-based decision support method for MADM (R-MADM) is proposed in this paper to help optimize the process of eliciting preference information in MADM. The contribution and motivation of this paper is summarized as follows:(1)In R-MADM, the process of eliciting preference information and the process of decision-making are synchronized and guided by pre-extracted decision rules. In contrast to existing methods, R-MADM is a “bottom-up” method. The MADM problem could be solved through two stages based on the proposed method, namely, decision rule extraction and decision rule application.(2)In the first stage, outcomes (ranking results) corresponding to different comparison relations are obtained using stochastic multi-objective acceptability analysis (SMAA). Decision rules are then extracted based on SMAA analysis results through the variable precision rough set (VPRS) approach.(3)In the second stage, according to the decision rules, the preference eliciting process and the decision-making process could be carried out step by step. DMs only need to provide partial preference information according to extracted rules in each step. Based on the SMAA analysis result, the measurement of the reliability of decision-making is given. Once the decision result is reliable enough, the process of eliciting preference information and the process of decision-making can be terminated. Therefore, the efficiency of MADM can be improved.

The remainder of this paper is organized as follows. Relevant theoretical foundations about VPRS and SMAA are introduced in Section 2. In Section 3, the proposed R-MADM method is illustrated in detail. A numerical example is used to illustrate the implementation of the proposed method in Section 4. Section 5 provides a conclusion and discusses the limitations of the proposed method as well as research directions for in-depth studies in the future.

2. Theoretical Foundations

2.1. Rough Set Theory

Rough set theory (RST) proposed by Pawlak provides a useful tool for extracting knowledge (decision rules) from inexact, uncertain, or vague information. RST has been widely used in the area of machine learning [38], knowledge management [39], expert system [40], decision support system [41], pattern recognition [42], yield prediction [43], and so on. The basic idea of RST is using available information to perform complete approximation (classification) of the given objects without any preliminary assumptions. In RST, the approximation of an object is related to its attribute information, and an information system is often expressed as a quadruple aswhere is referred to as the universe consisting of a finite set of objects, is a non-empty and finite set of attributes, is the union of attribute domains, i.e., for any , and is an information function which associates every object in with a unique attribute value.

Generally, the information system (IS) in RST is represented in the form of a decision table (knowledge table), in which rows and columns correspond to objects and their attributes, respectively. The attribute set is divided into the condition attribute set and the decision attribute set , i.e., . The value of the decision attribute in is related to the value of the condition attribute in . The objects in can be partitioned into a group of disjoint subsets based on the indiscernibility relation , and it is defined as

Each indiscernibility relation partitions the universe into a family of disjoint subsets called equivalent classes, which is expressed as

Given , can be approximated by its lower approximation and upper approximation . The lower approximation is the union of equivalent classes that belong to the subset with certainty, i.e.,

And the upper approximation is the union of equivalent classes that partly belong to the subset , i.e.,

The pair is called the rough set of with respect to . Based on the lower and upper approximation, the universe could be partitioned into three regions.(1) is referred to as the positive region of with respect to , and it is the lower approximation of , i.e., (2) is referred to as the boundary region of with respect to , and it is the subtraction of the upper approximation and the lower approximation of , i.e., (3) is referred to as the negative region of with respect to , and it is the subtraction of the universe and the upper approximation of , i.e.,

2.1.1. Variable Precision Rough Set Approach

The classical rough set approach only can be used to model fully correct classification problem. This is primarily due to the fact that the classical rough set approach is based on a deterministic approach which deliberately ignores the available probabilistic information in its formalism. The classification with a controlled misclassification error, which is referred to as partial classification, is outside the realm of this approach. This limitation severely reduces the applicability of RST to problems which are more probabilistic than deterministic in nature. To solve this problem, the variable-precision rough set (VPRS) approach is proposed by taking partial classification into account. In VPRS, the standard set inclusion relation used in the classical rough set approach is replaced by the majority inclusion relation. In the majority inclusion relation, the classification error of classifying objects of a set X into another set Y is measured bywhere denotes set cardinality. For a given admissible classification error , the majority inclusion relation in VPRS can be expressed as

It can be observed that the standard set inclusion relation is a special case of the majority inclusion relation when . Based on the majority inclusion relation, Ziarko gives the definitions of -lower and -upper approximations of a set with respect to in VPRS, which are defined as

In VPRS, the -lower approximation of constitutes its -positive region , i.e.,

And the -boundary region is given by

And the -negative region of is the complement of its -upper approximation, i.e.,

2.1.2. Dominance-Based Variable Precision Rough Set Approach

In both the classical rough set approach and VPRS approach, attribute information is assumed to be nominal, which cannot be arranged in any particular order. However, in some real-life applications, the information has obvious ordinal characteristic where better condition attribute values usually bring out better decision attribute values. The dominance-based variable precision rough set (DB-VPRS) approach improves the VPRS approach by replacing the indiscernibility relation with dominance relation, thus taking the preference-orders into consideration [44]. The dominance relation with respect to attribute is represented as , which is also denoted by , and means that dominates (is better than) in terms of attribute . For the benefit index, means that the attribute value of is greater than the attribute value of with respect to attribute , i.e.,

And for the cost index, means that the attribute value of is smaller than the attribute value of with respect to attribute , i.e.,

Based on the dominance relation, the dominance set of is defined by

And the dominated set of is defined by

Let , be decision classes. Each decision class is defined as , where is the decision attribute value. It is assumed that the total order of decision attribute values is ; and then, the order relation of decision classes can be written as . The upward and downward union of decision classes are defined aswhere if then ; and if then .

For a given confidence level in DB-VPRS, the lower and upper approximation of and are defined as

In DB-VPRS, the positive region of with respect to is defined b.

Similarly, the positive region of with respect to is defined as

Based on its duality characteristic, the negative regions of and are defined by

The boundary regions of and can be obtained by

2.1.3. Attribute Reduction and Decision Rule Extraction in VPRS

Attribute reduction for the analysis of important attributes and decision rule extraction for the approximation of the decision attribute by means of the condition attribute are major topics in RST.(1)Attribute dependency and approximation quality.For a given information system , let , , , , and the equivalent classes and are assumed to be known. Then, for a given confidence level , the dependency of on is measured byIf , the partition is completely dependent on ; If 0 , is partly dependent on ; If , is completely independent on .(2)Relative importance of attribute.According to the definition given by (28), the relative importance of an attribute can be measured byThe bigger the is, the more important is the attribute. If , the attribute is regarded as a redundant attribute.(3)-attribute reduct.For a given confidence level , an -attribute reduct is the minimal subset of condition attributes in preserving the dependency level with the decision attribute , satisfies the following two criteria.(a);(b)No attributes can be further eliminated from without affecting the requirement (a).There are usually more than one rough set reduct The common part of available rough set reduct is called the core of rough set, i.e.,(4)Decision rule extraction.

The approximation relation between condition attributes in and the decision attribute could be translated into a decision rule in the form of

2.2. Stochastic Multi-Objective Acceptability Analysis

Stochastic multi-objective acceptability analysis (SMAA) is a multi-criteria decision support technique for decision-making problems with uncertainty [45, 46]. In SMAA, inaccurate or uncertain input data are represented in the form of probability distribution. It is usually assumed that all feasible combinations of criteria weights and criteria measurements are equally likely to be selected. In SMAA, alternatives are evaluated according to statistically descriptive measurements which are calculated by inverse analysis of uncertainty space.

It is supposed that a set of alternatives with attributes are under evaluation. The value of attribute for alterative is represented by . The weight of attribute is represented by . The function in (32) is usually used to calculate the utility value of an alternative, and it is expressed by a convex combination of the attribute weight vector and the attribute value vector in feasible weight space . Here, attribute values are mapped into the range by a partial utility function .

If attribute weights are available, a multi-attribute decision-making problem can be addressed by calculating utility values and choosing the alternative with the largest overall utility. However, for various reasons, it is often difficult to obtain precise measurements for some attributes. Thus, in SMAA, is replaced with a stochastic variable . The joint probability density functions for attribute values and attribute weights are represented by and , respectively. When attribute weights and values are uncertain, utility value distributions of alternatives can be obtained by computing all possible combinations of uncertain parameters, and it is usually realized through Monte Carlo simulation technique in SMAA.

The core idea of SMAA is to classify alternatives to those which should be taken into consideration and to those which should be eliminated. The standard SMAA method only considers the information about the alternative with the first rank lacking holistic evaluation on all alternatives. SMAA-2 extends the discussion on all ranking results and gives several descriptive measures: rank acceptability index and three best rank-type measures.

2.2.1. Rank Acceptability Index

In SMAA-2, the ranking result for alternative could be calculated bywhere , , and . For a given order , its favorable ranking weights is defined by

Ranking acceptability index describes the share of combinations of uncertain parameter which could make alternative be ranked th. It is computed as a multidimensional integral over criteria measurements and favorable weight space as

Rank acceptability index ranges from zero to one. Alternatives with zero-value ranking acceptability index are never ranked at the certain order, and alternatives with one-value ranking acceptability index could obtain the certain rank with any feasible weights combinations.

2.2.2. K-Best Rank Indices

K-best rank indices in SMAA-2 include k-best rank (k-br) acceptability , k-br central weight vector , and k-br confidence factor , which are defined as

K-best rank indices extended the meaning of the descriptive measures in standard SMAA method by taking more alternatives into consideration. The k-br acceptability is used as a performance indicator of the alternatives ranked in top k. It can help aggregate some alternatives with a good performance into a small group and to eliminate others. The k-br weight vector describes preference information of the k-best alternatives. And the k-br confidence factor gives the credibility for the alternatives to be judged into the k-best ones with k-br central weight vector.

3. A Rule-Based Decision Support Method for Multi-Attribute Decision-Making

In the majority of extant MADM methods, the problem solving process often contains two separate sub-processes: the process of eliciting preference information from DMs and the process of decision-making. Generally, the process of decision-making cannot start if the process of eliciting preference information is not complete. In addition, during the process of eliciting preference information, DMs usually cannot receive feedback of the consequence of their choices. This affects the efficiency and reliability of decision-making. In this paper, a rule-based decision support method is proposed to help optimize the problem solving process in MADM, which is referred to as R-MADM. The proposed method overcomes the defects mentioned above, in which the process of eliciting preference information and the process of decision-making are synchronized (see Figure 1). Once the decision result is reliable, the process of eliciting preference information and the decision-making process could be terminated promptly. In R-MADM, a MADM problem is solved through two stages, namely, decision rule extraction and decision rule application.

3.1. Decision Rule Extraction

As shown in Figure 1, the aim of the decision rule extraction stage is to provide rules for subsequent decision-making process. The decision rule extraction stage is implemented through two steps. The first step is to construct a preference information system (IS) which can reflect the relationship between the preference structure of DM and the corresponding alternative ranking result. The second step is to extract decision rules from the constructed IS using variable precision rough set (VPRS) approach.

3.1.1. Construct Preference Information

In this paper, the preference structure of decision maker (DM) is roughly represented by a combination of pairwise comparison relations on attributes called preference combination. If there are kinds of pairwise comparison relations between two attributes, then for a given MADM problem consisting of m alternatives and n attributes, there will be a total of possible combinations. Let represent the pairwise comparison relation of attribute and attribute , then each preference combination can be represented by a tuple as satisfying . Here, three kinds of pairwise comparison relations are defined as follows:(a)If , it means that attribute is at least as important as attribute , i.e., , (b)If , it means that attribute is at most as important as attribute , i.e, , (c)If , it means that the pairwise comparison relation on attribute and attribute is not clear, which is expressed as .

In addition, the defined relations should satisfy the following properties.

(2) The defined pairwise comparison relations are reflexive and transitive, i.e.,

Consequently, for a given MADM problem consisting of m alternatives and n attributes, there are at most preference combinations. Take as an example, in R-MADM, all preference combinations could be depicted by a multi-level decision tree (see Figure 2). Each branch is a possible preference combination consisting of pairwise comparison relations on attributes. Each preference combination is represented by at the end of the branch. Nevertheless, not all combinations are rational in practice. Some preference combinations contain implicit preference information in which one pairwise comparison relations on attributes can be derived from others according to property (2). This kind of preference combination is marked with a green box in Figure 2. Some preference combinations contain inconsistent preference information in which pairwise comparison relations on attributes conflict with each other, and they are marked with red boxes in Figure 2. The preference combinations containing conflict preference information should be filtered.

In fact, each preference combination gives a group of no-conflicting inequality constrains of attribute weights. Under different constrain combinations, ranking results of alternatives can be obtained using stochastic multi-objective acceptability analysis (SMAA). Based on SMAA analysis results and corresponding preference combinations, an information system (IS) containing preference information is constructed, which is represented in the form of a decision table (see Table 1). In Table 1, pairwise comparison relations contained in preference combinations are condition attributes, while ranking results reflected by SMAA indices are decision attributes.

3.1.2. Extract Decision Rules from the Constructed Information System

Due to the stochastic nature of SMAA indices, the information system represented by Table 1 contains a great number of incomplete information. In this method, the variable precision rough set (VPRS) approach is used to extract decision rules from such incomplete information system.

Considering that, in MADM problem, both attribute weights and values are usually uncertain. For a given MADM problem consisting of m alternatives and n attributes, let be the set of possible combinations of attribute weights and values, each combination can be represented by a tuple , and it expressed as

Here, is a possible combination of n attribute values for alternative , is a possible combination of n attribute weights satisfying . Each combination corresponds to a ranking result of m alternatives. Without loss of generality, the simple additive weighting method is used for reasoning the ranking result in this paper. In the proposed method, the ranking result is obtained by evaluating the overall utility values of alternatives. And, the overall utility value for alternative is a convex combination of and , and it is expressed as

(1) Weak Rule Extraction Based on the Combination of VPRS and SMAA. Let all possible combinations of attribute values and weights be the universe , pairwise comparison relations contained in preference combinations be the condition attribute set , and ranking results reflected by SMAA indices be the decision attribute set . The indiscernibility relation with respect to condition attribute set is defined by

The objects in satisfying same pairwise comparison relations are indiscernible and can form an equivalent class with respect to as

In this method, for a MADM problem consisting of m alternatives, there are m decision attributes defined. Each decision attribute describes whether alternative could be ranked in top according to the attribute values and weights given by . Consequently, the indiscernibility relation with respect to a decision attribute is defined aswhere is a Boolean variable, if the bracketed expression is true then , otherwise .

Let and , based on the majority relation in VPRS, the classification error of classifying objects in X into Y is measured by . Here, is the number of objects in satisfying same pairwise comparison relations defined by . It can be calculated bywhere , is the value of pairwise comparison relation between attribute and attribute given by .

Similarly, is the number of objects in which simultaneously satisfy two conditions: (1) They satisfy same pairwise comparison relations defined by ; (2) Alternative could be ranked in top according to the attribute values and weights given by . It can be calculated by

The expression has the same meaning with the k-best rank (k-br) acceptability in SMAA, i.e., . Consequently, for a given admissible classification error , the majority inclusion relation in VPRS can also be expressed as

In this way, the -lower and -upper approximation of the equivalent class with respect to can be expressed as

According to (29), the relative importance of the pairwise relation for a decision attribute can be measured bywhere is the k-best rank acceptability under the constrain provided by , is the k-best rank acceptability under the constrain provided by . Then, the effect of pairwise comparison relations on ranking result is measured bywhere is the k-best rank acceptability under no constrain.

Considering that is usually obtained through the Monte Carlo simulation method, it often contains a computational error. Therefore, for a given threshold , the pairwise comparison relation is regarded to be redundant if .

In this method, whether or not an alternative could be ranked in top is considered as a decision attribute. Therefore, for a decision class , there are two objects in it, i.e., , is the union of objects in that could make alternative to be ranked in top ; is the union of objects in that could not make alternative to be ranked in top . According to the definition of positive region in VPRS given in section 2.1, preference combinations in the positive region of are referred to as positive preference combinations. For a given confidence level , the positive preference combinations satisfy

And preference combinations in the negative region of are referred to as negative preference combinations which satisfy

In the proposed method, the intersection of positive preference combinations is referred to as a positive rule, which is expressed as

And the intersection of negative preference combinations is referred to as a negative rule, which is expressed as

The positive rule reflects the common characteristic of the preference structure which could ensure alternative being ranked in top . Similarly, the negative rule gives the common characteristic of the preference structure which prevents alternative from being ranked in top . The ultimate rule is the aggregation of the positive rule and the negative rule , which is expressed asis referred to as a weak rule of the decision attribute . All weak rules for decision attributes in constitute the weak rule set in Figure 1, which can be represented as . The advantages of eliciting preference information based on weak rules lie in the following two aspects: (1) With the concept of attribute reduction in VPRS, the process of eliciting preference information based on weak rules could avoid the evaluation on redundant attributes, thus reducing the burden of DMs. (2) The relative priority of preference information is given by weak rules. In this way, the preference information, which is sensitive to ranking result, could be obtained preferentially to ensure its reliability.

(2) Strong Rule Extraction Based on the Combination of DB-VPRS and SMAA. The rules extracted based on the above preference information system are weak rules in which pairwise comparison relations on attributes are roughly defined from a logical and qualitative point of view. In practice, the pairwise comparison relation on attributes can be further refined based on its significance level. The significance level reflects DMs’ confidence in their evaluation of pairwise comparison relations on attributes. The significance level of pairwise comparison relations is essentially a kind of dominance relation. In the proposed method, to improve the reliability of the rule-based decision-making process, the extracted weak rules are refined using the combination of DB-VPRS and SMAA, which are defined as strong rules.

Similarly, let pairwise comparison relations considering dominance relation be condition attribute set . The difference of attribute weights represented by is defined as the subtraction of two attribute weight values, i.e., . Based on the value of the difference of attribute weights, three kinds of significance levels are given as follows:(a)If , then the significance level of the pairwise comparison relation between attribute and attribute is defined as low;(b)If , then the significance level of the pairwise comparison relation between attribute and attribute is defined as middle;(c)If , then the significance level of the pairwise comparison relation between attribute and attribute is defined as high.

It is assumed that, for any condition attribute , low middle high. Consequently, for two given objects and , means that the pairwise comparison relation on attribute and attribute reflected by is more significant than . If , is true, is said to be dominated by with respect to , i.e.,

Consequently, the dominance and dominated union of with respect to are represented by

By follow the definition in Section 2.1.2, let the ranking results of alternatives be decision attributes which is represented by . Let be decision classes with respect to a decision attribute . The object in could make the alternative to be ranked in top according to its attribute values and weights. The upward union of decision classes means that the alternative could be ranked at least in top . Similarly, the downward union of decision class means that the alternative could be ranked at most in top .

As discussed above, the approximation accuracy could be replaced by k-best rank (k-br) acceptability in SMAA. Therefore, according to equations (18)–(21), the -lower approximation and the -upper approximation of and are represented by

In this way, the strong rules can be extracted from a preference information system containing dominance relation using a dominance-based variable precision rough set (DB-VPRS) approach, which are usually represented in the form of a series of if-then decision rules, and they are usually expressed as

3.2. Decision Rule Application

In the decision rule application stage, as shown in Figure 3, the process of eliciting preference information and the process of decision-making are guided by rules and carried out step by step.

First of all, for a given MADM problem, a weak rule set (WRS) and a strong rule set (SRS) could be obtained based on the attribute value of alternatives using the proposed decision rule extraction method. The rules in WRS could eliminate redundant attributes and give the relative priority of preference information. And the rules in SRS further improve the confidence of decision-making process by introducing the dominance relation. Then, in the first step, according to the rules in WRS, investigation questionnaires are designed in which DMs only need to evaluate the pairwise comparison relation of partial attributes. In this step, DMs are allowed to answer the questions in the designed questionnaire in an intuitive and linguistic way. In the second step, the designed questionnaires are sent to DMs to collect their preference information. In this step, DMs could express their preference in a way like that “attribute A is more important than attribute B,” and they are informed the consequence of their choice. Moreover, even if DMs may not reach an agreement on the question, the following steps could still continue. When DMs agree on a pairwise comparison relation of two attributes, the significant level of this relation is further asked in the third step. According to rules in SRS, DMs are also informed the consequence of their choice in this step. In the fourth step, according to the collected preference information, a preliminary decision result can be obtained. Meanwhile, the reliability of the decision result is obtained in this step. In this paper, the reliability of the decision result is measured by the following equation (63).where is the th element of a sequence in which the k-best rank (K-br) acceptability is ordered from high to low. For a given threshold value , if , the decision result is considered to be reliable. In this way, the decision result can be explained from multiple perspectives by adjusting the value of and to adapt to different types of MADM problems.

If the decision result is reliable, the process of eliciting preference information and the process of decision-making could be terminated promptly. And if not, the rules in WRS and SRS should be updated based on collected preference information, and the steps above should be repeated again and again until the decision result is reliable.

4. Illustrative Example

In this section, a MADM problem consisting of twenty alternatives is used to illustrate the application of the proposed method. In this example, each alternative is evaluated based on three attributes. Attribute values are given in Table 2 in the form of interval numbers. For simplicity, attribute values are normalized to the range of zero to one. It is supposed that all attributes are benefit indices and independent of each other.

It is necessary to carry out a preliminary screening on the twenty alternatives to reduce the complexity of the problem. According to equations (35) and (36), k-best rank (k-br) acceptability results for the twenty alternatives under no constrains are firstly obtained through Monte Carlo simulation. In order to ensure the accuracy of analysis results and reduce the computational complexity of the problem, descriptive sampling technique is used in Monte Carlo simulation. Each simulation is carried out for ten times with up to 50000 samples and less than 0.002 convergence tolerance. The mean value and standard deviation of 1-br and 3-br rank acceptability of the twenty alternatives in ten simulations are given in Figures 3 and4, respectively. It can be observed that thirteen alternatives including alternative 1, 3, 5, 6, 7, 8, 10, 11, 13, 16, 17, 19, and 20 have near-zero rank acceptability which will be eliminated in further analysis. In this way, the MADM problem consisting twenty alternatives is simplified to a problem with only seven alternatives.

4.1. Decision Rule Extraction

As discussed in Section 3.1, all feasible preference combinations are potential decision rules. In this example, 27 preference combinations are depicted in Figure 5 in the form of a three level decision tree, in which 24 combinations are feasible and each combination is represented by . The preference combinations and their outcomes (ranking results) constitute a decision table (see Table 3), in which pairwise (Figure 6) comparison relations contained in preference combinations are condition attributes, while ranking results reflected by SMAA indices are decision attributes.

4.1.1. Weak Rule Extraction

According to equations (40) and (41), the universe is partitioned by feasible preference combinations into 23 equivalent classes, i.e.,

And each decision attribute divides the universe into two decision classes, i.e.,

Let the confidence level . Then, the -lower and -upper approximations of the decision attribute can be given by equations (46) and (47). Taking as an example, it can be obtained that

According to the definition in Section 2.1.1, it can be obtained that

Then, decision rules for the decision attributes are obtained by equations (52)–(54) as

Similarly, decision rules for other decision attributes can also be extracted from the information system like Table 3. All rules and their approximation accuracy are listed in Table 4.

The relative importance of pairwise comparison relations on attributes in weak rules are obtained by (48) and listed in Table 5. Let the threshold , it can be observed that the pairwise comparison on attribute 1 and attribute 2 is redundant for the rule , which could be eliminated from the rule . Based on (49), the comprehensive effects of pairwise comparison relations on ranking result are listed in the last row of Table 5. It can be observed that the pairwise comparison relation on attribute 1 and attribute 3 is more important than others. Based on the analysis result, when eliciting preference information from DMs, the priority of pairwise comparison relations is .

4.1.2. Strong Rule Extraction

The decision rules extracted based on the information provided by the decision table like Table 3 are weak rules, in which pairwise comparison relations on attributes are roughly defined. As discussed in the previous section, the weak rules could be refined by introducing dominance relations. The approximation accuracy of seven weak rules listed in Table 4 under different combinations of dominance relations are listed in Tables 611.

Take the weak rule as an example, as shown in Table 6, under different combinations of dominance relations, there are obvious differences on the k-br acceptability of alternative 2.

Let the confidence level , based on equation (58), it can be obtained that

The obtained strong rules for different upward unions of decision classes are illustrated in Figure 7, in which different filled regions correspond to the strong rules for different upward unions of decision classes. When DMs’ confidence in their evaluation of pairwise comparison relations on attributes fall within the filled region, the reliability of decision-making will be improved significantly. In addition, Table 6 could provide more decision support information to DMs. For example, even if DMs’ confidence in their evaluation of pairwise comparison relations on attributes are both low, the alternative 2 still could be ranked in top 5 with at least 82.24% confidence level. Meanwhile, even if DMs’ Tables 810confidence in their evaluation of pairwise comparison relations on attributes are both high, the probability of ranking alternative 2 in top 1 is at most 24.43%.

Similarly, based on the information provided in Tables 711, the refined strong rules for different weak rules are depicted in Figures 711 separately.

4.2. Decision Rule Extraction

In this section, a case is provided to illustrate Table 12 the process of decision-making based on the proposed method. It is assumed that the top three alternatives are of concern in this case.

First of all, according to the relative importance of pairwise comparison relations in weak rules given by Table 5, DMs are asked to evaluate the relative importance of attribute 1 and attribute 3, and they are informed of much decision support information. For example, the provided decision support information may consist of the following:(i)In the absence of preference information, alternative 2, alternative 9, and alternative 12 are the most likely to be ranked in top three, and their possibility are 39.60%, 54.78%, and 50.17% separately.(ii)If attribute 1 is more important than attribute 3, then the possibilities of eight alternatives being ranked in top three are at most 61.26%, 82.78%, 57.09%, 97.80%, 98.56%, 83.72%, 89.04%, and 27.33% according to Table 3.(iii)If attribute 1 is less important than attribute 3, then the probabilities of eight alternatives being ranked in top three are at most 93.25%, 1.35%, 99.87%, 63.45%, 56.53%, 12.68%, 96.86%, and 62.48% according to Table 3.

It is assumed that DMs reach an agreement that attribute 1 is more important than attribute 3. Then, they are asked to give the confidence of their evaluation. And, it is assumed that the significant level of the pairwise comparison relation on attribute 1 and attribute 3 is high. Then according to strong rules in Figures 713, DMs are informed the following decision support information.(i)Based on their preference information, the alternative 2 could be ranked in top three with at least a probability of 73.49%, the alternative 4 could be ranked in top three with at least a probability of 62.73%, the alternative 9 could be ranked in top three with at least a probability of 74.57%, the alternative 12 could be ranked in top three with at least a probability of 36.31%, the alternative 14 could be ranked in top three with at least a probability of 98.46%, and the alternative 15 could be ranked in top three with at least a probability of 63.43%.

According to (63), the reliability of decision result based on extant collected preference information is calculated as

Let the threshold value , then it can be obtained that

It means that, with an 80% confidence level, the decision result is reliable. And then, the process of eliciting preference information and the process of decision-making is terminated. The decision result is that alternative 2, alternative 9, and alternative 14 are most likely to be selected.

The aim of the proposed method is to provide timely, various, and concise decision support information for DMs. According to the requirements of DMs, a unique and more robust decision result can be obtained by adjusting the confidence level and the number of alternatives considered in (63). In addition, to obtain a unique and more robust decision result, more subjective factors (e.g., the risk awareness of DMs) should7 be considered.

4.3. Comparative Experiments

In order to verify the excellent performance of the proposed algorithm, comparative experiments are implemented with AHP [47], ANP [48], D-TOSPIS [49], ELECTRE-II [50], and PROMETHEE [51]. Under the condition that the index evaluation information is inaccurate and the decision maker’s preference information is incomplete, 20 potential design schemes including performance evaluation indexes of three products are analyzed and evaluated, which can be seen in Figure 14. Besides, the index accuracy is applied to describe the deviation between the relative importance of the extracted preference information and the relative importance of the real preference information. The accuracy results are shown in Figure 15, which indicates that the performance of the proposed algorithm is prior to the comparative algorithms.

Accuracy results of the comparative algorithms in real cases of three products are shown in Table 13 minutely. It is obvious that the accuracy of the proposed algorithm is higher than the other five comparative algorithms in the three real cases. Interestingly, along with the complexity of the cases increases, the accuracy of the six algorithms is decreased to a greater or lesser extent. However, the performance of the proposed algorithm is especially excellent in the complex case (e.g., product no.3).

5. Conclusion

In order to optimize the process of eliciting preference information from decision makers, a rule-based decision support method for multi-attribute decision-making is proposed in this paper. Based on the proposed method, it is unnecessary to ask decision makers to provide complete preference information. In this way, the decision burden of decision makers is reduced, and the efficiency of the multi-attribute decision-making is improved. The comparative experiments indicate that the performance of the proposed method is prior to the common methods (i.e., AHP, ANP, and TOSPIS). The significance of this paper is summarized as follows:(1)The core of this method is extracting rules based on attribute values of alternatives and available preference information provided by decision makers through the combination of stochastic multi-objective acceptability analysis and a variable precision rough set approach. With the concept of attribute reduction and approximation accuracy, the extracted rules could eliminate redundant attributes and give the relative priority of preference information. According to the pre-extracted rules, the preference information that is sensitive to decision result will be collected preferentially.(2)Based on the proposed method, the process of decision-making could be carried out step by step, and DMs are informed of much decision support information to help them make a choice. Moreover, the measurement of reliability of the decision result based on the k-best rank acceptability is given in this paper. In this way, according to the measurement, once the decision result is reliable enough, the preference eliciting and decision-making process can be terminated.

The limitation of this paper is that only the pairwise comparison relation on attributes is considered in the proposed method. Therefore, more types of relations between attributes will be studied in the future research. Moreover, considering that digital feedback information is often difficult to be understood for DMs, it is necessary to translate digital feedback information into semantic information, which is easier to be understood. The study on the transformation from digital feedback information to semantic information is also one of future research topics.

Data Availability

Raw data were generated at Navicat 15 for MySQL. Derived data supporting the findings of this study are available from the corre-sponding author on request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the National Key Research and Development Program of China, no. 2018YFE0177000, and the Fundamental Research Funds for the Central Universities, no. NT2021021.