Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A SBM-DEA based performance evaluation and optimization for social organizations participating in community and home-based elderly care services

  • Qiuhu Shao,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Construction and Real Estate, School of Civil Engineering, Southeast University, Nanjing, P. R. China

  • Jingfeng Yuan ,

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    jingfeng-yuan@seu.edu.cn

    Affiliation Department of Construction and Real Estate, School of Civil Engineering, Southeast University, Nanjing, P. R. China

  • Jin Lin,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliation Nanjing Municipal Education Bureau, Nanjing, P. R. China

  • Wei Huang,

    Roles Writing – original draft, Writing – review & editing

    Affiliation School of Civil Engineering, Sanjiang University, Nanjing, P. R. China

  • Junwei Ma,

    Roles Writing – original draft, Writing – review & editing

    Affiliation Department of Construction and Real Estate, School of Civil Engineering, Southeast University, Nanjing, P. R. China

  • Hongxing Ding

    Roles Writing – original draft, Writing – review & editing

    Affiliation Department of Construction and Real Estate, School of Civil Engineering, Southeast University, Nanjing, P. R. China

Abstract

The community and home-based elderly care service system has been proved an effective pattern to mitigate the elderly care dilemma under the background of accelerating aging in China. In particular, the participation of social organizations in community and home-based elderly care service has powerfully fueled the multi-supply of elderly care. As the industry of the elderly care service is in the ascendant, the management lags behind, resulting in the waste of significant social resources. Therefore, performance evaluation is proposed to resolve this problem. However, a systematic framework for evaluating performance of community and home-based elderly care service centers (CECSCs) is absent. To overcome this limitation, the SBM-DEA model is introduced in this paper to evaluate the performance of CECSCs. 186 social organizations in Nanjing were employed as an empirical study to develop the systematic framework for performance evaluation. Through holistic analysis of previous studies and interviews with experts, a systematic framework with 33 indicators of six dimensions (i.e., financial management, hardware facilities, team building, service management, service object and organization construction) was developed. Then, Sensitivity Analysis is used to screen the direction of performance optimization and specific suggestions were put forward for government, industrial associations and CECSCs to implement. The empirical study shows the proposed framework using SBM-DEA and sensitivity analysis is viable for conducting performance evaluation and improvement of CECSCs, which is conducive to the sustainable development of CECSCs.

1. Introduction

Globally, the aging population is increasing at an astonishing speed. According to World Health Organization, the proportion of the world’s population over 60 years old is predicted to rise from 12% to 22% during the period of 2015–2050 [1]. In particular, the population aged above 60 in China is expected to exceed 30% by 2050, which is obviously higher than the world average [2]. As a result, a corresponding number of special care for the elderly will be needed. Since the elders in China are keen to uphold traditional filial piety, they are more willing to choose traditional family care [3]. In response to the urgent needs for more elderly care, eldercare institutions have already undergone significant growth in number and size which provide an alternative for empty-nesters and disabled elders [4]. However, a series of problems in the existing eldercare institutions are apparent, such as ever-increasing operation costs, insufficient provision and inaccessibility [4, 5]. In addition, the community elderly care mainly provides family-oriented services for the elderly, such as life consulting services, mental care, primary and preventive healthcare as well as organizing sports activities. Community elderly care, which can narrow the growing gap between care needs and provision, will become the important trends in China [3].

To gear to the social development, it requires that home-based elderly care be prioritized, and correspondingly, more elderly healthcare facilities should be provided in communities. Meanwhile, the Chinese government is altering its role as direct provider to regulator and policy maker for all social welfare and encourages greater participation of social forces to fill the vacuum [6]. Given its nonprofit nature and commitment to service, social organizations can be viewed as the best choice to bridge the shortfall of elderly care services. In essence, social organizations are responsible to make full advantage of the donations and fund collected to cater for the citizens. Therefore, social organizations play a more important role in elderly care service delivery and emerge as the answer to the failure of China’s welfare economy.

Contemporarily, it is an inevitable trend for social organizations to become the main body of community and home-based elderly care [7]. The participation of social organizations in community and home-based elderly care can not only tackle practical problems, but also ensure the long-term development. However, there are still some problems in its development process, such as the imperfect organizational structure and government supervision system, the unsound service system, the lack of policy support, the single source of funding and the low purchasing process standardization [810]. These problems lead to the low-quality of community and home-based elderly care involving social organizations and cannot give full play to the advantages of solving the pension plight.

The study of community and home-based elderly care involving social organizations has begun to catch the attention of academia for the moment in China, but unfortunately, the depth and breadth of its research is far from enough. The existing research is given priority to case description, and focuses on the analysis of government purchasing policy, the choice of purchasing patterns, the problems and countermeasures of community and home-based elderly care involving social organizations [1113]. However, few scholars pay close attention to the performance management and evaluation which is urgently needed for the above-mentioned problems. Hence, It is vital to study the performance of social organizations involved in community and home-based elderly care and evaluate the performance of them, which would not only help social organization to optimize itself and improve efficiency, but also be conducive to the government departments to strengthen the management, thereby promoting the structural optimization of the elderly care system.

Performance refers to the effective output of an organization at different levels to achieve its goals [14]. Peter Drucker indicated that performance management should be taken seriously by every organization [15]. Taylor established Scientific Management Theory in 1891, which marked the establishment of enterprise performance evaluation system [16]. Subsequently, the research scope of performance management was gradually expanded, from the first enterprise performance management to the later organization and individual performance management, and then to the government performance management. In recent years, with the methodology of ABC cost accounting, AHP, FAHP, DEA, Grey Relation Analysis, Social Network Analysis and other multi-disciplinary method, performance evaluation and management has formed a rather mature system [1719].

The main question of this research is to propose a new approach to evaluate and optimize performance of social organizations involved in community and home-based elderly care. In the concrete practice of China, social organizations are known as community and home-based elderly care service centers (CECSCs). In this study, the index system is firstly constructed based on the social benefits of CECSCs. Then SBM-DEA is used to evaluate the performance of the CECSCs and Sensitivity analysis is utilized to screen the direction of performance optimization. The data of different levels of CECSCs are compared and analyzed. Finally, Specific development suggestions were put forward for different participants.

The main contributions of this study can be summarized as follows. This study focuses on the performance evaluation and optimization of CECSCs, and fills the gap of relevant research. Meanwhile, this study provides several directions for optimizing the performance of CECSCs, which is conducive to promoting the development of home-based care services in regional China.

The remaining part of this paper is organized as follows. In Section 2, related literatures are reviewed. Section 3 introduces the proposed method of framework analysis. The proposed method is applied to explore the performance of the CECSCs in Nanjing in Section 4. Further discussion and suggestion are proposed in section 5. Conclusions are provided in Section 6.

2. Literature review

2.1 Social organizations involved in community and home-based elderly care services

Social organizations are institutions whose aims are not necessarily to provide shareholders a return on their investment but to achieve social outcomes through various projects and activities [20, 21]. Social organizations may appear in public under different names, such as non-governmental, non-profit organizations, voluntary, humanitarian, philanthropic, independent and civil society organizations. For the purposes of our research, we will use the term social organizations [22]. Social organizations fulfil vital functions particularly for humanitarian-oriented activities, which are not addressed by the government and market institutions, such as health, non-formal education, relief and capacity building, protect wildlife, labor inclusion, etc. [21, 23, 24]. They are concerned with the problems of marginalization within society, so the role of these organizations in society has been essential, not only at national, but also at an international level [25].

Social organizations have drawn great attention from the public and academic, especially as suppliers of welfare provision, promoters of active citizenship, and guardians of the common and greater good in society through their special characteristics and values [26]. In co-production and co-creation theories [27, 28], social organizations engagement in community and home-based elderly care aims at achieving a public benefit which allows to increase the volume and quality of elderly care services and promote equality in the consumption of elderly care services and customer satisfaction. In China, rapid aging, a lack of public support for frail elders, and the failure to meet the needs of the old have led to including nonprofits as providers in the welfare for the elderly [6]. Participation of social organizations can not only increase the efficiency of the service but also have a positive effect on the democratic nature of service delivery. CECSCs have been set up in China to play the role of social organizations, which integrate social resources and provide services for the elderly.

Meanwhile, there are many weaknesses in social organizations, which may lead partnerships in the production of public services to fail. Because social organizations are not profit-oriented, they have to use specific operational models and rely on multiple resource providers to implement their operations [29], such as exemption from paying taxes [30]. However, recent studies on the sustainability and accountability of social organizations have raised significant concerns that social organizations are philanthropic uncertainty (inadequacy of owned and attracted resources, or relying heavily on government funding), philanthropic particularism (focusing on particular client groups and geographical limiting), philanthropic distrust (abusing and misconducting of religious charity funds), philanthropic paternalism (influence of donors’ interests on the mission and perceiving the contribution to the organizations entitlement, not as a right), philanthropic amateurism (problems with attracting professional workers) [24, 31].

Therefore, social organizations are facing growing pressure to performance-oriented, when they mobilize the endowment of resources and deliver services [32, 33]. Since Social organizations strive to the goal of public profit maximization [34, 35], it is necessary to secure development of such organizations not just by an increase of subsidies, but mainly by proper managing systems and radical elimination of what is not bringing any value [36]. Performance management of social organizations are essential for decision-making for governments, funders, clients, donors and all stakeholders [37]. Performance measurement helps to clarify expectations, promote consistency, provide risk signals, allow precision and objective forecasts, promote motivation and improve solutions to problems, improve accountability and increase objectivity [32]. Taking into account that many social organizations need to create trust and confidence, it is the multiplication of benefits from performance measurement as well.

2.2 Performance management and evaluation

Performance management, which is defined as a closed loop control system that deploys policy and strategy, and obtains feedback from various levels to manage the performance of the system [38], has been widely adopted by a wide range of industries [4, 39]. All organizations exist with high-level performance [40]. As such, performance management is positively related to strategic performance of organizations [41]. In the performance management system for organizations, the managers and implementers set objectives, measure and recapitulate how these objectives are met, give good performance reward and support continuous improvement [42]. Critical issues of performance management are the definition of objectives, measurement of objective achievement in terms of meeting all stakeholder requirements, the process of objectives attained and operation management [43]. To achieve performance management, managers or decision makers need to know which performance they seek. Hence, performance measurement constitutes an integral part of the performance management.

The success of a social organization depends on a plethora of factors, in which performance measurement is of paramount significance to ensure the outcome achieved [4446]. Performance management and measurement are used to obtain a performance score by measuring relevant performance indicators, proceed analysis based on this score and improve performance continually. Thus, to identify the measuring and managing performance indicators is at the heart of performance management and measurement [47]. Prior studies have conducted studies about the financial indicators of social organizations [48, 49]. However, Social organizations are mission-driven (rather than profit-driven) organizations and we cannot simply use financial indicators to measure the overall performance of social organizations [50]. Moreover, it should be noted that non-profit social organizations have begun to include outcomes as metrics of performance [51]. Many studies implement the outcome-based evaluations to measure performance of social organizations by the approach of DEA, which considers three dimensions: service quality, effectiveness and efficiency [52].

Performance evaluation is the process of determining the efficiency and/or effectiveness of past action, which has been widely adopted to measure the performance of social organizations [53]. The commonly-used methods for performance measurement include ratio analysis, regression analysis, multiple-criteria decision making analysis, AHP, BSC, the Delphi method, cost-benefit analysis, fuzzy comprehensive evaluation, and data envelopment analysis(DEA) [5458]. In effect, healthcare input and output are intractable to quantify and are easily affected by government polices [54]. Therefore, the functions between input and output show an insignificant relationship, leading to difficulty in evaluating performance of social organizations. Unlike other methods mentioned above, which need to judge indicator weight subjectively and make data dimensionless, the DEA can resolve qualitative problems with quantitative analysis, transform subjective judgments into objective ones, and develop an unbiased weighting or scoring for aggregation [59]. In addition, DEA is a simple and practical multi-criteria evaluation method applied in various categories [60]. Government departments, transportation projects, education institutions and etc., often use DEA in evaluating the operation performance of the institution or unit [6163]. Thus, the DEA method is more suitable and feasible for this study.

2.3 Knowledge gap

The study of social organizations participating in community and home-based elderly care has drawn the attention of researchers. However, prior studies mainly focused on the analysis of government purchase conversion [64], purchase mode selection [65], problems and countermeasures [66]. Few scholars have paid attention to the performance management of social organizations participating in home-based elderly care services.

The current academic research on the performance management is relatively mature. The performance management of social organizations has gradually become a hot research field. But the previous study on social organizations are mostly referred to the concept of social organizations in a narrow sense, that is, private non-enterprise units and foundations, as well as institutions with strong administrative nature such as universities [67], healthcare [41], sports organizations [68]. There are few studies on the performance evaluation of social organizations participating in community and home-based elderly care, which provides the corresponding space for this study.

3. Materials and methods

3.1 Model selection

As a social organization, CECSC integrates massive social resources and provides social public services, which are relatively homogeneous and characterized by obvious uncertainty between input and output [69, 70]. Therefore, this study chooses DEA, which has a strong applicability to the relative efficiency of homogeneous decision-making units (DMUs) with multiple inputs and multiple outputs, and also can effectively estimate the production frontier [71].

DEA model is an input and output analysis method based on relative efficiency proposed by Charnes, Cooper and Rhodes in 1978 [72]. Particularly, its derived non-parametric models, such as Charnes-Cooper-Rhoder(CCR) and Banker-Charnes-Cooper(BCC), have been widely employed to measure the relative efficiency of the same type of DMUs with multiple input and output indicators [73]. However, CCR and BCC model are typical radial model, which ignore the slack adjustment. Besides, these model cannot distinguish the efficient DMUs further [74]. Based on the CCR model, Tone(2001) constructed a non-radial slack-based measurement(SBM) model in which all slacks measures were incorporated into the objective function via a scalar method [75]. Therefore, SBM-DEA model can eliminate the deviation of efficiency measurement caused by the difference of radial selection, thereby obtaining more objective and accurate efficiency.

The purpose of this study is to comprehensively and systematically evaluate the management performance of CECSCs. At present, CECSCs in China are featured with public welfare, and since they are just starting out, the government has invested a large amount of funds and resources to maintain their normal operation, so the investment is astonishingly large, and it is difficult to quantify the real efficiency of the investment. Therefore, the output-oriented SBM-DEA model is adopted in this study.

Suppose that there are n DMUs, which refer to CECSCs in this study. Each DMU has m input indicators and s output indicators y. Bj is the j-th DMU, where: j = 1, 2, ……, n, [xij] is m×1 input indicators of Bj, where: i = 1, 2, ……, m, [yrj] is s×1 output indicators of Bj, where: r = 1, 2, ……, s. The relative efficiency value of the j0-th DMU is expressed as hj0. The output-oriented SBM-DEA model with variable returns to scale assumption is as follows:

In this formula, the efficiency value of j-th is expressed as θ. λj represents nonnegative vector. When θ = 1, the DMU is only considered efficient, otherwise, the DMU is inefficient and there is room for improvement. In this study, MaxDEA Basic 6.13 is used as the software for SBM-DEA model analysis.

After evaluating the performance of CECSCs through SBM-DEA, Sensitivity Analysis (SA) method is also employed in this study to design the path of performance optimization. SA is a common uncertainty analysis method in economic decision-making. It analyzes and predicts the influence of various uncertain factors on the economic effect of the program, finds out the factors that have greater influence on the economic effect of the program, or called sensitivity factors, and determines their influence degree [76]. The quantitative analysis of SA provides scientific data to identify the optimization direction and range of CECSCs, and realizes the effective practice of scientific and refined management in the field of performance optimization.

3.2 Indicator system construction

Scientific and reasonable indicator selection is the foundation of evaluation. Based on the extensive literature review and field interviews, this study constructs a performance evaluation indicator system of CECSCs. 33 indicators were proposed for the performance evaluation and these indicators could be categorized into six dimensions (i.e., financial management, hardware facilities, team building, service management, service object and organization construction) as shown in Table 1.

thumbnail
Table 1. Evaluation indicator system of operation performance of CECSCs.

https://doi.org/10.1371/journal.pone.0248474.t001

The first dimension is financial management. Achievements of performance management of home-based care are mainly reflected in whether the funds such as operator investment, government subsidies, operating income and social donations are effectively utilized to achieve the balance of income and expenditure, and the above investment is transformed into social benefits through operation [77]. Meanwhile, the home-based care itself must have a certain source of funds for its service team training, service facilities construction, service content provision, etc [79]. Therefore, financial management dimension evaluation indicators can be identified from the sources of funds and the financial situation.

The second dimension is hardware facilities since hardware facilities determine the upper limit of the development of home-based care [80]. As a home-based care, the size of the site, the number of beds, the selection and quantity of fixed assets determine the number of service objects and the types of services provided by the home-based elderly care service center [41].

The third dimension is the management of the service. Service is the direct embodiment of the effective output of CECSCs [82, 83]. The type and quality of services provided by community and home-based elderly care not only directly determine the amount of operating income, but also represent the social benefits it can effectively produce [84].

The fourth dimension is team development which indicates that the effective training of CECSCs for employees can promote service level of the whole industry and propel the overall progress of the whole industry, which has great social implications [89]. The team composition of CECSCs is mainly consisted of management personnel, service personnel, social workers, volunteers and other personnel [81, 86, 87]. Therefore, we set up the evaluation index of team development dimension from two aspects of team composition and staff training.

The fifth dimension is elderly care recipients. If an organization aims to progress in the long run, it must have its own faithful elderly care recipients [81]. Different from the enterprise organization, the CECSCs do not pay attention to the absolute number and growth rate of customers at the end-user level, but pay more attention to the social benefits of the operation of CECSCs [91]. Therefore, the end-user satisfaction of CECSCs is closely connected with its mission.

The sixth dimension is organization management which indicates that the standardized operation of an organization is the key to its long-term operation and effective development [94]. Systematization and standardization are helpful to clarify working standards and improve working efficiency [97, 98]. The institutionalization and standardization of an organization can reflect the level of its managers and its management performance [101, 102].

3.3 Data source

Attention should be laid on the selection of DMUs to enter the analysis as well as the choice and screening of factors [103]. According to Evaluation standard of CECSCs in Nanjing (2018 edition) and Opinions on carrying out the construction of CECSCs, the municipal civil affairs bureau and the district civil affairs bureau divided all the CECSCs into five grades in Nanjing. The higher the level of the CECSCs, the better service it will provide for the elderly. There were 509 CECSCs rated 3A or above, among which 27 were rated AAAAA, 53 were rated AAAA and 429 were rated AAA in Nanjing by the end of 2018. As SBM-DEA modeling requests the minimum number of DMUs to be at least triple the number of inputs and outputs included to attain a reasonable level of discrimination [104], 186 CECSCs were taken into account as DMUs in this study. Considering the feasibility of survey and comprehensiveness of data, the selection of DMUs is spread over 11 districts in Nanjing. In order to avoid the heterogeneity problem of DMUs, all of which were from urban areas.

The next step is to determine inputs and outputs for the DMUs to be compared. Normally inputs are defined as resources utilized by DMUs or conditions affecting the performance of DMUs while outputs are outcomes or produced goods and services or benefits generated as a result of operation of DMUs. In order to meet the daily operation of CECSCs, it needs to invest enormous funds, hardware facilities and personnel. Therefore, indicators of capital source (C1, C2, C3), hardware facilities (C6, C7, C8, C9), and team composition (C14, C15, C16, C17, C18) are selected as inputs. Due to the nature of non-profit, it is critical to pay more attention to its social benefit, rather than economic benefit, when evaluating the performance of CECSCs. Therefore, indicators of service management (C10, C11, C12, C13), staff training (C19, C20, C21), elderly care recipients (C22, C23, C24, C25) and organization management (C26, C27, C28, C29, C30, C31, C32, C33) are selected as non-financial performance index in outputs. In addition, as an important indicator to measure whether an organization can survive effectively for a long time and provide services continuously, economic status also occupies a certain proportion in performance evaluation indexes. Therefore, indicators of general financial position (C4, C5) are selected as financial performance index in outputs. Internal relationship among indicators can be seen in Fig 1. The grading criteria is shown in S1 Table.

4. Results and discussion

4.1 DEA input and output variables

Statistical information of 33 indicators is briefly summarized in Table 2. When the input index appears 0 value, a very small positive number is used to replace 0 value. The raw values of input and output variables are shown in S2 Table.

4.2 DEA analysis

MaxDEA Basic 6.13 is one of the most user-friendly softwares in SBM-DEA study. Based on the above principles and software operation, the performance of CECSCs in Nanjing was measured and the results are shown in Table 3.

The efficiency value is divided into effective and invalid value, and the invalid efficiency value is divided into three levels as shown in Table 4. It can be seen from Table 3 that among 186 CECSCs, 75 CECSCs are effective and 111 remaining CECSCs are invalid. In addition, the projection by the SBM-DEA model represents a practical “improvement”. The inputs and outputs of the projection of each inefficient DMU on the frontier are shown in appendix. It is easy to see that: inefficient DMUs should use lower inputs and higher outputs than the original values in order to reach the frontier; other DMUs should reduce (expand) at least one of its outputs (inputs) to reach the frontier.

thumbnail
Table 4. Performance efficiency statistics of CECSCs in Nanjing.

https://doi.org/10.1371/journal.pone.0248474.t004

As a typical example in the effective level, DMU059 is one of the earliest CECSC developed in Nanjing and even in the country. With well-equipped hardware facilities, high degree of management standardization and above-average service specialization, DMU059 is a leader in the community and home-based elderly care industry of Nanjing. DMU126(efficiency score = 0.921) was selected from the first level of SBM-DEA invalidation for analysis. This organization mainly provides spiritual consolation services for the elderly, but its emphasis on spirit rather than substance leads to its weak economic benefits, which partly affects its performance. However, the organization has a wide range of elderly care recipients, a long service time, a good service effect, and a high degree of management standardization. As a result, it performs well in all but economic indicators. DMU043(efficiency score = 0.426) was selected from the second level of SBM-DEA invalid for analysis. Due to its short opening time, low popularity, unstable source of users, and its huge investment cost in the early stage, the institution is greatly affected by the economic situation. DMU152(efficiency score = 0.385) was selected from the third level of SBM-DEA invalid for analysis. There are more well-known service centers around the organization, which affect its economic benefits. In addition, due to its poor reputation, customer satisfaction is relatively low. Moreover, the operating cost is ineffectively controlled, which leads to its unsatisfactory performance.

Meanwhile, the evaluation result of SBM-DEA efficiency value is compared with the existing grades of CECSCs in Nanjing, as shown in the Table 5. Compared with the rating results of current CECSCs, the evaluation results of SBM-DEA efficiency value are broadly similar in general trend but still differ in the evaluation of individual cases. This study indicates that the main reason is that the current evaluation of CECSCs is merely focusing on the hardware, ignoring the requirements for management efficiency. This reflects some problems in the reality, that is, many CECSCs use sufficient funds to buy hardware, but neglect the operation management and service quality. Although these social organizations can be rewarded a high rating in the evaluation, they cannot satisfy end-users, which defeats the purpose of the evaluation.

thumbnail
Table 5. Comparison of SBM-DEA performance efficiency and the existing grades of CECSCs in Nanjing.

https://doi.org/10.1371/journal.pone.0248474.t005

4.3 Sensitivity analysis

After identifying the gap, it is of necessity to determine the direction of performance optimization. In this study, SA method is adopted to study the effect of improving various indicators on the overall efficiency value of CECSCs. Three DMUs are randomly selected from the three levels where the efficiency value is invalid. Table 6 shows sensitivity analysis of output indicators of DMU126(first level), DMU043(second level) and DMU152(third level).

Although it is difficult to change the overall efficiency value through a certain DMU’s indicator due to the large number of input and output indicators, it can be seen from Figs 2 to 4 that the change of C10, C22, and C23 has a significant impact on the change of efficiency value. According to SA, as the basic demand of the largest number of the elderly, C10 plays a crucial role in the performance evaluation of CECSCs. Meanwhile, C22 and C23 also affect the efficiency value of CECSCs to a large extent. As for the other indicators, such as the indicators in team development dimension and organization construction dimension, they belong to the internal development category of CECSCs, and the optimization of this category is difficult to improve efficiency value directly and significantly, which can only indirectly affect the efficiency value by attracting end-users and increasing operational income.

4.4 Data comparative analysis

To observe the inputs and outputs of invalid DMUs and find out the reasons for the performance gap, SBM-DEA model is employed. This study randomly selects an invalid decision unit from each of the three invalid levels, which is the DMU126(efficiency score = 0.921) in the first level, DMU043 (efficiency score = 0.426) in the second level and DMU152(efficiency score = 0.385) in the third level. In order to provide a comprehensive analysis, the criteria for the selection of invalid decision unit takes into account CECSC from urban and rural districts with different ratings.

1) DMU126.

For the comparative analysis of CECSCs at the first level, several DMUs which are located in the same area as DMU126 in Nanjing city and have relatively consistent input indicators of capital source, hardware facilities and team composition were selected. On this basis, the DMU with the highest efficiency score is selected for comparison. Hence, DMU130 (efficiency score = 1.000) with the highest performance efficiency is chosen for comparison. The comparison of inputs and outputs of DMU126 and DMU130 is shown in Fig 5.

thumbnail
Fig 5. Comparison of DMU126 and DMU130 inputs and outputs.

https://doi.org/10.1371/journal.pone.0248474.g005

Although almost all inputs of DMU126 are higher than that of DMU130, DMU126 has no absolute advantage over DMU130 in outputs except in terms of C4. Moreover, it is even deficient in C11, C21, C22, and C23.This clearly shows that DMU130 is able to convert its inputs into outputs more efficiently than DMU126 by enhancing internal management measures. Hence, it is necessary to improve the ability of operation management and provide accurate service to improve organizational performance.

2) DMU043.

Taking the approach of selecting the DMU for comparative analysis from the first level, DMU161 (efficiency score = 1.000) with the highest performance efficiency is chosen for comparison. The comparison of inputs and outputs of DMU043 and DMU161 is shown in Fig 6.

thumbnail
Fig 6. Comparison of DMU043 and DMU161 inputs and outputs.

https://doi.org/10.1371/journal.pone.0248474.g006

As is shown in Fig 6, DMU043, which is the representative of high-standard CECSC in Nanjing, has significant advantages in all inputs due to receiving significant capital support. In contrast, DMU161, as the representative of CECSCs away from the city center, only has one service type, but it has reached higher performance than DMU043 which has nearly ten services. Therefore, an important breakthrough in improving organization performance is to grasp the demand on customer group with different consumption ability and preference. CECSCs should pay more attention to improve the quality of existing services and continuously enhance the satisfaction of the elderly while investing in abundant funds.

3) DMU152.

Taking the approach of selecting the DMU for comparative analysis from the first level, DMU071 (efficiency score = 1.000) with the highest performance efficiency is chosen for comparison. The comparison of inputs and outputs of DMU152 and DMU071 is shown in Fig 7.

thumbnail
Fig 7. Comparison of DMU152 and DMU071 inputs and outputs.

https://doi.org/10.1371/journal.pone.0248474.g007

As is shown in Fig 7, it is interesting to note that DMU071, which has relatively low inputs, has equal outputs to DMU152. The finding is in accordance with numerous advantages from developing service chain of the CECSCs. It has been demonstrated that it is the service chain that promotes efficient utilization of headquarter valuable resources for CECSCs, handles the requirements of all the elderly appropriately, maximizes long term profitability and so on. In addition, DMU071 focuses on the basic service, namely food, bath, cleaning, emergency, and treatment, while DMU152 chooses multi-channel development, placing equal emphasis on basic service and other value-added service functions. The efficiency scores of CECSCs can also be promoted by improving management measures systematically according to the region’s different demand while developing service chain.

(2) Design of Performance Improvement Path.

The core of performance improvement for CECSCs lies in cost reduction and efficiency enhancement. Under the condition that the investment remains unchanged, efforts should be made to focus on core business, improve management ability, and comprehensively enhance service quality, so as to achieve the goal of performance improvement. As mentioned above, the key output indicators of CECSCs are C10, C22, and C23. Taking DMU126, DMU043, and DMU152 as examples, since the categories of C10 have reached the upper limit and cannot be further improved, both C22 and C23 are increased simultaneously (the indicator C23 of DMU043 is 0, so only the effect of improving C22 on the efficiency value is considered). Therefore, the efficiency value will be greatly improved, as shown in Table 7.

From Table 7, it can be seen that C22 and C23 have a profound impact on the performance of CECSCs, and the greater the improvement, the greater the impact on the performance. Taking DMU152 as an example, as a rural CECSCs, the center fails to give full play to its geographical advantages. The coverage rate of the elderly in this community is only 27%, which is lower than the average 36% of the 186 CECSCs in Nanjing. In addition, the number of elderly people whose services are procured by the government is only 3, with huge space for improvement.

thumbnail
Table 7. The effect of improving C22 and C23 on the efficiency value of DMU126, 152 and 043.

https://doi.org/10.1371/journal.pone.0248474.t007

Therefore, the next step should focus on improving the service quality and attracting more end-users for this center. Rural areas are more willing to give priority to home-based elderly care, which is different from that in cities. Therefore, according to this characteristic, the center is suggested to encourage more rural elders to try and gradually adapt to the home-based elderly care by clearing requirements, improving service quality, and strengthening propagatition without substantial cost increase, which can eventually reach the purpose of cost reduction and efficiency increase.

Meanwhile, this paper lays emphasis on the performance optimization of the input indicators while strengthening the output. Since the capital investment, the occupancy nature and the total amount of fixed assets are one-time inputs, it is difficult to change. Therefore, this paper mainly studies the impact of indicators C7, C8 and C14-C18 on the performance. The study still takes DMU152 as an example.

From Table 8, it can be seen that for DMU152, the idea of improving the performance level by reducing investment is feasible. However, according to the Value Engineering Theory, the premise of increasing value by reducing input is that the output cannot fall significantly, otherwise it cannot improve performance [105].

thumbnail
Table 8. The effect of changing C7, C8 and C14-C18 on the efficiency value of DMU152.

https://doi.org/10.1371/journal.pone.0248474.t008

For DMU152, the annual service number is only 15,000, which is less than the average number of Nanjing (24,000). However, it has 250 m2 space, 10 beds and ¥1.22 million of fixed assets, which are all higher than the average level of the city. By improving the utilization rate of space and beds, reducing the space and the number of beds, and changing the space and beds to other functions, the performance can be effectively improved. Simultaneously, as a rural CECSC, there are 26 staffs, which is obviously redundant. While improving the working efficiency of staff and ensuring the quality of service, the number of staffs and expenses can be reduced to achieve the purpose of cost reduction and efficiency increase.

5. Implications and suggestions

The participation of social organizations in community and home-based elderly care service is related to a series of strategies and actions aiming to achieve elderly satisfaction and requirements with the main principles of welfare society. All the different aspects (e.g., finance, facilities, and administration) can significantly influence the level of performance of CECSCs. After a careful examination, some implications and suggestions can be provided, based on the shortcomings in the CECSC efficiencies in Nanjing. The performance improvement of the elderly care should involve the government, the industry association and CECSC. Each participant has the responsibility to make efforts to the development of the industry.

5.1 Government authorities

As the coordinator of CECSCs, the government needs to provide macro guidance for the comprehensive, coordinated and sustainable development of the industry. Firstly, government should guarantee and implement policies in land, finance, health and other aspects. For example, the government can increase investment (C1) in CECSCs to reduce their initial investment (C6) including construction costs and land costs. Government can provide subsidies when CECSCs purchase hardware facilities (C8, C9). Secondly, government should use the policy guidance to enhance the competitiveness of social organizations and stimulate the innovation ability of social organizations. Through the adjustment of service organization system (C30), professional division of labor (C14, C15, C16, C17, C18) and other aspects, it can help improve operational efficiency and reduce operating costs. Thirdly, government should carry out classified management according to the actual situation of CECSCs. As can be seen from the results of SBM-DEA, some CECSCs spend partial funds to improve the hardware to obtain high rating, but neglect the improvement of operation management. For the small-scale CECSCs, the rigid requirements on their hardware should be reduced; the focus of performance evaluation should be placed on the quality of service (C12, C13) and operational management (C30, C31). End-users’ satisfaction (C24) should be placed in a prominent position, so as to avoid the undesirable phenomenon that performance evaluation becomes investment comparison.

5.2 Industry associations

As a department authorized by the government, the industry association not only undertakes part of administrative functions but also shoulder the functions of training, assessment and supervision. Firstly, the industry association should strengthen supervision and evaluation. For example, the industry association should pay attention to forming an all-round and multi-level supervision system and building a multi-channel feedback mechanism (C32, C33). In addition, it attaches importance to the output indicators of performance evaluation to guide the rational investment of social organizations(C4). Secondly, the industry association should improve the quality of service personnel. The industry association is advised to increase the intensity and frequency of personnel training(C20, C21), and give priority to ensuring that training funds are fully implemented on the premise of government support, social participation and market promotion(C5). Thirdly, the industry association should diversify participation and improve management. The industry association is suggested to guide and encourage social organizations to actively participate in the community and home-based elderly care service industry(C2, C3), and increase the investment in living conditions, skills training and salary incentives for elderly care workers (C7, C21, C29), so as to maximize resource conservation and efficiency.

5.3 CECSCs

As the results demonstrate, in some CECSCs, there exist low performance efficiency despite high capital investment. In order to improve operation performance, CECSCs should strive to improve the ability of internal administration (B11, B12, B13). Meanwhile, as the most significant indicators, the level of community coverage (C22, C23) and the level of Customer satisfaction (C24), should also be given due attention to. It is mandatory for CECSCs to provide differentiated services that are based on accurate analysis of consumption ability and preference in community. For example, the CECSCs that are spread in underdeveloped area should enhance the efficiency in the organization by providing basic service with high quality. In addition, the development of CECSCs needs to balance service types and service quality (C10, C11), meaning the pursuit of highly professional service is crucial. It is suggested that CECSCs avoid to blindly expand the scale and increase the types of services, but implement professional service to improve the customer satisfaction. At present, some CECSCs in Nanjing have realized chain operation is conducive to the development of organizations by achieving scale effect. Through SBM-DEA analysis, the service chain operation should facilitate internal resource allocation as well as reduce costs, consequently achieving performance improvement.

6. Conclusion

This study proposes a systematic framework for performance evaluation of CECSCs with 33 indicators developed from literature review and field interviews. These indicators help to evaluate performance of the CECSCs from six dimensions: financial management, hardware facilities, team development, service management, elderly care recipients and organization construction. On the basis of the different CECSCs in Nanjing in 2018, the proposed SBM-DEA method is able to effectively measure the performance efficiency and discern the inefficiencies in its internal management. As an important consideration, the impact of region and quality grading is also considered in the evaluation. This study proves that the performance of 75 CECSCs in Nanjing is effective, while that of the remaining 111 is not. This result is similar in general trend but still differ in individual cases compared with the existing rating results of CECSCs. To test the stability of SBM-DEA results, sensitivity analysis has been conducted in the models by changing outputs, which determines the direction of performance optimization. Hence, the performance evaluation system proposed in this paper can be used in practice. Some relevant suggestions for government authorities, industry associations and CECSCs have also been offered.

However, this study is also subjective to some limitations. The first restriction is that social impact, the most pivotal aspect of the performance evaluation of social organizations, still needs to be improved. Another limitation is that a large quantity of valuable data cannot be effectively applied in the research due to the different statistical diameters, which needs further exploration in the future.

References

  1. 1. WHO. World Report on Aging and Health. Geneva, Switzerland: World Health Organization 2015. Available from: https://www.who.int/ageing/publications/world-report-2015/en/.
  2. 2. Sun X, Liu X, Li F, Tao Y, Song Y. Comprehensive evaluation of different scale cities’ sustainable development for economy, society, and ecological infrastructure in China. Journal of Cleaner Production. 2017;163:S329–S327.
  3. 3. Zhou JS, Walker A. The need for community care among older people in China. Ageing & Society. 2016;36(6):1312–1332. https://doi.org/10.1017/s0144686x15000343. WOS:000378595300010.
  4. 4. Yuan J, Li L, Wang E, Skibniewski MJ. Examining sustainability indicators of space management in elderly Facilities—a case study in China. Journal of cleaner production. 2019;208:144–159.
  5. 5. Tao ZL, Cheng Y, Dai TQ, Rosenberg MW. Spatial optimization of residential care facility locations in Beijing, China: maximum equity in accessibility. International Journal of Health Geographics. 2014;13. WOS:000341455000001. pmid:24885128
  6. 6. Wong L, Tang J. Dilemmas confronting social entrepreneurs: Care homes for elderly people in Chinese cities. Pacific Affairs. 2006;79(4):623–640. https://doi.org/10.5509/2006794623. WOS:000246027800005.
  7. 7. Ma J, Liang L, editors. The Evolution of China’s Aged Service Supply Model. 2019 4th International Conference on Humanities Science and Society Development (ICHSSD 2019); 2019: Atlantis Press.
  8. 8. Feinglass J, Norman G, Golden RL, Muramatsu N, Gelder M, Cornwell T. Integrating social services and home-based primary Care for High-Risk Patients. Population health management. 2018;21(2):96–101. pmid:28609187
  9. 9. Zhou M, editor Review on Home-based Care for the Aged in China—Visualization Analysis based on Citespace. 1st International Symposium on Innovation and Education, Law and Social Sciences (IELSS 2019); 2019: Atlantis Press.
  10. 10. Wang J, Wu B. Domestic helpers as frontline workers in China’s home-based elder care: A systematic review. Journal of women & aging. 2017;29(4):294–305. pmid:27552244
  11. 11. Shen J, Tang S, Xu C. Analysis and research on home-based care for the aged based on insurance policy under government leading. AMSE Journals-AMSE IIETA-Series: Advances A. 2017;54(1):106–126.
  12. 12. Baozhong S, Yuheng L, Xiaodong Z. Who are to support the aged in rural China? The study of people’s willingness to purchase socialized care service and its influencing factors. Journal of Rural Studies. 2020.
  13. 13. Bing L, Dongqiong Y, editors. Problems and Countermeasures of the Development of Medical-Nursing Combined Elderly Care Services in Sichuan Province. 2019 3rd International Conference on Education, Culture and Social Development (ICECSD 2019); 2019: Atlantis Press.
  14. 14. Schechner R. Performance studies: An introduction: Routledge; 2017.
  15. 15. Drucker P. The effective executive: Routledge; 2018.
  16. 16. Waring SP. Taylorism transformed: Scientific management theory since 1945: UNC Press Books; 2016.
  17. 17. Lima-Junior FR, Carpinetti LCR. Quantitative models for supply chain performance evaluation: a literature review. Computers & Industrial Engineering. 2017;113:333–346.
  18. 18. Büyüközkan G, Karabulut Y. Sustainability performance evaluation: Literature review and future directions. Journal of environmental management. 2018;217:253–267. pmid:29605780
  19. 19. Tetiana H, Karpenko LM, Olesia FV, Yu SI, Svetlana D. Innovative Methods of Performance Evaluation of Energy Efficiency Projects. Academy of Strategic Management Journal. 2018, 17(2).
  20. 20. Demerjian P, Lewis-Western M, McVay S. How Does Intentional Earnings Smoothing Vary With Managerial Ability? Social Science Electronic Publishing. 2020;35(2): 0148558X1774840.
  21. 21. Moczulska M, Seiler B, Stankiewicz J. Coopetition in for-profit and non-profit organizations—micro level. Management. 2019;23(2):138–156. https://doi.org/10.2478/manment-2019-0023.
  22. 22. Mevlja B, Kavčič K. Impact of stakeholders on the development of non-governmental organisations in Slovenia. Ekonomski pregled. 2019;70(2):236–258. https://doi.org/10.32910/ep.70.2.4.
  23. 23. Nanthagopan Y, Williams N, Thompson K. Levels and interconnections of project success in development projects by Non-Governmental Organisations (NGOs). International Journal of Managing Projects in Business. 2019;12(2):487–511. https://doi.org/10.1108/ijmpb-04-2018-0085.
  24. 24. Gunawan AS, Fiarni C, Ryana Y. Design for Performance Monitoring System Using Earned Value Analysis Method for Nonprofit Organizations Case Study of Organization X, Indonesia. Riza LS, Pranolo A, Wibawa AP, Junaeti E, Wihardi Y, Hashim UR, et al., editors2017. 477–482.
  25. 25. Pape U, Brandsen T, Pahl JB, Pieliński B, Baturina D, Brookes N, et al. Changing Policy Environments in Europe and the Resilience of the Third Sector. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations. 2019;31(1):238–249. https://doi.org/10.1007/s11266-018-00087-z.
  26. 26. Egholm L, Heyse L, Mourey D. Civil Society Organizations: the Site of Legitimizing the Common Good—a Literature Review. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations. 2019;31(1):1–18. https://doi.org/10.1007/s11266-019-00171-y.
  27. 27. Pestoff Victor. Co-production and Third Sector Social Services in Europe: Some Concepts and Evidence. Voluntas International Journal of Voluntary & Nonprofit Organizations. 2012;23(4):1102–1118.
  28. 28. Osborne SP, Radnor Z, Strokosch K. CO-PRODUCTION AND THE CO-CREATION OF VALUE IN PUBLIC SERVICES A suitable case for treatment? Public Management Review. 2016;18(5):639–653. https://doi.org/10.1080/14719037.2015.1111927. WOS:000372108100001.
  29. 29. Ceptureanu S, Ceptureanu E, Bogdan V, Radulescu V. Sustainability Perceptions in Romanian Non-Profit Organizations: An Exploratory Study Using Success Factor Analysis. Sustainability. 2018;10(2):294. https://doi.org/10.3390/su10020294.
  30. 30. Lamboy-Ruiz MA, Cannon JN, Watanabe OV. Does State Community Benefits Regulation Influence Charity Care and Operational Efficiency in U.S. Non-profit Hospitals? Journal of Business Ethics. 2017;158(2):441–465. https://doi.org/10.1007/s10551-017-3757-2.
  31. 31. Zabolotnaya G, Larionov A. Arrangements for the Transfer of Social-Services Delivery to Non-Governmental Providers (Regional Practices, Russia). Nispacee Journal of Public Administration and Policy. 2019;12(2):251–274. https://doi.org/10.2478/nispa-2019-0022. WOS:000502563300011.
  32. 32. Ferreira MR, Carvalho A, Teixeira F. Non-Governmental Development Organizations (NGDO) Performance and Funds—A Case Study. Journal of Human Values. 2017;23(3):178–192. https://doi.org/10.1177/0971685817713279.
  33. 33. Yalegama S, Chileshe N, Ma T. Critical success factors for community-driven development projects: A Sri Lankan community perspective. International Journal of Project Management. 2016;34(4):643–659. https://doi.org/10.1016/j.ijproman.2016.02.006. WOS:000374708000007.
  34. 34. Kellner A, Townsend K, Wilkinson A. ‘The mission or the margin?’ A high-performance work system in a non-profit organisation. The International Journal of Human Resource Management. 2016;28(14):1938–1959. https://doi.org/10.1080/09585192.2015.1129636.
  35. 35. Guo C, Brown WA, Ashcraft RF, Yoshioka CF, Dong HKD. Strategic Human Resources Management in Nonprofit Organizations. Review of Public Personnel Administration. 2011;31(3):248–269. https://doi.org/10.1177/0734371x11402878. WOS:000294474600002.
  36. 36. Bris P, Patermann J, Cermakova M. Improvement of Quality Management and Performance of the Non-profit Organization Providing Social and Health Care. Ly PTM, Soukup J, Dao P, Tuan PM, editors2017. 399–416.
  37. 37. Hwang H, Powell WW. The Rationalization of Charity: The Influences of Professionalism in the Nonprofit Sector. Administrative Science Quarterly. 2009;54(2):268–298. https://doi.org/10.2189/asqu.2009.54.2.268. WOS:000268585600003.
  38. 38. Bititci US, Carrie AS, McDevitt L. Integrated performance measurement systems: a development guide. International journal of operations & production management. 1997;17(5):522–534. https://doi.org/10.1108/01443579710167230
  39. 39. Xiahou X, Tang Y, Yuan J, Chang T, Liu P, Li Q. Evaluating Social Performance of Construction Projects: An Empirical Study. Sustainability. 2018;10(7):2329.
  40. 40. Soysa I B, Jayamaha N, Grigg N P, et al. Operationalising performance measurement dimensions for the Australasian nonprofit healthcare sector[J]. The Tqm Journal, 2016, 28(6): 954–973.
  41. 41. Soysa IB, Jayamaha NP, Grigg NP. Developing a strategic performance scoring system for healthcare nonprofit organisations. Benchmarking: An International Journal. 2018;25(9):3654–3678. https://doi.org/10.1108/BIJ-02-2017-0026
  42. 42. Neely A, Gregory M, Platts K. Performance measurement system design: A literature review and research agenda. International journal of operations & production management. 2005;25(12):1228–1263.
  43. 43. Otley D. Performance management: a framework for management control systems research. Management accounting research. 1999;10(4):363–382.
  44. 44. van der Geer E, van Tuijl HF, Rutte CG. Performance management in healthcare: performance indicator development, task uncertainty, and types of performance indicators. Social science & medicine. 2009;69(10):320–350.
  45. 45. Pirozzi MG, Ferulano GP. Intellectual capital and performance measurement in healthcare organizations. Journal of Intellectual Capital. 2016;17(2):1523–1530.
  46. 46. Ryan A, Linden A, Maurer K, Werner R, Nallamothu B. Attribution methods and implications for measuring performance in healthcare. 2019.
  47. 47. Kennerley M. Indicators for measuring and managing performance. Higher Education Strategy and Planning: A Professional Guide. 2017:213.
  48. 48. Ritchie WJ, Kolodinsky RW. Nonprofit organization financial performance measurement: An evaluation of new and existing financial performance measures. Nonprofit Management and Leadership. 2003;13(4):367–381.
  49. 49. Sousa MJ, Pesqueira AM, Lemos C, Sousa M, Rocha Á. Decision-Making based on Big Data Analytics for People Management in Healthcare Organizations. Journal of medical systems. 2019;43(9):290%@ 0148–5598. pmid:31332535
  50. 50. Gunawan AS, Fiarni C, Ryana Y, editors. Design for performance monitoring system using earned value analysis method for nonprofit organizations case study of organization X, Indonesia. 2017 3rd International Conference on Science in Information Technology (ICSITech); 2017: IEEE.
  51. 51. yu Zang H, Wu C, editors. The Improved Performance Evaluation Model for Non-profit Organizations. International Conference on Advances in Education and Management; 2011: Springer.
  52. 52. Medina-Borja A, Triantis K. A conceptual framework to evaluate performance of non-profit social service organisations. International Journal of Technology Management. 2007;37(1–2):147–161.
  53. 53. Boland L, Légaré F, Perez MMB, Menear M, Garvelink MM, McIsaac DI, et al. Impact of home care versus alternative locations of care on elder health outcomes: an overview of systematic reviews. BMC geriatrics. 2017;17(1):20. pmid:28088166
  54. 54. Otay İ, Oztaysi B, Onar SC, Kahraman C. Multi-expert performance evaluation of healthcare institutions using an integrated intuitionistic fuzzy AHP&DEA methodology. Knowledge-Based Systems. 2017;133:90–106.
  55. 55. Li L, Yuan J, Roper KO, Zhou Z. A multi-stakeholder delphi study to determine key space management components for elderly facilities in China. Sustainability. 2017;9(9):1565.
  56. 56. Tromp N, Baltussen R. Mapping of multiple criteria for priority setting of health interventions: an aid for decision makers. BMC health services research. 2012;12(1):454%@ 1472–6963. pmid:23234463
  57. 57. Stuck AE, Egger M, Hammer A, Minder CE, Beck JC. Home visits to prevent nursing home admission and functional decline in elderly people: systematic review and meta-regression analysis. Jama. 2002;287(8):1022–1028. pmid:11866651
  58. 58. Kuo H-I, Hung J-Y, Yang C-H. How to Evaluate the Long-Term Care Agencies Performance? Advanced Science Letters. 2018;24(7):4782–4785.
  59. 59. Cooper WW, Seiford LM, Zhu J. Data envelopment analysis. Handbook on data envelopment analysis: Springer; 2004. p. 1–39.
  60. 60. Olesen OB, Petersen NC. Stochastic data envelopment analysis—A review. European Journal of Operational Research. 2016;251(1):2–21.
  61. 61. Min H, Ahn YH. Dynamic Benchmarking of Mass Transit Systems in the United States Using Data Envelopment Analysis and the Malmquist Productivity Index. Journal of Business Logistics. 2017;38(1):55–73.
  62. 62. Chen R. Application research of data envelopment analysis and multimedia information fusion algorithm in public performance management. Multimedia Tools and Applications. 2019:1–17.
  63. 63. Thanassoulis E, Dey PK, Petridis K, Goniadis I, Georgiou AC. Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis. Journal of the Operational Research Society. 2017;68(4):431–445.
  64. 64. Liwen H, Jian W. Practice and Policy Recommendations of Government Purchasing Elderly Care from the Perspective of Interaction between Government and the Public. Nanjing Journal of Social Sciences. 2016;(12):24.
  65. 65. Fang Y. A Research on Generational Differences of Elderly-care Concepts in Cities. Population and Society. 2017;(1):10.
  66. 66. Huang G. Functions, Problems and Countermeasures of China’s Rural Ecosystems. Journal of Landscape Research. 2019;11(5):62–69.
  67. 67. Stella E, Wibisono D, editors. Proposed Integrated Performance Management System for Ministry of Research, Technology, and Higher Education in Indonesia. 3rd International Seminar and Conference on Learning Organization; 2016: Atlantis Press.
  68. 68. O’Boyle I, Hassan D. Performance management and measurement in national-level non-profit sport organisations. European Sport Management Quarterly. 2014;14(3):299–314.
  69. 69. Zhao R, Zhou H, Zhu J. Status quo and needs analysis of health services among elderly urban residents in the developing and ageing Chongqing. INTERNATIONAL JOURNAL OF CLINICAL AND EXPERIMENTAL MEDICINE. 2019;12(10):12538–12544.
  70. 70. Ying L. The Enlightenment of the Home-based Elderly Care Mode in Foreign Countries. DEStech Transactions on Social Science, Education and Human Science. 2018;(emass).
  71. 71. Cao Y, You J, Shi Y, Hu W. Evaluating R&D and Transformation Functional Platforms’ Operational Performance Using a Data Envelopment Analysis Model: A Comparative Study. Sustainability. 2019;11(18):5023.
  72. 72. Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision making units. European journal of operational research. 1978;2(6):429–444.
  73. 73. Cook WD, Seiford LM. Data envelopment analysis (DEA)–Thirty years on. European journal of operational research. 2009;192(1):1–17.
  74. 74. Rödder W, Reucher E. Advanced X-efficiencies for CCR-and BCC-models–towards Peer-based DEA controlling. European Journal of Operational Research. 2012;219(2):467–476.
  75. 75. Tone K. A slacks-based measure of efficiency in data envelopment analysis. European journal of operational research. 2001;130(3):498–509.
  76. 76. Mcculloch A. Sensitivity Analysis in Practice: a Guide to Assessing Scientific Models. Journal of The Royal Statistical Society Series A-statistics in Society, 2005, 168(2): 466–466.
  77. 77. Kim H, Lee CW. Efficiency analysis for nonprofit organizations using DEA. Asia Pacific Journal of Innovation and Entrepreneurship. 2018.
  78. 78. Golden LL, Brockett PL, Betak JF, Smith KH, Cooper WW. Efficiency metrics for nonprofit marketing/fundraising and service provision-a DEA analysis. Journal of Management and Marketing Research. 2012;10:1.
  79. 79. Duan H. A survey of non-profit organizations evaluation methods. Asian Social Science. 2010;6(8):30.
  80. 80. Rouyendegh BD, Oztekin A, Ekong J, Dag A. Measuring the efficiency of hospitals: a fully-ranking DEA–FAHP approach. AnOR. 2019;278(1–2):361–378.
  81. 81. Shimshak DG, Lenard ML, Klimberg RK. Incorporating quality into data envelopment analysis of nursing home performance: A case study. Omega-International Journal of Management Science. 2009;37(3):672–685. WOS:000259851900017. pmid:20161166
  82. 82. Oh EG, Lee HJ, Kim Y, Park YS, Yoo JY, Woo S. Current Status of Home Visit Programs: Activities and Barriers of Home Care Nursing Services. Journal of Korean Academy of Nursing. 2015;45(5):742–751. WOS:000365453800012. pmid:26582119
  83. 83. Amirkhanyan AA, Meier KJ, O’Toole LJ, Dakhwe MA, Janzen S. Management and Performance in US Nursing Homes. Journal of Public Administration Research and Theory. 2018;28(1):33–49. https://doi.org/10.1093/jopart/mux003. WOS:000428114500003.
  84. 84. DeLellis NO, Ozcan YA. Quality outcomes among efficient and inefficient nursing homes: A national study. Health Care Management Review. 2013;38(2):156–165. WOS:000316000900007. pmid:22395294
  85. 85. Grabowski DC, Town RJ. Does Information Matter? Competition, Quality, and the Impact of Nursing Home Report Cards. Health Services Research. 2011;46(6):1698–1719. https://doi.org/10.1111/j.1475-6773.2011.01298.x. WOS:000297244000002.
  86. 86. Vongxaiburana E, Thomas KS, Frahm KA, Hyer K. The Social Worker in Interdisciplinary Care Planning. Clinical Gerontologist. 2011;34(5):367–378. https://doi.org/10.1080/07317115.2011.588540. WOS:000300002500003.
  87. 87. Vanderstichelen S, Cohen J, Van Wesemael Y, Deliens L, Chambaere K. Volunteer involvement in the organisation of palliative care: A survey study of the healthcare system in Flanders and Dutch-speaking Brussels, Belgium. Health & Social Care in the Community. 2019;27(2):459–471. WOS:000458580000019. pmid:30325557
  88. 88. Pawlak A. The quality of care provided in nursing homes for the elderly. Family Medicine and Primary Care Review. 2015;17(3):197–201. WOS:000216559600008.
  89. 89. Engle RL, Sullivan JL, Tyler D, Parker V, Lukas CV. TRAINING AND COACHING TO PROMOTE HIGH PERFORMANCE IN VA NURSING HOME CARE. Gerontologist. 2012;52:576. WOS:000312888204127.
  90. 90. Chao CY, Ku PY, Wang YT, Lin YH. The effects of job satisfaction and ethical climate on service quality in elderly care: the case of Taiwan. Total Quality Management & Business Excellence. 2016;27(3–4):339–352. https://doi.org/10.1080/14783363.2014.982893. WOS:000371809500008.
  91. 91. Subasi F, Hayran O. Evaluation of life satisfaction index of the elderly people living in nursing homes. Archives of Gerontology and Geriatrics. 2005;41(1):23–29. WOS:000229853300003. pmid:15911035
  92. 92. Stevenson DG. Nursing home consumer complaints and quality of care: A national view. Medical Care Research and Review. 2006;63(3):347–368. WOS:000237944600004. pmid:16651397
  93. 93. Desai VM. Ignorance Isn’t Bliss: Complaint Experience and Organizational Learning in the California Nursing Home Industry, 1997–2004. British Journal of Management. 2010;21(4):829–842. https://doi.org/10.1111/j.1467-8551.2009.00685.x. WOS:000284066800002.
  94. 94. Nelson EC, Batalden PB, Huber TP, Mohr JJ, Godfrey MM, Headrick LA, et al. Microsystems in health care: Part 1. Learning from high-performing front-line clinical units. The Joint Commission journal on quality improvement. 2002;28(9):472–493. pmid:12216343
  95. 95. Cole KD, Waite MS, Nichols LO. Organizational structure, team process, and future directions of interprofessional health care teams. Gerontology & geriatrics education. 2004;24(2):35–49.
  96. 96. Wang H. Research on Aging of Population and the Sustainable Development. Asian Social Science. 2010;6(12):206.
  97. 97. Yan J. The Realistic Predicament and Coping Strategies for the Improvement of China’s Healthy Old-age Service System. 2019.
  98. 98. Leibkuechler P. Trust in the Digital Age—The Case of the Chinese Social Credit System. Redesigning Organizations. Springer, Cham, 2020: 279–289.
  99. 99. Aktas A, Cebi S, Temiz I. A new evaluation model for service quality of health care systems based on AHP and information axiom. Journal of Intelligent & Fuzzy Systems. 2015;28(3):1009–1021.
  100. 100. Tynkkynen L-K, Lehto J, Miettinen S. Framing the decision to contract out elderly care and primary health care services–perspectives of local level politicians and civil servants in Finland. BMC Health Services Research. 2012;12(1):201. pmid:22805167
  101. 101. Bouwman R, Bomhoff M, Robben P, et al. Classifying Patients’ Complaints for Regulatory Purposes: A Pilot Study. Journal of Patient Safety, 2016. pmid:27906817
  102. 102. Mack JW, Jacobson J, Frank D, Cronin AM, Horvath K, Allen V, et al. Evaluation of patient and family outpatient complaints as a strategy to prioritize efforts to improve cancer care delivery. The Joint Commission Journal on Quality and Patient Safety. 2017;43(10):498–507. pmid:28942774
  103. 103. Golany B, Roll Y. AN APPLICATION PROCEDURE FOR DEA. Omega-International Journal of Management Science. 1989;17(3):237–250. https://doi.org/10.1016/0305-0483(89)90029-7. WOS:A1989U711000005.
  104. 104. Mardani A, Zavadskas EK, Streimikiene D, Jusoh A, Khoshnoudi M. A comprehensive review of data envelopment analysis (DEA) approach in energy efficiency. Renew Sust Energ Rev. 2017;70:1298–1322. https://doi.org/10.1016/j.rser.2016.12.030. WOS:000396184900103.
  105. 105. Huang LZ, Zhang BX. The analysis and demonstration of value engineering about the performance of science & technology inputs of local government. Shuhua H, Qingguo M, Thjota H, editors. Wuhan: Hubei Peoples Press; 2007. 52–58.