Next Article in Journal
A Parametric Approach for Conceptual Integration and Performance Studies of Liquid Hydrogen Short–Medium Range Aircraft
Previous Article in Journal
Development and Assessment of an Intelligent Compaction System for Compaction Quality Monitoring, Assurance, and Management
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Forecasting the Future Excellence: 30 Years of Evaluating Service Organizations in Slovakia

by
Kristina Zgodavova
1,*,
Peter Bober
2,
Nataša Urbančíková
3,
Gilberto Santos
4 and
Andrea Sütőová
1
1
Institute of Materials and Quality Engineering, Faculty of Materials, Metallurgy and Recycling, Technical University of Košice, Letná 9, 04200 Košice, Slovakia
2
Faculty of Electrical Engineering and Informatics, Technical University of Košice, Letná 9, 04200 Košice, Slovakia
3
Faculty of Economics, Technical University of Košice, Letná 9, 04200 Košice, Slovakia
4
Design School of Polytechnic Institute of Cávado and Ave (IPCA), 4750-810 Barcelos, Portugal
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(14), 6856; https://doi.org/10.3390/app12146856
Submission received: 14 June 2022 / Revised: 30 June 2022 / Accepted: 5 July 2022 / Published: 6 July 2022

Abstract

:
The aim of this paper is to model and interpret the results obtained from the assessment of the Level of Excellence of Slovak service organizations using the criteria of the European Foundation for Quality Management (EFQM) excellence model. The Gompertz logistic function is effectively employed to fit the incremental improvement and predict the values of future Levels of Excellence. The EFQM model is usually used to improve organizational development and performance. The study focuses on the problem of the slow growth or even stagnation of Slovak service organizations towards Excellence. The questionnaire method was used to assess the Level of Excellence of the selected organizations, and the approach of measuring efficiency as a ratio of results and enablers was used to evaluate the organization’s ability to transform inputs into outputs. Data were collected from 30 service organizations over a period of 20 years. The first finding of the study is the demonstration of the applicability of the Gompertz function to model the evolution of the Level of Excellence. The accuracy of the model is very high, and this predisposes this function to be used to forecast the scores of organizations over time. Examining efficiency yielded a second finding, that organizations were failing to capitalize on the effort put into translating it into results. After the first few years of growth, efficiency stagnates and then even declines. This suggests that the application of the original EFQM excellence model has reached the end of its ability to improve the effectiveness of organizations as a whole. Individual firms may have been growing or declining, but the average service score across the country had no longer the capacity to improve anymore.

1. Introduction

Services are playing an increasingly important role in the national economy. They are already often the largest source of employment and job creation [1]. Transport services, tourism, energy services, and knowledge and information services have gradually replaced declining employment in industry and agriculture in developed countries. Services such as electronic banking, telecommunications companies’ voice services, and postal services, which were previously considered “domestic”, have become internationally tradable. Services account for more than two-thirds of the world’s gross domestic product (GDP) and are the fastest growing sector [2]. The share of services in GDP is estimated to be 65% globally, with the EU-28 accounting for 66.7% in 2020. Western European countries in particular have a higher share [2,3].
Slovakia is a country with a relatively high share of industrial employment in the European Union, mainly due to the production of vehicles. However, the service sector accounts for more than 60 percent of Slovakia’s total GDP [4,5]. Services in Slovakia are dominated by trade and real estate, and dynamic development is in tourism, weakened by the COVID-19 pandemic. Public services, professional and support services, and ICT (information and communication technology) services are the next in terms of importance and size. As the country’s industry is driven by the automotive and electronics sectors, domestically owned advanced exportable services deserve considerable policy attention as they could significantly help the economy grow.
Hence, service organizations are challenged to develop, improve, and innovate in the face of the global competitive environment [6]. One tool that can help them is the European Foundation for Quality Management (EFQM) Excellence model that employs the principle of self-assessment. This model is the most widely used tool for improving organizations in Europe and according to [7] is used by more than 50,000 organizations regardless of size or type [8]. Excellence is considered the highest level of quality and is the result of quality development efforts [9].
The score obtained from the self-assessment shows the level of maturity of the organization in various areas and allows for predicting the organization’s performance [10,11]. Some literature sources have tested the possibility of modeling the evolution of scores over time using the Gompertz function [12,13]. In this context, this study aims to answer the following questions:
  • Could the Gompertz function be used to predict the Level of Excellence of service organizations?
  • To what extent are organizations able to transform enablers (what the organization does) into results (what the organization achieves) and improve the Level of Excellence?

2. Theoretical Framework

2.1. EFQM Excellence Model

The EFQM foundation was founded in 1989, and the first version of the EFQM Excellence model was created by a group of experts from various sectors and academic institutions and launched in 1992 [14]. This model provides the basis for awarding the European Quality Award (EQA) by the EFQM foundation to organizations that are the best examples of the Total Quality Management (TQM) in Europe.
The EFQM Excellence model can be used to identify how the various activities of an organization need to be coordinated to achieve the desired result. The basic principle of the model is self-assessment which consists of comprehensive, systematic, and regular reviews of the organization’s activities and results that support the organization to achieve its desired goals [15]. The EFQM suggests a number of approaches for implementing the EFQM excellence model self-assessment (i.e., questionnaire, matrix chart, workshop, and pro-forma and award simulation) [16]. A self-assessment score (0–1000) ranks organizations in five levels of maturity [17]: starting (0–150)—early stage of developing and effectively run organization; progress (151–300)—some good practices but not an organization-wide cohesive approach and results moderate or not known in some areas; mature (301–450)—good results in most areas but innovation/industry leadership is lacking, strategies, systems, and people are not fully benchmarked and/or systematically improved; advanced (451–700)—an industry leader with strong results in comparison to benchmarks, and effective strategies, systems, and people in most areas; and world-class (701–1000)—supported by highly effective strategies, systems, and people.
The EFQM Excellence model is driven by the cause-and-effect relationships between the enablers (what the organization does) and results (what the organization achieves) [17]. The enablers consist of the following criteria: 1. leadership (maximum score 100), 2. strategy (maximum score 80), 3. people (maximum score 90), 4. partnership and resources (maximum score 90), and 5. processes (maximum score 140). The results are: 6. customer results (maximum score 200), 7. people results (maximum score 90), 8. society results (maximum score 60), and 9. key performance results (maximum score 150). The maximum score of the criteria represents its weight in the assessment.
The underlying principle of the model is adding value for customers. The model also includes the RADAR dynamic assessment framework that takes into account the aspects of results, approach, deployment, and assessment and review. Thus, RADAR provides a multidimensional structured approach to validating organizational performance. Following the RADAR rationale, an organization needs to define at the highest level the outcomes it intends to achieve as part of its strategy. Accordingly, it is clear that managers should reflect on what aims they want to reach within the organization, at both strategic and tactical levels. The setting of objectives should enable clear and focused measures capable of achieving the expected results in the organization when they are implemented.
This simple but sophisticated and important logic provides a framework for effective planning—strategic and tactical—as well as for evaluating organizational performance [18,19].
The model was successively revised in 2000, 2010, and 2020. Although revisions were made, the overall structure of the model and the purpose of use remained the same until 2019. The first revision mainly brought a change in that organizations could choose the percentage weightings of the criteria according to their strategy. The revision in 2010 partly changed the naming of Criteria 5, processes, products, and service; and 9, business results; and also clarified the content of the sub-criteria. In addition, “Fundamental Concepts of Excellence” was amended, containing eight principles: adding value for customers; creating a sustainable future; developing organizational capability; harnessing creativity and innovation; leading with vision; inspiration and integrity; managing with agility; succeeding through the talent of people; and sustaining outstanding results [20].
The latest revision of the EFQM model is valid from 2020. The new model, created using the “Design Thinking” methodology, has changed from a simple self-assessment tool to a tool that also includes a transformation methodology [21]. A comparison of the EFQM 2020 model with the previous version of 2013 can be found in [22,23,24]. The impact of the EFQM model on quality development in Europe has been very significant in recent years and has become the standard model for many national quality award schemes in European countries and has reached beyond Europe to the Middle East, Asia, South America, and South Africa [7]. Top performing European organizations also score above 700 in services [18,25].
Potential limitations in the use of excellence models, according to [16], may be a lack of understanding of the meaning and potential benefits of self-assessment for the organization, overly complex evaluation criteria, excessive paperwork, cumbersome procedures, and inadequate infrastructure.

2.2. Questionnaire Method

The EFQM Excellence model suggests five possible self-assessment methods: questionnaire, matrix, workshop, pro-forma, and award simulation. Experts agree that the decision about which self-assessment technique to choose depends on the culture of the organization, complexity of operations, levels of staffing, etc. [26]. As self-assessment was not a standard part of the processes in service organizations at the beginning of our research, a straightforward questionnaire method was chosen. The questionnaire survey is aimed at obtaining the opinions of managers and other employees of the organization about the Level of Excellence according to the respective criteria of the EFQM model. Training of both management and staff is required prior to the use of the questionnaire [7]. The advantages of this approach are its relatively fast and easy application, its possibility to involve all people in the organization, its support for communication efforts, but also the possibility to use it in conjunction with other self-assessment methods. A related risk is that respondents’ views on strengths and areas for improvement cannot be directly ascertained. The accuracy of the self-assessment depends on the understanding of the questions, may be influenced by the subjective opinion of the respondents or even by efforts to manipulate the result, and fatigue may occur when completing the questionnaire. Support from the organizers is essential to obtain valid responses [27]. The results of the application of the EFQM model of self-assessment using a questionnaire approach in services are presented, for example, in [28,29,30,31,32,33].

2.3. Gompertz Function

Growth S-curve models with the Gompertz function have been used to predict performance in various fields of applied research, and originally Gompertz used it in the biological field to specify mortality law and life span [34]. In marketing, the Gompertz function has been used to model new product sales and predict market growth [35,36,37]. Other applications have been in management [38] and economics [39]. A group of S-curves is primarily used to visualize the progress of a measured parameter over time, which resembles the shape of the letter S. Growth is rapid at the beginning but gradually slows towards its perceived limit of improvement. The logistic curve is used to show a symmetrical progression. However, in the case of measuring excellence, there is an obvious asymmetry of development, which corresponds to the employment of the Gompertz curve [40].
Despite their limitations, S-curves have also been extensively used in technology management to model technology performance limits [12]. Mlčoch and Slimák used the Gompertz function for the evaluation of the bearings’ quality [41], and Zgodavová & Slimák used it for the evaluation of the production quality in general [13]. The Gompertz model also appeared in the work of [12] as a benchmarking and self-assessment tool and a piecewise regression model for sustainable business excellence. In a study [11], the possibility of applying the Gompertz model to predict the growth of integrated management system implementation in organizations is presented.
Gompertz’s model was formulated as a solution to a differential equation that assumes that the population growth rate is a function of the logarithm of the saturation limit [42]. Although the Gompertz curve is similar to the simple logistic curve, it is not symmetric concerning its inflection point. The inflection point for the Gompertz model is approximately at 37% of the long-term saturation levels [43]. Several different re-parameterizations of the traditional cumulative Gompertz model exist [37,44]. One of them is given by Equation (1).
Y ( t ) = a e e ( k ( t T i ) )
where t denotes time, a is an asymptote (saturation level), e is Euler’s number, k is a growth-rate coefficient, and Ti represents a time at an inflection point where the speed of growth is maximal. The Ti parameter shifts the growth curve horizontally without changing its shape (allocation parameter), whereas a and k are shape parameters that affect curve shape [44,45].
One special parameter b was added to Equation (1) that represents the entry level of the s-shaped evolution step. This parameter shifts the curve vertically. The final saturation level is the sum of b and original Gompertz curve saturation a. This modification reflects the fact that the entry level of the EFQM Excellence model score is higher than zero [46]. Hence, the modified equation is as follows (2):
Y ( t ) = b + a e e ( k ( t T i ) )

3. Methodology

3.1. Context of the Study

The starting point of the research was the EFQM Excellence Model and the history of the National Quality Award of the Slovak Republic (NQA SR). One of the preconditions for the accession of the Slovak Republic to the European Union was also the implementation of the document adopted by the Council of EU ministers about the “European Quality Promotion Policy” of 1994. The European Commission required the drafting of National Quality Programmes by each member state in the Union. The government of the Slovak Republic, as one of the few associated countries, passed Resolution No. 673/1998, declaring the National Quality Programme of the Slovak Republic (NQA SR) until 2003. This program also included the declaration of 2000 to be the Year of Quality and the implementation of NQA SR as one of the top priorities of the program [28]. The government of the Slovak Republic continues to pursue this program and passed further resolutions related to the NQA SR in 2004–2008, 2009–2012, and 2013–2016. The National Quality Award of the Slovak Republic is the most prestigious quality award for the Slovak organizations. Thus, NQA is the highest award to be gained nationally, ultimately enabling the winner to gain national recognition amongst competitors in terms of quality management [4].
Slovakia officially launched awarding prizes in several categories, including services, in 2000. In the same year, the data collection for this study also started; therefore, the whole evolution of the EFQM application is available from the very beginning. Due to the COVID-19 pandemic situation, the NQA SR was not held in 2019 and 2020. Our research team applied the EFQM model to assess the Level of Excellence in 30 selected Slovak service organizations, which we tracked over 20 years using the Self-Assessment for Quality Improvement (SAQI) software tool we developed for data collection. The purpose of the software tool was to overcome some cumbersome procedures when collecting data.

3.2. Sample and Data Collection

The sample of organizations is representative of the types of services, and contacts were made at themed exhibitions where our team worked to evaluate and award the best service providers. The survey population consisted of 30 service organizations that had undergone self-assessment over a 20-year period following the EFQM Excellence criteria. The survey included service providers in the energy, food service, hospitality, information and communications technology, healthcare, and education sectors of varying sizes. Some of the surveyed organizations participated in the competition for the National Quality Award of the Slovak Republic.
Firms were motivated to be involved in the longitudinal quality assessment because of the opportunity to benchmark themselves and to win a national quality award in the service category. If a firm was dissolved or lost interest, it was replaced by a firm with a comparable profile by industry and size. Accordingly, the results of the self-assessment are reliable and valid sources of information due to the training, specialization, and qualifications of the interviewers involved in the process.
The data were collected using specialized software that allowed longitudinal historical data collection, analysis, and evaluation of the obtained data. The software also included educational material used to provide training to those conducting the self-assessment. We first tested the questionnaire on a pilot sample of 10 respondents and, after modification, used it for self-assessment in organizations. After the update of the EFQM Excellence Model in 2010, we refined the questions on Criteria 5 and 9 in the questionnaire. Subsequently, we tested it again to maintain the continuity of the assessment. From 2000 to 2019, 600 assessment reports with complete and valid results were collected.

3.3. Measures

The score was measured using indicators from 32 sub-criteria grouped to 9 criteria of the EFQM Excellence Model (Appendix A, Table A1). The measurement scales of the RADAR scoring matrices were used for all sub-criteria to obtain the scores for each indicator. Appendix B, Table A2 and Table A3 show the RADAR matrix for enablers and for results, respectively. The score for each criterion is the product of the average of the sub-criteria scores and the criterion weight. The total score represents the sum of enablers and results (Appendix C, Table A4).

3.4. Data Analysis

This study applied the graphical presentation of the data and the Gompertz function to interpret the results and predict the trend toward excellence. The Gompertz function parameters were calculated by the trust-region algorithm for curve fitting, and the model precision is assessed by the calculation of the adjusted coefficient of determination [37]. The ability to convert enablers into results was investigated using the efficiency indicator (EFF) [47], which is defined by the Formula (3).
EFF = Value   of   Output   ( Results ) Value   of   Input   ( Enablers )

4. Results and Discussion

Figure 1 shows the average score of the 30 service organizations assessed according to the EFQM Excellence model criteria for the three time periods with the fitted Gompertz function.
The years 2000–2006 saw a sharp improvement in the score; 2007–2012 was a period of slight deterioration after the onset of the global financial crisis, followed by a period of new growth due to the recovery. The years 2013–2019 were a period of stagnation. In the first period, both enablers and results were still growing. The next period, marked by the economic crisis of 2008–2009, saw enablers growing but results declining. In the last period, both enablers and results stagnated. The model’s ability to stimulate growth has been exhausted.

4.1. Using Gompertz function for the Service Organizations Level of Excellence Forecasting

The Gompertz function proved to be a suitable model to describe the existing evolution of the Level of Excellence according to the EFQM Excellence model; the accuracy of the model is very high. The value of the adjusted coefficient of determination R2adj is 0.9907 (recalculated from initial value b = 142.04) proves the high explanatory power of the Gompertz trend. To validate the suitability of this model for forecasting, we use data from the early years retrospectively to build the model and check the forecast against reality in subsequent years (Figure 2).
Figure 2 illustrates the ability of the Gompertz function to predict the future Level of Excellence. Data from three years 2000–2002 were sufficient enough to reliably predict the saturation four years later. However, we assume that the achievement of high forecasting accuracy was reached due to the circumstances:
  • The first three years covered the informative period before and after the maximum growth (inflection point of the Gompertz curve).
  • The average of 30 companies filtered out random deviations and exploited the validity of “Central Limit Theorem” known from statistics.
  • No extreme events occur in the next four years that would invalidate the forecast.
Estimation of the four unknown parameters of the Gompertz function requires four independent equations: the input of four data points. In Figure 2, we use three data points and the entry score level b was set to a value of 160 by an educated guess from prior knowledge. The deviation of the predicted value from the actual one was 1.51% in 2006. The variation of b in a range between 140 and 190 changes the deviation from 4.90% to −5.97%. Using four data points from 2000 to 2003 leads to a deviation of 3.7%. This shows that the forecasting model can tolerate imprecision of an educated guess, and three years of measurement should be enough to forecast the score saturation in four years. The overview of four Gompertz functions parameters and score deviations are in Table 1.

4.2. The Ability of Service Organizations to Transform Enablers into Outputs

A detailed view of the flow and internal structure of enablers and results is shown in the Figure 3a,b. The Figure shows the average level of individual enablers sub-criteria (a) and results sub-criteria (b).
In the first onset period, all criteria in enablers grew because the EFQM approach represented a new perspective on the functioning of emerging service companies and had the ability to discover large gaps in strategy, leadership, processes, etc. In the second period, firms were under pressure from the global crisis, which was most evident in the short-term decline in Criterion 3 (people), but then it rose back by leaps and bounds after the crisis. Criteria 1 (leadership), 2 (strategy) and 4 (sources and partnership) continued to grow but only slowly. Criterion 5 (processes, product and services) had previously differed from the others by substantially higher values, but in the second period, they were the most affected by the crisis, and its performance was declining for the longer period. In the third period, after recovering from the crisis, the relationships between the criteria bounced back. Only Criterion 5 (processes, product and services) increased and reached the pre-crisis level and was able to slowly grow. Again, it deviated higher from the other criteria related to strategy, leadership, or people. However, all the other four criteria hit their natural limits and arrived at stagnation or even weakened, with a lack of capacity for future improvement.
Results of Criterion 6 (customer results) gradually grew during the first period, but in the second period, there was more or less stagnation, and the criterion declined in the third period. Criterion 7 (people results) grew sharply in the first period, declined sharply in the second period after the economic crisis, and started to grow slowly in the third period. Criterion 8 (society results) gradually grew, declined slightly in the second period, and grew very slowly in the third period. Finally, Criterion 9 (business results) grew sharply and reached saturation in the first phase, declined slightly after the crisis, and then cycled up and down.
The relationship between results and enablers is presented as the efficiency according to Equation (3) in Figure 4a, and as a scatterplot in Figure 4b for the three time periods. Figure 4a additionally contains the historical evolution of real GDP per capita [48] and the employment rate [49].
Efficiency grew sharply at the beginning of the first period showing positive effect of the EFQM but then began to stagnate. In the second period, the crisis manifested itself in a decline, and in the third period, efficiency became stagnant again. The scatterplot in Figure 4b reflects the correlation between the values of results and enablers. In the first period, there is a positive correlation, when enablers increase, so do results. The second and third periods show a negative correlation, i.e., despite increasing enablers, results are decreasing. Finally, in the third period, results fall more sharply as enablers rise than in the second period, as is evident from the coefficients of the regression lines in Figure 4b.
The period up to 2000 is characterized by a turbulent transition from a centrally controlled national economy to a market economy. The year 2000 was declared the Year of Quality in Slovakia, and the awarding of the National Quality Award [4] was launched in line with the EFQM model of excellence. A large group of companies, after media coverage and extensive training, started to use this tool for their improvement. In addition, the Service Quality Award was first awarded in 2000. Hence, there is a sharp growth in efficiency in 2001–2002 against the backdrop of economic recovery and rising real GDP per capita in the country. Service organizations were able to learn and make intensive use of their enablers to promote results. This fact is confirmed by the positive correlation evident in Figure 4b. However, in the following years, the growth of efficiency stalled despite the continued growth of GDP. We conclude that the potential of the EFQM tool has been depleted under the given conditions.
Although in the second reporting period the overall EFQM score remained approximately at the same level, efficiency dropped significantly. The economic crisis in 2008–2009 meant that the ability to convert enablers into results declined and has not bounced back to the 2007 level. GDP has also fallen in line with this, and its growth has stalled. Two years after the crisis, the employment rate also slumped and only started to grow in 2014. Between 2007 and 2012, a number of foreign companies came to Slovakia, bringing a new corporate culture to service organizations as well. In the meantime, many organizations have also introduced an ISO 9001 quality management system and Six Sigma methodology [50,51], and some an ISO 14001:2015 environmental management system. Several organizations have started to apply for the Quality Award for Services [4]. This situation was also reflected in the growth of the scores: 1. leadership, 2. strategy, 3. people, and 4. partnership and resources according to Figure 3a. However, the increase in enablers and especially investing in 3. people, was not reflected at all in results. On the contrary, Criteria 7. people results, with the sub-criteria perception measure and performance and 8. society results, declined. The crisis brought a loss of perspective and motivation for personal improvement and social security (employment declined). The consequence, especially in the field of health and social services, has been a move abroad, and the costs spent on education have not been recouped.
The situation in efficiency did not change significantly in the third period either; the correlation between enablers and results was negative in both periods as shown in Figure 4b. In 2015, there were some clear signs of accelerated economic growth and improvement in the parameters of macro-economic stability or socio-economic parameters. Although both GDP and employment grew and overall social conditions improved, the ability to convert enablers into results has been lost. One reason for this could be that catching up with the most advanced economies represented by the former EU-15 has slowed down [36]. Another reason is that economic migration continued during this period.
The analysis and discussion show that the EFQM excellence model has definitely exhausted its ability to improve the efficiency of the organization. Individual firms may were growing or declining, but the average score in services in Slovakia was not improving and did not reach the total score comparable to other European countries, e.g., Germany. There, healthcare organization efficiency was 0.81 [52], while efficiency in Spain was about 0.71 [53,54]. The observed firms tried to leverage enablers but lacked the ability to drive outcomes, thus demonstrating a low ability to innovate and be competitive.
For comparison, we also present the EFF indicators of the EFQM Global Excellence Award (GEEA) applicants and the National Quality Award of the Slovak Republic (NQA SR) applicants for 2016 and 2019. We calculated efficiency according to Formula (3) as the average of all categories. GEEA applicants score at the advanced level (451–700), and NQA SR applicants score at the mature level (301–450). In both cases, the award simulation approach was used in the evaluation.
Efficiency for GEEA according to [55] in 2016 was 0.88 and in 2017 was 0.75, while the average total score in 2016 was 653 and in 2017 was 692. Efficiency for NQA SR candidates in 2016 was 0.81 and in 2017 was 0.73. The average total score in 2016 was 417 and in 2017 was 377.

5. Conclusions

The EFQM model enables self-assessment across multiple criteria and provides an opportunity to become aware of the functioning of service organizations in terms of effectiveness. The survey carried out in Slovakia suggests that there is a lack of sufficient systemic insight across their organizational levels and an understanding of mechanisms and linkages. Moreover, the EFQM model itself is being transformed into a new systems approach that facilitates a better awareness of inter-relationships within the system and with its environment. It remains an open question for further study as to how organizations will be able to adopt the systems approach in self-evaluation and use it to the benefit of enhancing excellence.
The results of the study demonstrated two main findings:
  • The Gompertz function has confirmed its ability to describe the evolution and predict the Level of Excellence scores in the service organization segment in Slovakia over 20 years.
  • The firms’ overall scores were close to their limit and could not move further up without creative destruction. However, the price at which firms were able to maintain their overall score—through higher investment in enablers—is also important. However, even though the enablers’ benchmarks were raised proactively, they did not result in improved scores but instead in a slight decline. The trend in the efficiency of service businesses has reversed, and the predicted results have ceased to be achieved.
Modelling with a Gompertz curve has been confirmed as appropriate; the value of the adjusted coefficient of determination R2adj is 0.9907, which corresponds to the high accuracy of the model. The average of 30 companies had the ability to filter out random deviations and showed effects of the Central Limit Theorem for sufficient sample sizes. Therefore, the Gompertz function can be used for predicting scores of organizations over time. Even scores from three or four years are sufficient to predict for the next few years. The curve has a fast-rising slope in the first phase, which gradually slows down in growth. Therefore, the use of the Gompertz trend was particularly suitable in the situation of Slovakia, when the EFQM framework was only being introduced, and companies had large margins and thus the ability to grow rapidly in the criteria monitored.
The second finding relates to the efficiency of organizations that have failed to capitalize on the efforts made to translate it into results towards the end of the observed period. After the first years of growth, efficiency experiences stagnation and even subsequent decline. This implies that the EFQM Excellence model in use has lost its capacity to improve efficiency. This negative trend of efficiency can eventually be overcome by changing the evaluation model; therefore further research will continue based on the new FQM Excellence Model [14] which is challenging organizations to build a new culture and improve their performance. Slovak service companies achieved particularly low societal results, which indicate too strong a focus on the company. Indeed, the typical culture of companies is too results-oriented and underestimates societal outcomes, focusing on improving the whole of society. In this case, however, it is necessary to achieve a cultural change in the view of entrepreneurship, which is certainly not easy and requires a longer period of time to deploy a new framework.
Possible limitations of these study results may be affected by the evaluators’ own perception of the Level of Excellence.

Author Contributions

Conceptualization, K.Z.; methodology, K.Z., P.B.; software, P.B.; validation, N.U., G.S.; formal analysis, N.U.; investigation, K.Z.; resources, N.U., G.S., A.S.; data curation, K.Z., N.U.; writing—original draft preparation, K.Z.; visualization, P.B.; project administration, K.Z.; funding acquisition, K.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the MINISTERSTVO ŠKOLSTVA, VEDY, VÝSKUMU A ŠPORTU SLOVENSKEJ REPUBLIKY, Grant No. KEGA 018TUKE-4/2022 Creation of new study materials, including an interactive multimedia university textbook for computer-aided engineering activities and VEGA 1/0633/20 Research of the variability of properties and functions of products made of composite materials produced by additive manufacturing.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. EFQM Excellence Model criteria and sub-criteria.
Table A1. EFQM Excellence Model criteria and sub-criteria.
NoCriteria Subcriteria
Enablers1Leadership1a How leaders develop the mission, vision, and values and are role models for a culture of excellence in the organization
1b How leaders are personally involved in ensuring the organization’s management system is developed, implemented, and continuously improved
1c How leaders are involved with customers, partners, and representatives of society
1d How leaders motivate, support, and recognize the organization’s people
2Strategy2a How policy and strategy are based on the present and future needs and expectations of stakeholders
2b How policy and strategy are based on information from performance measurement, research, learning, and creativity-related activities.
2c How policy and strategy are developed, reviewed, and updated
2d How policy and strategy are deployed through a framework of key processes
2e How policy and strategy are communicated and implemented
3People3a Human resources plan
3b People’s capabilities
3c Empowerment
3d Communication
3e Reward and recognition
4Partnerships & Resources4a Partnerships
4b Technological support for processes
4c Sustainability
4d Technology
4e Knowledge sharing
5Process, Products & Services5a Management and improvement of key processes
5b Innovation
5c Marketing and promotion
5d Production/delivery/service
5e Relationship management
Results6Customer results6a Perception Measures
6b Performance Indicators
7People results7a Perception Measures
7b Performance Indicators
8Society results8a Perception Measures
8b Performance Indicators
9Business results9a Key Performance Outcomes
9b Key Performance Indicators

Appendix B

Table A2. RADAR scoring matrix for enablers.
Table A2. RADAR scoring matrix for enablers.
RADAR ElementAttributeMeasurement Scale
0%25%50%75%100%
Approach Sound:
Approach has a clear rationale
Approach has a defined processes
Approach focuses on stakeholder needs
Integrated: Approach is linked with other approaches as appropriate; Approach supports policy and strategy.
DeploymentImplemented: Approach is implemented.
Systematic: Approach is deployed in a structured way with the method used for deployment being planned and executed soundly.
Assessment and ReviewMeasurement: Regular measurement of the effectiveness of the deployment is carried out; Measures selected are appropriate.
Learning is used to: Identify best practice and improvement opportunities.
Improvement: Output from measurement and learning is analyzed and used to identify, prioritize, plan, and implement improvements.
0%—no evidence or anecdotal; 25%—some evidence; 50%—Evidence; 75%—Clear evidence; 100%—Comprehensive evidence.
Table A3. RADAR scoring matrix for results.
Table A3. RADAR scoring matrix for results.
RADAR
Element
AttributeMeasurement Scale
0%25%50%75%100%
ResultTrends: Trends are positive and good performance continues.
Objectives: Objectives are agreed and are reasonable.
Benchmarking: Results are reported.
Causes: Results are achieved through approaches.
Scope: Results are achieved in relevant areas.

Appendix C

Table A4. Measured scores, calculated Efficiency, and Gompertz function values.
Table A4. Measured scores, calculated Efficiency, and Gompertz function values.
CriterionEnablers (EN)Results (RE) Efficiency
1.2.3.4.5.EN Sum6.7.8.9.RE SumTotal ScoreEFF = RE/ENGompertz Function
YearScore
200030272020501471551020501970.34196.66
20013332302655176282015451082840.61285.66
20023531302861185375524531693540.92352.50
20033835343860205445325651873920.91386.82
20043835304262207455028661893960.91401.88
20053935294558206495430672004060.97408.09
20064036304463213505225651924050.90410.58
20074035254065205486025682014060.98411.57
20084035254265207486025661994060.96411.97
20094038414461224494720621784020.80412.12
20104239424562230485019631804100.78412.18
20114343404761234524022651794130.76412.21
20124547424356233534220681834160.79412.22
20134542444959239494223661804190.75412.22
20144645404658235524422591774120.75412.22
20154646414858239484523611774160.74412.22
20164343404460230494822671864160.81412.22
20174643424262235504723621824170.77412.22
20184543434164236414824641774130.75412.22
20194443404266235524624631854200.79412.22

References

  1. Titko, J.; Lace, N.; Kozlovskis, K. Service quality in banking: Developing and testing measurement instrument with Latvian sample data. Acta Univ. Agric. Silvic. Mendel. Brun. 2013, 61, 507–515. [Google Scholar] [CrossRef] [Green Version]
  2. WTO. World Trade Report 2019. Available online: https://www.wto.org/english/res_e/booksp_e/00_wtr19_e.pdf (accessed on 5 December 2019).
  3. The World Bank. The World Bank. Available online: https://data.worldbank.org/indicator/NV.SRV.TOTL.ZS?locations=XC-SK (accessed on 10 May 2021).
  4. Jurkovičová, M.; Kašubová, K. 12 years of the National Quality Award of the Slovak Republic. Qual. Innov. Prosper. 2012, 16, 1–17. [Google Scholar] [CrossRef] [Green Version]
  5. Statistica. Slovakia: Distribution of Gross Domestic Product (GDP) across Economic Sectors from 2010 to 2020. Available online: https://www.statista.com/statistics/375606/slovakia-gdp-distribution-across-economic-sectors/ (accessed on 12 December 2021).
  6. Marinho, A.; Silva, R.; Santos, G. Why Most University-Industry Partnerships Fail to Endure and How to Create Value and Gain Competitive Advantage through Collaboration—A Systematic Review. Qual. Innov. Prosper. 2020, 24, 34–50. [Google Scholar] [CrossRef]
  7. EFQM. 25 Years of the EFQM Model Excellence. Available online: https://efqm-rus.ru/docs/articles/25_years_of_the_EFQM_Excellence_Model.pdf (accessed on 12 September 2016).
  8. Gouthier, M.; Giese, A.; Bartl, C. Service excellence models: A critical discussion and comparison. Manag. Serv. Qual. Int. J. 2012, 22, 447–464. [Google Scholar] [CrossRef]
  9. Kiauta, M. Idea of Quality Versus Idea of Excellence. Qual. Innov. 2012, 16, 103–113. [Google Scholar] [CrossRef] [Green Version]
  10. Calvo-Mora, A.; Blanco-Oliver, A.; Rolldán, J.; Periáñez-Cristóbal, R. TQM factors and organisational results in the EFQM excellence model framework: An explanatory and predictive analysis. Ind. Manag. Data Syst. 2020, 20, 2297–2317. [Google Scholar] [CrossRef]
  11. Cabecinhas, M.; Domingues, P.; Sampaio, P.; Bernardo, P.; Franceschini, F.; Galetto, M.; Gianni, M.; Gotzmani, K.; Matrogiacomo, L.; Hernandez-Vivanco, A. Integrated management systems diffusion models in South European countries. Int. J. Qual. Reliab. Manag. 2018, 35, 2289–2303. [Google Scholar] [CrossRef]
  12. D’Avino, D. Stochastic Performance Modelling and Management for Technological Systems. Ph.D. Thesis, Università Degli Studi di Napoli, Naples, Italy, 2008. [Google Scholar]
  13. Zgodavová, K.; Slimák, I. Strategies of Quality of Small and Medium Enterprises in Transforming Economies. In Proceedings of the 44th European Quality Congress, Budapest, Hungary, 12 June 2000; HNC for EOQ. EOQ: Budapest, Hungary, 2000. [Google Scholar]
  14. EFQM. EFQM Award History. Available online: http://www.efqm.org/what-we-do/recognition/efqm-award-history (accessed on 10 December 2021).
  15. Zgodavová, K. Self-Assessment. In The SAGE Encyclopedia of Quality and the Service Economy; Dahlgaard-Park, S., Ed.; SAGE Publications Inc.: London, UK, 2015; Volume 2, pp. 678–682. [Google Scholar] [CrossRef]
  16. Dahlgaard, J.; Chen, C.; Jang, J.Y.; Banegas, L.; Dahlgaard-Park, S. Business excellence models: Limitations, reflections and further development. Total Qual. Manag. Bus. Excell. 2013, 24, 519–538. [Google Scholar] [CrossRef] [Green Version]
  17. Mule, G. Excellence Is Measured by Growth: “Why and How?”—Presentation Transcript. Available online: https://slideplayer.com/slide/14803168/ (accessed on 10 November 2021).
  18. Zink, K.J. EFQM Excellence Model. In The SAGE Encyclopedia of Quality and the Service Economy; Dahlgaard-Park, S.M., Ed.; SAGE Publishing, Ltd.: London, UK, 2015; pp. 173–178. [Google Scholar] [CrossRef]
  19. Suárez, E.; Rolán, J.; Calvo-Mora, A. A structural analysis of the EFQM model: An assessment of the mediating role of process management. J. Bus. Econ. Manag. 2014, 15, 862–885. [Google Scholar] [CrossRef] [Green Version]
  20. Dibey, D. EFQM Excellence Model and the European Quality Award. Available online: https://unece.org/fileadmin/DAM/trade/wp6/documents/2004/roundtable/efqm_uk.pdf (accessed on 14 December 2021).
  21. EFQM. The EFQM Excellence Model. Available online: https://www.efqm.org/efqm-model/ (accessed on 5 July 2021).
  22. Fonseca, L.; Amaral, A.; Oliveira, J. Quality 4.0: The EFQM 2020 Model and Industry 4.0 Relationships and Implications. Sustainability 2021, 13, 3107. [Google Scholar] [CrossRef]
  23. Nenadál, J. The New EFQM Model: What is Really New and Could Be Considered as a Suitable Tool with Respect to Quality 4.0 Concept? Qual. Innov. Prosper. 2020, 24, 17–28. [Google Scholar] [CrossRef] [Green Version]
  24. Turisová, R.; Pacaiová, H.; Kotianová, Z.; Nagyová, A.; Hovanec, M.; Korba, P. Evaluation of eMaintenance Application Based on the New Version of the EFQM Model. Sustainability 2021, 13, 3682. [Google Scholar] [CrossRef]
  25. Şanlıöz-Özgen, H. European Quality Award Winning Companies: A Situational Analysis; Emerald Group Publishing Limited: Bingley, UK, 2016. [Google Scholar]
  26. Borbely, M. Factors influencing self-assessment in a changing library environment. Perform. Meas. Metr. 2011, 12, 7–22. [Google Scholar] [CrossRef]
  27. EFQM. The EFQM Excellence Model 1999; EFQM: Brussels, Belgium, 1999. [Google Scholar]
  28. Tarí, J.J.; de Juana-Espinosa, S. EFQM model self-assessment using a questionnaire approach in university administrative services. TQM Mag. 2007, 19, 604–616. [Google Scholar] [CrossRef]
  29. Nenadál, J. EFQM Excellence Model as a Framework for Quality Evaluation of Czech Universities. In Proceedings of the 57th EOQ Congress, Tallinn, Estonia, 17–20 June 2013; EOQ: Brussels, Belgium, 2013; pp. 231–237. [Google Scholar]
  30. Medne, A.; Lapina, I.Z. Sustainability of a university’s quality system: Adaptation of the EFQM excellence model. Int. J. Qual. Serv. Sci. 2020, 12, 29–43. [Google Scholar] [CrossRef]
  31. Van Schoten, S.; de Blok, C.; Spreeuwenberg, P.; Groenewegen, P.; Wagner, C. The EFQM Model as a framework for total quality management in healthcare: Results of a longitudinal quantitative study. Int. J. Oper. Prod. Manag. 2016, 36, 901–922. [Google Scholar] [CrossRef] [Green Version]
  32. Maquieira, S.P.; Tarí, J.; Molina-Azorín, J. Transformational leadership and the European Foundation for Quality Management model in five-star hotels. J. Tour. Anal. 2020, 27, 99–118. [Google Scholar] [CrossRef]
  33. Bratianu, C.; Hadad, S.; Bejinaru, R. Paradigm Shift in Business Education: A Competence-Based Approach. Sustainability 2020, 12, 1348. [Google Scholar] [CrossRef] [Green Version]
  34. Gompertz, B., XXIV. On the Nature of the Function Expressive of the Law of Human Mortality, and on a New Mode of Determining the Value of Life Contingencies. Philos. Trans. R. Soc. Lond. 1825, 115, 513–583. [Google Scholar] [CrossRef]
  35. Morrison, J. How to use diffusion models in new product forecasting. J. Bus. Forecast. Methods Syst. Flush. 1996, 15, 6–9. [Google Scholar]
  36. Morvay, K.; Frank, K.; Hudcovský, M.; Hvozdíková, V.; Jeck, T.; Šikulová, I. Economic Development of Slovakia in 2015 and Outlook up to 2017. Available online: https://ekonom.sav.sk/uploads/journals/348_economic_development_of_slovakia_2015.pdf (accessed on 22 April 2022).
  37. Hudec, O.; Sisaková, J.; Tartalova, A.; Zelinsky, T. Statisticke Metody v Ekonomickych Vedach; Elfa: Kosice, Slovakia, 2007. [Google Scholar]
  38. Rządkowski, G.; Glażewska, I.; SawIńska, K. Gompertz function and its applications. Found. Manag. 2015, 7, 185–190. [Google Scholar] [CrossRef] [Green Version]
  39. Figueira, F.C.; Moura, N.J.; Ribeiro, M. The Gompertz-Pareto income distribution. Physica A 2011, 370, 689–698. [Google Scholar] [CrossRef] [Green Version]
  40. Chu, K.H. Fitting the Gompertz equation to asymmetric breakthrough curves. J. Environ. Chem. Eng. 2020, 8, 103713. [Google Scholar] [CrossRef]
  41. Mlčoch, L.; Slimák, I. Řízení Kvality a Strojírenská Metrologie/Quality Control and Engineering Metrology; SNTL/ALFA: Prague, Czech Republic, 1987. [Google Scholar]
  42. Teng, J.; Grover, V.; Gutller, W. Information technology innovations: General diffusion patterns and its relationships to innovation characteristics. IEEE Trans. Eng. Manag. 2002, 49, 13–27. [Google Scholar] [CrossRef] [Green Version]
  43. Sudtasan, T.; Mitomo, H. Comparison of Diffusion Models for Forecasting the Growth of Broadband Markets in Thailand. In Proceedings of the 14th Asia-Pacific Regional Conference of the International Telecommunications Society (ITS): “Mapping ICT into Transformation for the Next Information Society”, Kyoto, Japan, 24–27 June 2017. [Google Scholar]
  44. Tjørve, K.; Tjørve, E. The use of Gompertz models in growth analyses, and new Gompertz-model approach: An addition to the Unified-Richards family. PLoS ONE 2017, 12, e0178691. [Google Scholar] [CrossRef]
  45. Satoh, D. Discrete Gompertz equation and model selection between Gompertz and logistic models. Int. J. Forecast. 2021, 37, 1192–1211. [Google Scholar] [CrossRef]
  46. Tammaru, T. EFQM Levels of Excellence. Available online: https://docplayer.net/100708606-Efqm-levels-of-excellence.html (accessed on 19 March 2022).
  47. Bou-Llusar, J.; Escrig-Tena, A.; Roca-Puig, V.; Beltrán-Martín, I. To what extent do enablers explain results in the EFQM excellence model? An empirical study. Int. J. Qual. Reliab. Manag. 2014, 22, 337–353. [Google Scholar] [CrossRef]
  48. European Commission. Eurostat Data Browser. Available online: https://ec.europa.eu/eurostat/databrowser/view/sdg_08_10/default/table (accessed on 22 April 2022).
  49. Statistical Office of the Slovak Republic. Datacube. Available online: http://datacube.statistics.sk/#!/view/en/VBD_SLOVSTAT2/pr2827rs/v_pr2827rs_00_00_00_en (accessed on 8 April 2022).
  50. Girmanová, L.; Šolc, M.; Kliment, J.; Divoková, A.; Mikloš, V. Application of Six Sigma Using DMAIC Methodology in the Process of Product Quality Control in Metallurgical Operation. Acta Technol. Agric. 2017, 20, 104–109. [Google Scholar] [CrossRef] [Green Version]
  51. George, M.L. Lean Six Sigma for Service; McGraw-Hill Education: London, UK, 2003. [Google Scholar]
  52. Moeller, J. The EFQM Excellence Model. German Experiences with the EFQM Approach in Healthcare. Int. J. Qual. Healthc. 2001, 13, 45–49. [Google Scholar] [CrossRef] [Green Version]
  53. Escrig, A.; de Menezes, L. What characterizes leading companies within business excellence models? An analysis of EFQM Recognized for Excellence recipients in Spain. Int. J. Prod. Econ. 2015, 169, 362–375. [Google Scholar] [CrossRef] [Green Version]
  54. Gómez-López, R.; Serrano-Bedia, A.M.; López-Fernández, M. An exploratory study of the results of the implementation of EFQM in private Spanish firms. Int. J. Qual. Reliab. Manag. 2019, 36, 331–346. [Google Scholar] [CrossRef]
  55. EFQM. EFQM Global Excellence Award 2017: Benchmark Scoring Report Paperback—18 December 2017; Independently Published; EFQM: Brussels, Belgium, 2017; 32p. [Google Scholar]
Figure 1. Average score of 30 service organizations and the corresponding Gompertz function (b = 142.04, a = 270.18, k = 0.9281 Ti = 2000.51) during three time periods.
Figure 1. Average score of 30 service organizations and the corresponding Gompertz function (b = 142.04, a = 270.18, k = 0.9281 Ti = 2000.51) during three time periods.
Applsci 12 06856 g001
Figure 2. Level of Excellence forecasting using data from three and four years.
Figure 2. Level of Excellence forecasting using data from three and four years.
Applsci 12 06856 g002
Figure 3. Decomposed Level of Excellence for: (a) enablers criteria; (b) results criteria.
Figure 3. Decomposed Level of Excellence for: (a) enablers criteria; (b) results criteria.
Applsci 12 06856 g003
Figure 4. Relationship between results and enablers: (a) efficiency, real GDP per capita and employment; (b) scatterplot of results against enablers.
Figure 4. Relationship between results and enablers: (a) efficiency, real GDP per capita and employment; (b) scatterplot of results against enablers.
Applsci 12 06856 g004
Table 1. Parameters of Gompertz functions and score deviations.
Table 1. Parameters of Gompertz functions and score deviations.
Description Data Pointsb Calculated
b Preset Value
akTiScore in 2006Deviation in 2006
Measured score in 2006 405.00-
Three years, b = 160 (Figure 2)3160.00252.350.99402000.66411.111.51%
Three years, b = 140 3140.00287.660.84992000.57424.834.90%
Three years, b = 1903190.00190.881.54052000.78380.82−5.97%
Four years (Figure 2)4147.54274.650.89652000.60420.023.71%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zgodavova, K.; Bober, P.; Urbančíková, N.; Santos, G.; Sütőová, A. Forecasting the Future Excellence: 30 Years of Evaluating Service Organizations in Slovakia. Appl. Sci. 2022, 12, 6856. https://doi.org/10.3390/app12146856

AMA Style

Zgodavova K, Bober P, Urbančíková N, Santos G, Sütőová A. Forecasting the Future Excellence: 30 Years of Evaluating Service Organizations in Slovakia. Applied Sciences. 2022; 12(14):6856. https://doi.org/10.3390/app12146856

Chicago/Turabian Style

Zgodavova, Kristina, Peter Bober, Nataša Urbančíková, Gilberto Santos, and Andrea Sütőová. 2022. "Forecasting the Future Excellence: 30 Years of Evaluating Service Organizations in Slovakia" Applied Sciences 12, no. 14: 6856. https://doi.org/10.3390/app12146856

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop