Design of an operations manager selection system in service encounter

Article history: Received March 25, 2015 Received in revised format August 6 2015 Accepted August 6 2015 Available online August 9 2015 The purpose of this study is to provide criteria for selecting operations managers at the ‘service encounter’ for mobile telecommunication companies, and develop a system for this multicriteria decision-making scheme based on the Analytical Hierarchy Process (AHP). There are three main criteria for evaluating the capability of service-encounter operation managers: (1) the ability to design service process; (2) the ability to operate service process; (3) the ability to conduct improvement. The AHP operation manager selection tool was developed based on the complex problems at the service encounter. It was created as a decision support system which was used to recruit and evaluate operations managers’ capability for the purpose of career advancement. Growing Science Ltd. All rights reserved. 5 © 201


Introduction
Recently, there has been intense competition in the market share among well-known telecommunication companies.One of the most important factors in people selecting a vendor is the quality of service at the service encounter.It is a direct communication between the service encounter and customers, and effective operations management at the service encounter enhances company's competitiveness.Common problems found at a poor service encounter are complaints from unsatisfied customers, caused by having to wait in line for too long on average.The main reason for this problem stems from the operations managers with poor management abilities, resulting in ineffective problemsolving skills.
The in-depth knowledge of operations management is not only applicable for the manufacturing industry but also profitable for the service industry (Johnston, 1999).In general, there are nine areas of the service industry that can benefit from applying operation management.These are: linking operation's performance to business drivers, performance measurement and operations improvement, guarantees, complaints and service recovery, managing people, service design, service technology, the design of internal networks, the service encounter, and managing service capacity (Johnston, 2005).Moreover, the Customer Operations Performance Center (COPC) -a guideline to management practices, key measurements, and training for customer-centric service operations is designed to improve customer satisfaction through improving the service and quality, increasing revenue, and reducing the cost of providing excellent service.
There are three criteria for selecting the best adequate personnel (Güngör et al., 2009).The first criterion is the general work factor including work experience, the use of foreign languages, bachelor's degree, master's degree, analytical thinking, and basic computer skills.Second, the complimentary work factor is composed of decision making, team working, effective time management, willingness, lifelong learning, and determination to meet objectives and goals.The last criterion is the individual factor that consists of core ability, appearance, age, culture, and written communication skill.Although employees who have passed these three criteria are able to do routine tasks at the service encounter, they cannot handle the operational problems effectively, especially when an unusual situation happens.This is because the employee lacks of operations management abilities.Therefore, this study will focus on selecting the most capable operations manager at the service encounter in order to improve the service quality.The ultimate goal of this research is to identify the multi-criteria for selecting an operations manager who can manage the operational work efficiently with the purpose of recruiting or promoting employees to a higher operations management position.
Among the several tools for multi-decision making, Analytical Hierarchy Process (AHP) is considered as the most attractive one to select the best alternative since AHP does not limit the number of criteria and alternatives.So that, all criteria as well as alternatives can be performed with Pairwise comparison which is the most precise method in prioritizing criteria and candidates (Peniwati, 2007).AHP is a structured technique that helps decision makers to find the decision that best suits their goal and their understanding of the problem.It provides a comprehensive and rational framework for structuring decision problems, representing and quantifying its elements, relating those elements to overall goals, and evaluating alternative solutions (Saaty, 1980).In this study, the first level of the hierarchy is selecting the most suitable operations manager.The second level is the main operations management criteria, which is used for selecting an operations manager.The third level specifies sub-criteria which are related to the criteria in the second level.The bottom level of the hierarchy includes the candidates to be evaluated.This hierarchy is summarized in Fig. 1.

Methodology
Research methodology in this study is divided into four phases as shown in Fig. 2. The multiple criteria to determine an eligible operations manager is explored and established in the first phase.After this, phase two leads the multiple criteria from the first phase and develops it to test operations management candidates.Next, in phase three, the qualitative data received from the tests are analyzed by using AHP tools and sensitivity analysis.Phase four provides decision support system to help users reduce frustration of AHP model.

First phase: establishing the multiple criteria for selecting operations
The multiple criteria for evaluating operations management capabilities are established, and the relevant literature about operations management in textbooks, journal and COPC standard was reviewed (Machuca et al., 2007;Fitzsimmons, 2011;Russell & Taylor, 2011;Slack et al., 2010).In addition, an in-depth mobile telecommunications service provider in Thailand with a number of service encounters was investigated in order to identify the main problems that usually occur in the working situation.Problems in the service encounter were observed and classified into two main groups.The first group is customer complaint problems while the second one is the problems in service operations.
Problems from customer complaints during year 2012 to 2013 are pointed out in the questionnaire of over 5,000 customers.In order to point out the problems in service encounter with impact to customer satisfaction, these questionnaires are open-ended questionnaire which distributed the several complaints from customer.Using Pareto analysis, there are five problems that occupied over 80 percent of this group.The poor environment at the service encounter is the most claimed problem followed by inconveniences during the service provision, the average amount of time a customer spends waiting in line being too long, lack of customer care, and insufficient service supporting facilities.The result is illustrated in Fig. 3.
In the second group, the problems are specified based on focus group interviews with experienced managers at service encounters in a case company.Problems which were obtained from interviews are summarized in three main categories.The first category is customer service failure that was caused by staff not following specified service standards or procedures.Second, when problems occurred at the service encounter, the operations manager could not find the root cause of the problem and was unable to solve it effectively.Finally, there is no risk management plan to aid operations from unexpected serious events such as natural disasters, burglary, fire, or other serious events.
Once problems from both customer complaints and managers were clearly identified, group interviews with managers were then conducted in order to investigate the root causes of these problems.The major cause is the lack of operational management abilities/experience in the service manager.Therefore, the service encounter cannot provide a good service.Operations management knowledge areas were then shared with service operations managers in order to improve these operational services.The suggested operations management techniques to be used for these operational problems are shown in Table 1.The operations manager cannot find the root causes of the problems and was unable to solve it effectively 10.Improving operations by using QC 7 tools technique to find the root cause of the problem and use other techniques to solve it No risk management plan in the event of unexpected serious events 11.Risk management to assess the risks that may occur and action to prevent them.
After operations management techniques from a literature review were selected and matched with the service problems, Item-Objective Congruency index (IOC) questions were constructed and presented to operations management experts (1 person of industrial engineering academician, 3 people of senior and top-level managers at the case company) to verify the matching results.Each subject question was rated on three scales: '-1' represented disagree, '0' represented not assured, and '+1' represented agree.The IOC index from all questions were 0.841 (n = 4) which illustrates the suitable level of content validity (IOC index must be more than 0.5).The mention formula for calculating IOC index are shown in Table 2.
Based on the IOC results, verified operations management techniques were considered as criteria which had been used in this project.All criteria were then classified into three main categories which are 1) the ability to design a service process, 2) the ability to operate a service process, and 3) the ability to conduct improvement based on the operations management textbook (Slack et al., 2010).Each main criterion has its own sub criteria.All criteria are summarized in Fig. 4.

Second phase: leading the multiple criteria into test with operations manager candidates
According to the results from phase one, ten identified sub-criteria were used to create the Operations Management Test (OMT).OMT is a five multiple-choice question that contains the total of 44 questions (four questions per one sub criterion) and the examinees were asked to give answers within 2 hours.These questions aim to test the general operational management concepts of the candidate, and also to see the way they handle problems found at the service encounter that have been given.
To test the validity of this exam, OMT had been used to test the applicants who wished to pursue the Industrial Engineering Master's program at Chulalongkorn University.All applicants have experiences in industry and strong motivation to join the program which is similar to the candidates at the case company that have service operation background and would like to be promoted to a higher position in operations.The entrance exam scores in relation to the number of years of experience in industry.This is displayed in Fig. 5.It clearly shows that candidates with longer working experience gain higher scores than the lower one (correlation coefficient = 0.8434).The R-square value is more than 0.7 which indicates that the pretest result is valid.Moreover, comparing the academic background of the candidates with the entrance exam scores, the correlation results show that students with an Industrial Engineering background acquire better results than those from other science-based academic background including other branches of engineering.The result shows that T-test (data is normal distribution) is significant (p-value = 0.025).However, F-test is not significant (p-value = 0.793).After the OMT was validated by the entrance exam of the Industrial Engineering Master's program, it was then given to the actual ten candidates who worked in the service encounter and had potential to be operations managers.OMT scores from these candidates will be put into the Pairwise comparison method in every criterion by AHP tools in the next phase.

Third phase: analyzing by using AHP tools
In this phase, all criteria from phase one and the OMT results from phase two were put into the Pairwise comparison (by the well-known Analytical Hierarchy Process or AHP) in order to rank all candidates and select the best candidate to be a service manager.The developed AHP program based on an Excel spreadsheet format is used to implement Pairwise comparison.This was divided into four main steps.

The first step: pairwise comparison for criteria
First of all, all criteria were given a rating score and compared to each other in pairs (i.e.four criteria were grouped into 4C2 or 6 pairs).Then the weighting priority value for each criterion was calculated by the AHP method.After that, sub criteria were compared and computed with the priority value by the same method.Weighting priority values for each criterion by top management at service encounter in this study are listed in Table 3.

Second step: pairwise comparison for alternatives
In step two, results from the OMT were performed with pairwise comparison.Then, the weighting values for OMT scores from all candidates were calculated using the AHP method again.Weighting priority values for each candidate are shown in Table 4.

Third step: AHP calculation
In step three, the total scores for each candidate were calculated by summing the product between weighting global priority values of each criterion (from step 1) and weighting values of the OMT score of each criterion (from step 2).Finally, the total scores were ranked from the highest to the lowest and the candidate that had the highest score was selected to be an operations manager at the service encounter.Ranking of the total scores are illustrated in Table 5.

Last step: Sensitivity analysis
In the last step, a sensitivity analysis was used to check the sensitivity of the ranking of the total AHP score.Through increasing or decreasing the weight priority of criteria, the resulting AHP score changes the priorities and the ranking of the candidates can be observed if changing in the weight priority of criteria happens.The sensitivity analysis of this AHP outcome into performance sensitivity is displayed in Fig. 6.In summary of the sensitivity analysis method, the result of AHP methods is much more sensitive to weighting priority of each criterion.In other words, changing weighting values will affect the ranking of the AHP score.Therefore, the weighting priority values should be set carefully.
The grey colored frame shows the interval when the relative importance weight is increased or decreased, the grey colored frame points would change the outcome from decision making in selecting an operations manager to be another one.According to the graph, it was found that the selection criterion of the ability in the service design process had the least amount of change.Therefore, caution should be taken for paired comparison between the service process design ability and other criteria.
When work teams who performed the selection were interested in selecting another operations manager other than the most appropriate candidate, the decision to select the second candidate could be made.For instance, the first candidate might have greater personality and language abilities which were found in other criteria apart from this research.The executive might make the decision to select the second candidate instead, in order that the feeling could be used in helping make decisions through the procedural analysis process.The ability to conduct improvement The ability to operate service process The ability to design service process

Sensitivity analysis summary graph
Unvaried outcome interval

Varied outcome interval
Change to be candidate 4 Change to be candidate 4 Change to be candidate 3 information and retrieve data for work processing.The structure of decision support system for selecting a shop operations manager is shown in Fig. 7.The finding of the outcomes from the questionnaires satisfied in feasibility at 80.95%, usability at 81.90%, and utility at 81.90%, and the total score was 81.58%.It was concluded that the implementation of Analytical Hierarchy Process for selecting the capable operations managers was valid.

Conclusion
The objective of the research was to create an instrument for selecting competent knowledgeable personnel in operations management to be operations managers and provide services to the customers in the telecommunication service business of the case study organization.The research classified the operating procedures into four phases: the first phase is the investigation of the criteria for selecting a service operations manager, the second phase is to develop a test of service operations management, the third phase is to design a decision model using Analytic Hierarchy Process for multiple criteria decision making and sensitivity analysis to suggest the most competent and knowledgeable candidate in operations management applied to solve the existing problems which have occurred within the shop division, and the fourth phase provides the result from the developed decision support system which suggests the promising shop operations manager.Finally, this developed decision support system is tested for its reliability and validity by the questionnaires regarding its feasibility, usability, and utility of this research.They were given to top executives who were involved in selecting the suitable operations manager in the case study.The result is shown that the operations manager selection system by the AHP model is accurate and can be applied to assist selecting operations managers in service encounter applications.

Fig. 7 .
Fig. 7. Decision support system for selecting a shop operations manager

Table 1
Operations management knowledge to solve the identified operations problems Fig. 2. Research methodology.Fig. 3. Pareto chart of customer complaint at service encounter

Table 2
Formula for calculating IOC index.(E1 -E3 are represent to senior and top-level managers at the case company, A1 is represent to industrial engineering academician)

Table 3
Weighting priority values for each criterion

Table 4
Weighting priority values for each candidate in each criterion

Table 5
Ranking of the total AHP score to select the best operations manager

. Last phase: decision support system for operations manager selection model
The supportive system for decision making to select the suitable operations manager is classified into four parts including, processing device (computer), the user applications of decision support systems program (User), decision making model (model), and database.A Personal Computer (PC) with Microsoft Excel 2010 program with the code written for controlling the application software would be chosen as a process device using Visual basic application as the major program in system processing.This would support the decision making for selecting the best operations manager.Since Microsoft Excel 2010 program is the program that all organizations in Thailand use for operations such as data storage, computation and processing, etc.The development of Microsoft Excel 2010 as the supportive system in decision making to select the capable operations manager would help save costs in buying packages and save time in learning the instruction method of these packages.According to the decision support system, the user was the top executive in the position.He or she was involved in selecting the suitable operations manager of the organization for the telecommunication service provision case study.The decision making model would apply a mathematical model of Analytic Hierarchy Process (AHP).The last part of the database would use Excel Spreadsheets from Microsoft Excel 2010 program to store