An empirical study on evaluating training program : A case study of university employee

Article history: Received February 1, 2011 Received in Revised form April, 10, 2011 Accepted 12 April 2011 Available online 14 April 2011 In this paper, we present an empirical study on measuring the effects of training programs on efficiency of university employee. The proposed model of this paper uses Kirkpatrick four level models based on some questionnaire. The questions are divided into four different groups of reflection, leaning, behavior and efficiency and the feedback are collected using Likert scales. We perform some statistical tests to analyze the results and conclude that staff training has relatively positive impact on all four items. In addition, the effects of different personal characteristics such as age, gender and marriage conditions are investigated on all four levels of Kirkpatrick's model. The results indicate that the Kirkpatrick could be implemented for measuring the effects of training programs, efficiently. © 2011 Growing Science Ltd. All rights reserved.


Introduction
Knowledge plays an important role on staff efficiency and there are literally different methods to increase the level of education on various organizations such as providing short courses, books, educational movies, etc.One of the most important issues is to understand how effective is training programs.There are different studies for measuring the effects of training based on different studies.Ducharme and Feldman ( 1992) compared different staff training strategies to promote generalized teaching skills.McDonnell (1997) studied the effects of training care staff to manage challenging behavior for three-day course studies.Rice et al. (1985) studied crisis prevention and intervention training for psychiatric hospital staff.Richman et al. (1988) investigated the effects of self-monitoring and supervisor feedback on staff performance for a residential setting.McDonnell et al. (2008) studied the effects of a 3-day training program in the management of aggressive behavior in services for staff with autism spectrum disorders were investigated using a quasi-experimental design.An experimental people received training for a 10-month period and a contrast group, which had received no training.The study indicated that staff training increased career confidence, but there were no training effects of measures of staff coping, support or perceived control of challenging behaviors.The study also indicated that staff training could increase staff confidence in managing aggression in people with autism spectrum disorders.Arthur (1994) presented a comprehensive survey on different customer-service training for academic libraries.Galloway and Ho (1996) presented a model of service quality for measuring the efficiency of service training.Daly et al. (2008) examined the effect of improvisation training, as used in schools of acting, in preparing front-stage service employees performed their roles when interacting with customers as cabin crew in a regional Irish airlines.Kirkpatrick (1994) presented a well-known method for evaluating training effectiveness of organizations.In his model, there are four levels of reaction, learning, behavior and results and the performance of learning is measured based on these levels.
In this paper, we study the impact of service training for university employees in one of private universities in Iran.The model uses Likert scale from one to five for a questionnaire consists of thirty questions and the results are analyzed using parametric statistical tests.The organization of this paper first presents the proposed model and next it explains the details of the implementation of the proposed model for the case study in section 2 and 3, respectively.Finally, concluding remarks are presented in the last section to summarize the contribution of the paper.

Methodology
Learning plays a vital role for the success of any organization and there is no doubt that any organization needs to have employees with high level of skills and knowledge to survive in a competitive market.Service training is one of the well-known methods for increasing the level of people's knowledge.Service training has different advantages such as promoting employees' levels, adjusting staffs' behavior and increasing their disciplines, which lead organizations to maintain operations, which are more efficient.There are many evidences, which indicate that service training has positive impact on the efficiency of organization such as reducing the number of incidents, preventing waste of resources, etc.

Service learning objectives
There are different learning objectives associated with any service learning programs.In summary, we could categorize the objectives into three different groups of organizational, employee and social issues as follows.

Organizational objectives
In order to meet organizational needs we need to maintain qualified employees who have minimum requirement skills.In addition, the organizational objectives require cooperative spirit among employees, group team-work followed by working regulations.

Employees objective
There must be a good relationship between employee's personality and their responsibilities.In other word, when an employee performs his duties better, he/she tends to have a better feeling and more confidence.

Social objective
There is also an important aspect of organizational objectives, which is the contribution to social system.In fact, we need to emphasis that social objectives play important role on organizational needs.

Kirkpatrick model
Kirkpatrick model is one of the most important techniques for measuring the impact of training programs.The method consists of four major levels of reaction, behavior, learning and results.In the reaction level, the model studies how the learners react to the learning process while the learning focuses on the impact of the learning on increasing the knowledge and skills.The behavior is associated with the capability to execute the learned skills practically while the results are on the items such as efficiency, monetary, moral, etc.The first two levels are also called hot evaluations while the next two levels are called cold evaluations.The reason is that we could almost instantly measure the impact of the first two levels while the impact of the second two levels is measured with delay.

The case study
In this paper, we implement the proposed model of this paper to study the impact of learning programs held for some university staff.The total number of people who were working for the university was 667.In order to find out the number of sample size we have used the following statistical sampling technique, where N is the population size, represents the yes/no categories, and N=667, the number of sample size is calculated as n=247.Table 1 shows the frequencies of the people who participated in our survey.As we can observe from Table 1, over half of the people who participated in our survey are from administration department.These are the people who are responsible for registering the students, performing financial transaction, etc and their responsibilities are important to increase customer's satisfaction.According to Table 1, most people who participated in our survey are between 30 to 50 years old and over two third of the particpants are women.In addition, 32% of the people who took part in our survey had less than 10 years of job experience, 46.5% between 11 to 16 years of job experience, 16.2% between 16 to 20 years of job experience and 3.3% had more than 20 years of job experience.23.4% of the people who participated in our survey had only 12 years of educational background, 15.6% with 14 years of educational background, 49.6% with batchlour degree and 11.5% hold master degrees.

The results
In order to analyze the results of the data gathered from this survey we have performed a normality test to examine whether we could use parameteric statistics for the data and found out that the skewness of our data was less than 1.Therefore, we have used regular t-student test to analyze the data.The questionnarie of our survey consists of 30 questions.Table 2 summarizes the results of our survey for measuring the impact of training programs on people's reflection.As we can observe all t-student values indicate the rejection the null hypothsis, having no impact, when the level of confidence is 1% and the degree of freedom is 246.Therefore we can conclude the experimental mean is well above the theoretical mean for all 11 questions associated with reflection questions.In other words, the survey indicate that the training program reflected above average for these people.The impact of training programs on people's learning is demonstrated in Table 3. Again, we observe that the effects of experimental mean is well above the theoretical mean of 2, which means the training program could increase the participants' learning.Finally, table 4 summarizes the impact of questions on changing people's behavior.

Table 4
The impact of training programs to change on people's behavior Again, we have obtained the results, which mostly indicate that the mean of experimental results are mostly above the average, except one case, and we can conclude that the training programs could change staff's behavior.However, the results indicate that the training program did not have meaningful impact on receiving more support from management team.We have measured the impact of gender on our study and summarized the results on Table 5.Based on the results of Table 5 we can conclude that for α=.05 there is a meaningful difference between two groups of men and women.In other words, male employees believe more than women do that training program has positive impact on increasing behavior and efficiency.We have repeated the same statistical test to study the effect of marriage on efficiency and behavior and the results are summarized in Table 6.As we can observe from the results of Table 5, there is no meaningful difference between married and single people.Finally, it is interesting to study the effects of age on our survey which is summarized in Table 7.It is clear from the results of Table 7 that there are meaningful differences between reflection, learning and efficiency for different ages.

Conclusion
In this paper, we have presented an empirical analysis to study the effects of learning programs on increasing employee's efficiency.The proposed model of this paper used Kirkpatrick four level models based on some questionnaire and analyzed the results.The survey was executed using Likert scale and the results were analyzed using parametric t-student tests.The results indicated that training programs has positive impact on reflection, learning and behavior.The results also indicated that there was no meaningful difference between married and single people but there was stronger belief among male people who took part in the survey that the training programs was useful.Finally, the results indicated that there were meaningful differences between reflection, learning and efficiency in different ages.
2 /α z is CDF of normal distribution and finally ε is the error term.Since we have 96

Table 1
Frequency of the different people who participated in the survey

Table 2
The impact of training programs on people's reflection

Table 3
The impact of training programs on people's learning

Table 5
The impact of gender on training program on behavior and efficiency

Table 6
The impact of marriage on training program on behavior and efficiency

Table 7
The impact of age on training program on behavior and efficiency