Skip to main content
Log in

Interviewee Selection Test and Evaluator Assessments of General Mental Ability, Emotional Intelligence and Extraversion: Relationships with Structured Behavioral and Situational Interview Performance

  • Published:
Journal of Business and Psychology Aims and scope Submit manuscript

Abstract

The purpose of the study was to examine antecedents of interview performance commonly measured via two divergent methods; selection tests and evaluator assessments. General mental ability (GMA), emotional intelligence (EI), and extraversion have been largely studied in isolation. This study evaluates the relative strength of these traits across methods and tests whether selection test and evaluator-assessed traits interact to further enhance the prediction of interview performance. 81 interviewees were asked to complete traditional selection tests of GMA, EI, extraversion, and a video-recorded structured behavioral and situational job interview. The traits, behavioral, and situational interview performance were then evaluated with three independent sets of raters. Regression analysis was used to investigate the extent that these traits predicted structured interview performance. Results indicate that each trait was a strong predictor of interview performance, but results differed based on the method of measurement and the type of structured interview assessed. Further, evaluator perceptions related to interview performance more strongly than did selection tests. Finally, evaluator assessments of each trait interacted with its respective selection test counterpart to further enhance the prediction of interview performance. This improves our understanding of how applicant traits impact hiring decisions. This is the first study to directly compare tested versus others’ ratings of interviewee GMA, EI, and extraversion as predictors of interview performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Ashkanasy, N. M., Hartel, C. E. J., & Daus, C. S. (2002). Diversity and emotion: The new frontiers in organizational behavior research. Journal of Management, 38, 307–338.

    Article  Google Scholar 

  • Baron, R. A. (1993). Interviews moods and evaluations of job applicant: The role of applicant qualifications. Journal of Applied Social Psychology, 23, 253–271.

    Article  Google Scholar 

  • Barrick, M. R., Shaffer, J. A., & DeGrassi, S. W. (2009). What you see may not be what you get: Relationships among self-presentation tactics and ratings of interview and job performance. Journal of Applied Psychology, 94, 1394–1411.

    Article  PubMed  Google Scholar 

  • Beatty, R. N. (1986). The five-minute interview. New York: Wiley.

    Google Scholar 

  • Berry, C. M., Sackett, P. R., & Landers, R. N. (2007). Revisiting interview-cognitive ability relationships: Attending to specific range restriction mechanisms in meta-analysis. Personnel Psychology, 60, 837–874.

    Article  Google Scholar 

  • Bing, M. N., LeBreton, J. M., Davison, H. K., Migetz, D. Z., & James, L. R. (2007). Integrating implicit and explicit social cognitions for enhanced personality assessment: A general framework for choosing measurement and statistical methods. Organizational Research Methods, 10(2), 346–389.

    Article  Google Scholar 

  • Blackman, M. C. (2002). Personality judgment and the utility of the unstructured employment interview. Basic and Applied Social Psychology, 24, 241–250.

    Article  Google Scholar 

  • Blackman, M. C., & Funder, D. C. (2002). Effective interview practices for accurately assessing counterproductive traits. International Journal of Selection and Assessment, 10, 109–116.

    Article  Google Scholar 

  • Borkenau, P., Mauer, N., Riemann, R., Spinath, F. M., & Angleitner, A. (2004). Thin slices of behavior as cues of personality and intelligence. Journal of Personality and Social Psychology, 86, 599–614.

    Article  PubMed  Google Scholar 

  • Brody, N. (1992). Intelligence (2nd ed.). San Diego, CA: Academic Press.

    Google Scholar 

  • Burnett, J. R., Fan, C., Motowidlo, S. J., & DeGroot, T. (1998). Interview notes and validity. Personnel Psychology, 51, 375–396.

    Article  Google Scholar 

  • Burroughs, J. W., Drew, D. R., & Hallman, W. K. (1991). Predicting personality from personal possessions: A self-presentational analysis. Journal of Social Behavior and Personality, 6, 147–163.

    Google Scholar 

  • Caldwell, D. F., & Burger, J. M. (1998). Personality characteristics of job applicants and success in screening interviews. Personnel Psychology, 51, 119–136.

    Article  Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56, 81–105.

    Article  PubMed  Google Scholar 

  • Campion, M. A., Palmer, D. K., & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50, 655–702.

    Article  Google Scholar 

  • Campion, M. A., Pursell, E. D., & Brown, B. K. (1988). Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25–42.

    Article  Google Scholar 

  • Chaplin, W. F. (1991). The next generation of moderator research in personality psychology. Journal of Personality, 59, 143–178.

    Article  PubMed  Google Scholar 

  • Choi, S., & Kluemper, D. H. (2011). The relative utility of differing measures of emotional intelligence: Other-rated EI as a predictor of social functioning. European Review of Applied Psychology, 93, 270–277.

    Google Scholar 

  • Choi, S., Kluemper, D. H., & Sauley, K. S. (2011). What if we fake emotional intelligence? A test of criterion validity attenuation. Journal of Personality Assessment, 93, 270–277.

    Article  PubMed  Google Scholar 

  • Cole, M. S., Feild, H. S., & Giles, W. F. (2003). Using recruiter assessments of applicants resume content to predict applicant mental ability and Big Five personality dimensions. International Journal of Selection and Assessment, 11, 78–88.

    Article  Google Scholar 

  • Cole, M. S., Feild, H. S., & Stafford, J. O. (2005). Validity of resume reviewers inferences concerning applicant personality based on resume evaluation. International Journal of Selection and Assessment, 13, 321–324.

    Article  Google Scholar 

  • Connolly, J. J., Kavanagh, E. J., & Viswesvaran, C. (2007). The convergent validity between self and observer ratings of personality: A meta-analytic review. International Journal of Selection and Assessment, 15, 110–117.

    Article  Google Scholar 

  • Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565–579.

    Article  Google Scholar 

  • Cortina, J. M., Golstein, N. B., Payne, S. S., Davison, H. K., & Gilliland, S. W. (2000). The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology, 53, 325–351.

    Article  Google Scholar 

  • Costa, P. T., & McCrae, R. R. (1985). The NEO personality inventory manual. Odessa, FL: Psychological Assessment Resources Inc.

    Google Scholar 

  • DeGroot, T., & Gooty, J. (2009). Can nonverbal cues be used to make meaningful personality attributions in employment interviews? Journal of Business and Psychology, 24, 179–192.

    Article  Google Scholar 

  • DeGroot, T., & Motowidlo, S. (1999). Why visual and vocal interview cues can affect interviewers’ judgments and predict job performance. Journal of Applied Psychology, 84, 986–993.

    Article  Google Scholar 

  • Digman, J. M. (1990). Personality structure: Emergence of the five-factor model. Annual Review of Psychology, 41, 417–440.

    Article  Google Scholar 

  • Dipboye, R. L. (1992). Selection interviews: Process perspectives. Cincinatti, OH: South-Western.

    Google Scholar 

  • Dipboye, R. L. (1994). Structured and unstructured selection interviews: Beyond the job-fit model. In G. R. Ferris (Ed.), Research in personnel and human resources management (Vol. 12). Greenwich, CT: JAI Press.

    Google Scholar 

  • Dunn, W. S., Mount, M. K., Barrick, M. R., & Ones, D. S. (1995). Relative importance of personality and general mental ability in managers’ judgments of applicant qualifications. Journal of Applied Psychology, 80, 500–509.

    Article  PubMed  Google Scholar 

  • Fast, L. A., & Funder, D. C. (2008). Personality as manifest in word use: Correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology, 94, 334–346.

    Article  PubMed  Google Scholar 

  • Fisher, C. D., & Ashkanasy, N. M. (2000). The emerging role of emotions in work life: An introduction. Journal of Organizational Behavior, 21, 123–129.

    Article  Google Scholar 

  • Fox, S., & Spector, P. E. (2000). Relations of emotional intelligence, practical intelligence, general intelligence, and trait affectivity with interview outcomes: It’s not all just “G”. Journal of Organizational Behavior, 21, 203–220.

    Article  Google Scholar 

  • Funder, D. C., & Sneed, C. D. (1993). Behavioral manifestations of personality: An ecological approach to judgmental accuracy. Journal of Personality and Social Psychology, 64, 479–490.

    Article  PubMed  Google Scholar 

  • Gignac, G. E., Stough, C., & Loukomitis, S. (2004). Openness, intelligence, and self-report intelligence. Intelligence, 32, 133–143.

    Article  Google Scholar 

  • Gill, A. J., Oberlander, J., & Austin, E. (2006). Rating e-mail personality at zero acquaintance. Personality and Individual Differences, 40, 497–507.

    Article  Google Scholar 

  • Gosling, S. D., Rentfrow, P. J., & Swann, W. B, Jr. (2003). A very brief measure of the Big Five personality domains. Journal of Research in Personality, 37, 504–528.

    Article  Google Scholar 

  • Hakel, M. D. (1982). Employment interviewing. In K. M. Rowland & G. R. Ferris (Eds.), Personnel Management (pp. 129–155). Boston: Allyn and Bacon.

    Google Scholar 

  • Highhouse, S., & Bottrill, K. V. (1995). The influence of social (mis)information on memory for behavior in an employment interview. Organizational Behavior and Human Decision Processes, 62, 220–229.

    Article  Google Scholar 

  • Hofstee, W. K. (1994). Who should own the definition of personality? European Journal of Personality, 8, 149–162.

    Article  Google Scholar 

  • Hogan, R. T. (1996). A socioanalytic perspective on the five-factor model. In J. S. Wiggins (Ed.), The five-factor model of personality (pp. 163–179). New York: Guilford Press.

    Google Scholar 

  • Hogan, R. T. (2007). Personality and the fate of organizations. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Hogan, R. T., & Shelton, D. S. (1998). A socioanalytic perspective on job performance. Human Performance, 11, 129–144.

    Article  Google Scholar 

  • Huffcutt, A. I., & Arthur, W. J. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 577–580.

    Article  Google Scholar 

  • Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001a). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897–913.

    Article  PubMed  Google Scholar 

  • Huffcutt, A. I., & Roth, P. L. (1998). Racial group differences in interview evaluations. Journal of Applied Psychology, 83, 288–297.

  • Huffcutt, A. I., Roth, P. L., & McDaniel, M. A. (1996). A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459–473.

    Article  Google Scholar 

  • Huffcutt, A. I., Van Iddekinge, C. H., & Roth, P. L. (2011). Understanding applicant behavior in employment interviews: A theoretical model of interviewee performance. Human Resource Management Review, 21, 353–367.

    Google Scholar 

  • Huffcutt, A. I., Weekley, J. A., Wiesner, W. H., DeGroot, T., & Jones, C. (2001b). Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619–644.

    Article  Google Scholar 

  • Hunter, J. E., & Hirsch, H. R. (1987). Applications of meta-analysis. In C. I. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (Vol. 2, pp. 257–321). New York: Wiley.

    Google Scholar 

  • Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.

    Article  Google Scholar 

  • Hunter, J. E., Schmidt, F. L., & Le, H. (2006). Implications of direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology, 91, 594–612.

    Article  PubMed  Google Scholar 

  • Hurtz, G. M., & Donovan, J. J. (2000). Personality and job performance: The five revisited. Journal of Applied Psychology, 85, 869–879.

    Article  PubMed  Google Scholar 

  • Janz, T. (1982). Initial comparisons of patterned behavioral description interviews versus unstructured interviews. Journal of Applied Psychology, 67, 577–580.

    Article  Google Scholar 

  • John, O. P., & Srivastava, S. (1999). The “Big Five” trait taxonomy: History, measurement, and theoretical perspectives. In L. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102–138). New York: Guilford.

    Google Scholar 

  • Kluemper, D. (2008). Trait emotional intelligence: The impact of core-self evaluations and social desirability. Personality and Individual Differences, 44, 1402–1412.

    Article  Google Scholar 

  • Kluemper, D., DeGroot, T., & Choi, S. (2013). Emotion management ability: Predicting task performance, citizenship, and deviance. Journal of Management, 39, 878–905.

    Article  Google Scholar 

  • Kluemper, D. H., McLarty, B. D., & Bing, M. N. (2014). Acquaintance ratings of the Big Five personality traits: Incremental validity beyond and interactive effects with self-reports in the prediction of workplace deviance. Journal of Applied Psychology. doi:10.1037/a0037810

  • Kluemper, D. H., & Rosen, P. (2009). Future employment selection methods: Evaluating social networking websites. Journal of Managerial Psychology, 24, 567–580.

    Article  Google Scholar 

  • Kluemper, D., Rosen, P., & Mossholder, K. (2012). Social networking websites, personality ratings, and the organizational context: More than meets the eye? Journal of Applied Social Psychology, 42, 1143–1172.

    Article  Google Scholar 

  • Kolar, D. W., Funder, D. C., & Colvin, C. R. (1996). Comparing the accuracy of personality judgments by the self and knowledgeable others. Journal of Personality, 64, 311–337.

    Article  PubMed  Google Scholar 

  • Konig, C. J., Melchers, K. G., Kleinmann, M., Richter, G. M., & Klehe, U. C. (2007). Candidates’ ability to identify criteria in nontransparent selection procedures: Evidence from an assessment center and a structured interview. International Journal of Selection and Assessment, 15, 283–292.

    Article  Google Scholar 

  • Kristof-Brown, A. L., Barrick, M. R., & Franke, M. (2002). Influences and outcomes of candidate impression management in job interviews. Journal of Management, 28, 27–46.

    Article  Google Scholar 

  • Latham, G. P., Saari, L. M., Pursell, E. D., & Campion, M. A. (1980). The situational interview. Journal of Applied Psychology, 65, 422–427.

    Article  Google Scholar 

  • Lievens, F., Highhouse, S., & DeCorte, W. (2005). The importance of traits and abilities in supervisors’ hireability decisions as a function of method of assessment. Journal of Occupational and Organizational Psychology, 78, 453–470.

    Article  Google Scholar 

  • Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence. In P. Salovey & D. J. Sluyter (Eds.), Emotional development and emotional intelligence. New York: Basic Books.

    Google Scholar 

  • McCrae, R. R., & Costa, P. T. (1999). A five-factor theory of personality. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research. New York: Guilford Press.

    Google Scholar 

  • McCrae, R. R., & Weiss, A. (2007). Observer ratings of personality. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology. New York: Guilford Press.

    Google Scholar 

  • McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599–616.

    Article  Google Scholar 

  • McFarland, L. A., & Ryan, A. M. (2000). Variance in Faking Across Noncognitive Measures. Journal of Applied Psychology, 85, 812–821.

    Article  PubMed  Google Scholar 

  • Morris, J. H., Sherman, J., & Mansfield, E. R. (1986). Failures to detect moderating effects with ordinary least squares moderated-regression: Some reasons and a remedy. Psychological Bulletin, 99, 282–288.

    Article  Google Scholar 

  • Mount, M. K., Barrick, M. R., & Strauss, J. P. (1994). Validity of observer ratings of the Big Five personality factors. Journal of Applied Psychology, 79, 272–280.

    Article  Google Scholar 

  • O’Boyle, E. H., Humphrey, R. H., Pollack, J. M., Hawver, T. H., & Story, P. A. (2010). The relation between emotional intelligence and job performance: A meta-analysis. Journal of Organizational Behavior, 32, 788–818.

    Article  Google Scholar 

  • Oh, I., Wang, G., & Mount, M. K. (2011). Validity of observer ratings of the five-factor model of personality traits: A meta-analysis. Journal of Applied Psychology, 96, 762–773.

    Article  PubMed  Google Scholar 

  • Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660–679.

    Article  Google Scholar 

  • Podsakoff, P. M., MacKenzie, S. B., Lee, J., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.

    Article  PubMed  Google Scholar 

  • Posthuma, R. A., Morgeson, F. P., & Campion, M. A. (2002). Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology, 55, 1–81.

    Article  Google Scholar 

  • Reynolds, W. M. (1982). Development of reliable and valid short forms of the Marlowe–Crowne social desirability scale. Journal of Clinical Psychology, 38, 119–125.

    Article  Google Scholar 

  • Roberts, B. W. (2009). Back to the future: Personality and assessment and personality development. Journal of Research in Personality, 43, 137–145.

    Article  PubMed  PubMed Central  Google Scholar 

  • Robertson, I. T., & Smith, M. (2001). Personnel selection. Journal of Occupational and Organizational Psychology, 74, 441–472.

    Article  Google Scholar 

  • Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634–644.

    Article  Google Scholar 

  • Roth, P. L., & Huffcutt, A. I. (2013). A meta-analysis of interviews and cognitive ability: Back to the future? Journal of Personnel Psychology, 12, 157–169.

    Article  Google Scholar 

  • Roth, P. L., Van Iddekinge, C. H., Huffcutt, A. I., Edison, C. E, Jr, & Schmit, M. J. (2005). Personality saturation in structured interviews. International Journal of Selection and Assessment, 13, 261–273.

    Article  Google Scholar 

  • Salgado, J. F., & Moscoso, S. (2002). Comprehensive meta-analysis of the construct validity of the employment interview. European Journal of Work and Organizational Psychology, 11, 299–326.

    Article  Google Scholar 

  • Salovey, P., & Mayer, J. D. (1990). Emotional intelligence. Imagination, cognition, and personality, 9, 185–211.

    Article  Google Scholar 

  • Schmidt, N., & Ostroff, C. (1986). Operationalizing the “behavioral consistency” approach: Selection test development based on a content-oriented strategy. Personnel Psychology, 39, 91–108.

    Article  Google Scholar 

  • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.

    Article  PubMed  Google Scholar 

  • Srull, T. K., & Wyer, R. S. (1989). Person memory and judgment. Psychological Review, 96, 58–83.

    Article  PubMed  Google Scholar 

  • Sue-Chan, C., & Latham, G. P. (2005). The situational interview as a predictor of academic and team performance: A study of the mediating effects of cognitive ability and emotional intelligence. International Journal of Selection and Assessment, 12, 312–320.

    Google Scholar 

  • Townsend, R. J., Bacigalupi, S. C., & Blackman, M. C. (2007). The accuracy of lay integrity assessments in simulated employment interviews. Journal of Research in Personality, 41, 540–557.

    Article  Google Scholar 

  • Van Iddekinge, C. H., Raymark, P. H., & Roth, P. L. (2005). Assessing personality with a structured employment interview: Construct-related validity and susceptibility to response inflation. Journal of Applied Psychology, 90, 536–552.

    Article  PubMed  Google Scholar 

  • Wonderlic & Associates. (1992). Wonderlic personnel test and scholastic level exam: User’s Manual. Libertyville, IL: Wonderlic Personnel Test, Inc,

    Google Scholar 

  • Wong, C. S., & Law, K. S. (2002). The effect of leader and follower emotional intelligence on performance and attitude: An exploratory study. Leadership Quarterly, 13, 243–274.

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank Tim DeGroot and Lilli A. Bishop for helpful comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Donald H. Kluemper.

Appendix

Appendix

Behavioral Interview Questions

Tell me about a time when you were challenged to get somebody to do something they really did not want to do.

  1. 1.

    Please describe a time when you had to work with someone who was difficult to get along with.

  2. 2.

    At times we are put in situations where we find ourselves correcting someone’s behavior because it is inappropriate, offensive, or just plain wrong for other reasons. Tell me about a situation where you had to confront someone who was doing something wrong.

  3. 3.

    Please explain something you have done in a work situation that shows how creative or innovative you can be.

  4. 4.

    Please explain a recent decision that you had to make that was particularly challenging or complicated.

Situational Interview Questions

  1. 1.

    Imagine you were working with a fellow worker whom you knew greatly disliked performing a particular job task. You were in a situation where you needed this task completed, and this employee was the only one available to assist you. What would you do to motivate the employee to perform this task?

  2. 2.

    Imagine being in a situation with both a co-worker and a client in which the client is being unreasonable. Your co-worker appears frustrated and begins to make comments that may be construed as sarcastic and offensive. How do you handle this situation?

  3. 3.

    Imagine that, as part of a living unit activity, you are dealing with client who is difficult to deal with. In front of all the other clients, they refuse to follow your directives. How would you go about dealing with the client?

  4. 4.

    Suppose you are working on an important report and become increasingly uncertain whether or not you will complete the project by the stated deadline set for you by your supervisor. How would you deal with this situation?

  5. 5.

    Imagine that your boss is sick and you are asked to fill in for him or her for a few weeks. One particular task requiring attention is to plan for an upcoming outing to a local park including yourself, two additional staff, and 12 clients. What would you do to prepare for this outing?

figure a
figure b
figure c
figure d
figure e

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kluemper, D.H., McLarty, B.D., Bishop, T.R. et al. Interviewee Selection Test and Evaluator Assessments of General Mental Ability, Emotional Intelligence and Extraversion: Relationships with Structured Behavioral and Situational Interview Performance. J Bus Psychol 30, 543–563 (2015). https://doi.org/10.1007/s10869-014-9381-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10869-014-9381-6

Keywords

Navigation