Abstract
This study reviewed and summarized the literature on the use of written tests in the selection of firefighters using a sample of 13,418 individuals drawn from 101 samples. For the prediction of job performance, cognitive tests showed substantial validity (.42), although mechanical comprehension tests showed even higher validity (.54). However, the best prediction was obtained by tests which were composites of cognitive and mechanical predictors (.56). Training criteria was best predicted by cognitive measures (.77), although mechanical comprehension predictors also showed substantial prediction value (.62). Tests which were composites of cognitive and mechanical measures showed validities equal to that of cognitive measures (.77).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Campbell, J.C. (1982). Editorial. Some remarks from the outgoing editor. Journal of Applied Psychology, 67, 671–700.
Hirsh, H.R., Northrop, L.C., & Schmidt, F.L. (1986). Validity generalization results for law enforcement occupations. Personnel Psychology, 39, 399–420.
Hunter, J. E. & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Beverly Hills, California: Sage Publications.
Law, K. S., Schmidt, F. L., & Hunter, J. E. (1991). Non-linearity of range correlations in meta-analysis: A test of an improved procedure. Submitted for publication.
McDaniel, M. A. (1986). Computer programs for calculating meta-analysis statistics. Educational and Psychological Measurement, 46, 175–177.
McDaniel, M. A., Schmidt, F. L., & Hunter, J. E. (1988). A meta-analysis of methods for rating training and experience in personnel selection. Personnel Psychology, 41, 283–314.
Pearlman, K. (1979). The validity of tests used to select clerical personnel: A comprehensive summary and evaluation (TS-79–1). U.S. Office of Personnel Management, Personnel Research and Development Center, (NTIS No. PB 80. 102 650).
Schmidt, F. L., Law, K., Hunter, J. E., Rothstein, J. R., Pearlman, K., & McDaniel, M. A. (1993). Refinements in validity generalization procedures: Implications for the situational specificity hypothesis. Journal of Applied Psychology, 78, 3–13.
APPENDIX A: PUBLISHED FIREFIGHTER STUDIES
Alvares, K.M., and Boston, D.A. (1976). THe validation of a selection device for metropolitan firefighters: A comparison of measures of aptitude, personality measures, and measures designed to be job-related. (Technical Report No. TCSC 76–1). Toledo, OH: Toledo Civil Service Commission.
Barrett, G.V., Alexander, R.A., Byers, P., and Klein, I. (1981). Development of an entrance level selection program for firefighters. Akron, Ohio.
Bullock, C. (1981). A firefighter test transportability study: Comparison of Robbins Hose Company (Dover, Delaware) and Maryland counties firefighter jobs. Philadelphia, PA: U.S. Office of Personnel Management, Mid-Atlantic Region.
Civil Service Board, City of Tampa (1977). A validation report: Entry-level firefighters. Tampa, FL: Civil Service Board, City of Tampa.
Ford, S.F., and Sullivan, S.M. (1982). Firefighter validation study: A concurrent study of the entry-level position. NJ: New Jersey Department of Civil Service, Division of Examinations.
Henderson, N.D. (1986). A concurrent validation study of the validity and utility of the 1983 Cleveland firefighter Entry Level examination. Oberlin, OH, Oberlin College, Department of Psychology.
Kriska, S.D., and Hines, C.V. (1984). Firefighter selection-test validation study for the City of Columbus. Columbus, OH: Municipal Civil Service Commission.
Manpower Administration (1958). Technical report on standardization of the General Aptitude Test Battery. Manpower Administration (DOL). Washington, D.C. U.S. Training and Employment Service. June 58.8P.
McCann, F.E., Zupkis, R., Howeth, W.F. and Nichols, G.V. (July, 1975). The validation of McCann Associates ESV Entrance firefighter written test. Huntington Valley, PA: McCann Associates.
MacNaughton, J.F., Richardson, P. and Mellon, S.J., Jr. (1978). Job and worker characteristics of the entry-level firefighter position in the Houston Fire Department. Houston, TX: City of Houston, Legal Department.
Miller, J.M. (1976). Validation of a test for selecting firefighters. Unpublished doctoral dissertation, Marquette University.
Murdy, L.B., and Norton, R.P. (1972). Fire private test validation study: City of Fort Worth Fire Department (IBR Technical Report No. 72–2). Forth Worth, TX: Texas Christian University, Institute of Behavioral Research.
Payne, S.S. (1979). Validity of Test 21 for selection of entry level firefighters in the D.C. Fire Department (Personnel Research and Development Center).
Psychological Services, Inc. (1983). A description of the PSI entry-level Firefighter Selection Test. Washington, D.C.: Psychological Services, Inc.
Rosenfeld, M., and Thornton, R.F. (1976). The development and validation of a firefighter selection examination for the City of Philadelphia. Princeton, NJ: Educational Testing Service, Center for Occupational and Professional Assessment.
Ruedebusch, V.M., Vaaler, T.P., Keck, M., Powers, M., Mendenhall, M., Bayreder, C., and Black, P. (1975). A study of the validity of proposed written examinations for the selection of entry-level firefighters in Des Moines. St. Louis, MO: U.S. Civil Service Commission, Intergovernmental Personnel Programs, St. Louis Region.
Shores, J.A. (1984). Validation of a civil service selection procedures for firefighters. Unpublished master's thesis, California State University, Long Beach, 1984. Masters Abstracts International, 23 (01), 229.
Skinas, N., and Goldstein, L.S. (1975). Construction and validation of an entry-level firefighter examination. Trenton, NJ: New Jersey Department of Civil Service, Division of Examinations, Test Validation and Staff Development Unit.
Strand, T. (1975). A comparative study of two entry level firefighter selection tests. Unpublished doctoral dissertation, Wayne State University.
Sulzer, J.L. (1977). Final report. Test development project for entrance exam for firefighter. New Orleans, LA: City of New Orleans, Department of city civil service.
Tice, T. E. (1970). Selection systems and performance appraisal in the fire service: A study of criteria development and test validation. Unpublished master's thesis, Iowa State University of Science and Technology, Ames, Iowa.
Tyler (1980) study (cited in Bullock, 1981).
van Rijn, P., and Payne, S.S. (1980). Criterion-related validity research base for the D.C. Firefighter Selection Test (Personnel Research Report 80–28). Washington, D.C.: Office of Personnel Management, Personnel Research and Development Center, Examination Services Branch. (NTIS No. PB-81–122 087).
Waibel, J.J., Billingsley, W., and Thorsen, S. (1974). The validation of entry-level firefighter examinations in the states of California and Nevada. Sacramento, CA: Selection Consulting Center. (NTIS No, P-231–997).
Wetrogan, L. I., and Schemmer, F. M. (1986). Development and validation of the B-3 and B-4 entry-level firefighter examinations. (Tech. Rep.) Alexandria, Virginia: International Personnel Management Association.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Barrett, G.V., Polomsky, M.D. & McDaniel, M.A. Selection Tests for Firefighters: A Comprehensive Review and Meta-Analysis. Journal of Business and Psychology 13, 507–513 (1999). https://doi.org/10.1023/A:1022966820186
Issue Date:
DOI: https://doi.org/10.1023/A:1022966820186