Skip to main content

Work Samples and Simulations in Competency Evaluation

  • Chapter
Evaluation and Accountability in Clinical Training

Abstract

The evaluation of student competence in clinical training is part of the broader issue of competency evaluation across a variety of professions. Many disciplines have similar needs to evaluate the application of skills as distinct from levels or scope of knowledge. Work samples and simulations offer alternative measurement methods to paper-and-pencil testing that can well be applied to skill application. The usefulness of such methods for evaluation of interactive skills is particularly appropriate to clinical training.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Albo, D., Jr., Taylor, C. W., and Page, B. (1982). Evaluating the performances of resident-physicians against the target of excellent physicians in practice. In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance (pp. 113–125 ). Chicago: American Board of Medical Specialties.

    Google Scholar 

  • American Dental Hygienists’ Association. (1978). Dental hygiene clinical evaluation for state licensure. Washington, DC: U.S. Department of Commerce.

    Google Scholar 

  • American Psychological Association, Committee on Standards for Providers of Psychological Services. (1981). Specialty guidelines for the delivery of services by industrial/organizational psychologists. American Psychologist, 36, 664–669.

    Article  Google Scholar 

  • Anastasi, A. (1982). Psychological testing ( 5th ed. ). New York: Macmillan.

    Google Scholar 

  • Asher, J., and Sciarrino, J. A. (1974). Realistic work sample tests: A review. Personnel Psychology, 27, 519–533.

    Google Scholar 

  • Borman, W. C. (1979). Format and training effects on rating accuracy and rating errors. Journal of Applied Psychology, 64, 410–421.

    Article  Google Scholar 

  • Borman, W. C. (1982). Evaluating performance effectiveness on the job: How can we generate more accurate ratings? In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance (pp. 179–193 ). Chicago: American Board of Medical Specialties.

    Google Scholar 

  • Bray, D. W. (1982, October). Combining heterogeneous data in competence evaluation. Paper presented at the Conference on Professional Competence Evaluation. American Board of Professional Psychology, Washington, DC.

    Google Scholar 

  • Bray, D. W., and Howard A. (1983). The ATandT longitudinal studies of managers. In K. W. Schaie (Ed.), Longitudinal studies of adult psychological development (pp. 266312 ). New York: Guilford Press.

    Google Scholar 

  • Bray, D. W., Campbell, R. J., and Grant, D. L. (1974). Formative years in business. New York: Wiley.

    Google Scholar 

  • Brugnoli, G. A., Campion, J. E., and Basen, J. A. (1979). Racial bias in the use of work samples for personnel selection. Journal of Applied Psychology, 64, 119–123.

    Article  Google Scholar 

  • Byham, W. C. (1982, October). Developing examiner skills in competence evaluation. Paper presented at the Conference on Professional Competence Evaluation, American Board of Professional Psychology, Washington, DC.

    Google Scholar 

  • Carlson, H. S. (1978). The AASPB story: The beginning and first 16 years of the American Association of State Psychology Boards, 1961–1977. American Psychologist, 33, 486–495.

    Article  Google Scholar 

  • Cascio, W. F., and Phillips, N. F. (1979). Performance testing: A rose among thorns? Personnel Psychology, 32, 751–766.

    Article  Google Scholar 

  • Gordon, M. E., and Kleiman, L. S. (1976). The prediction of trainability using a work sample test and an aptitude test: A direct comparison. Personnel Psychology, 29, 243–253.

    Google Scholar 

  • Gronlund, N. E. (1965). Measurement and evaluation in teaching. Toronto, Canada: Macmillan.

    Google Scholar 

  • Guion, R. M. (1978). Scoring of content domain samples: The problem of fairness. Journal of Applied Psychology, 63, 499–506.

    Google Scholar 

  • Harden, R. M., and Gleeson, F. A. (1979). Assessment of clinical competence using an objective structured clinical examination ( OSCE ). Medical Education, 13, 41–54.

    Google Scholar 

  • Howard, A. (1982, January). Who are the industrial/organizational psychologists? An analysis of data from the 1981 APA Directory survey. Report prepared for the Executive Committee of APA’s Division of Industrial and Organizational Psychology (Division 14 ).

    Google Scholar 

  • Howard, A„ and Lowman, R. L. ( 1982, January). Licensing and industrial/organizational psychology: Background and issues. Report prepared for the Executive Committee of APA’s Division of Industrial and Organizational Psychology (Division 14 ).

    Google Scholar 

  • Hurley, H. J. (1982). The Part II certifying examination in dermatology: An assessment of interpretive skills. In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance (pp. 43–50 ). Chicago: American Board of Medical Specialties.

    Google Scholar 

  • Ivancevich, J. M. (1979). Longitudinal study of the effects of rater training on psychometric error in ratings. Journal of Applied Psychology, 64, 502–508.

    Article  Google Scholar 

  • Lamont, C. T., and Hennen, B. K. E. (1972). The use of simulated patients in a certificatioi examination in family medicine. Journal of Medical Education, 789–795.

    Google Scholar 

  • Latham, G. P., Wexley, K. N., and Pursell, E. D. (1975). Training managers to minimize rating errors in the observation of behavior. Journal of Applied Psychology, 60, 550–555.

    Article  Google Scholar 

  • Livson, N. (1973). Developmental dimensions of personality: A life-span formulation. In P. B. Baltes and K. W. Schaie (Eds.), Life-span developmental psychology: Personality and socialization. New York: Academic Press.

    Google Scholar 

  • McConnell, J. J., and Parker, T. (1972). An assessment center program for multiorganizational use. Training and Development Journal, 26, 6–14.

    Google Scholar 

  • McGuire, C. H., and Babbott, D. (1967). Simulation technique in the measurement of problem-solving skills. Journal of Educational Measurement, 4, 1–10.

    Article  Google Scholar 

  • Miller, E. V. (1982). Performance checklist to evaluate anesthesia skills. In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance. Chicago: American Board of Medical Specialties.

    Google Scholar 

  • Miller, J. N., and Engin, A. W. (1974). Performance-based school psychology certification: Situational response testing. Psychology in the Schools, 11, 422–424.

    Google Scholar 

  • Morgenstern, A. L. (1972). A systematic approach for oral board examinations in psychiatry. American Journal of Psychiatry, 129, 54–58.

    PubMed  Google Scholar 

  • Naftulin, D. H., Wolkon, G. H., Donnelly, F. A., Burgoyne, R. W., Kline, F. M., and Hansen, H. E. (1977). A comparison of videotaped and live patient interview examinations and written examinations in psychiatry. American Journal of Psychiatry, 134, 1093–1097.

    PubMed  Google Scholar 

  • Office of Strategic Services Assessment Staff. (1948). Assessment of men. New York: Rinehart.

    Google Scholar 

  • Ofsanko, F. J., and Paulson, C. C. ( 1977, February). Who interviews the interviewer—and how? The Personnel Administrator, 27–29.

    Google Scholar 

  • -point lag found in black’s S.A.T. scores. ( 1982, October 5). The New York Times, p. A21.

    Google Scholar 

  • Reed, G. F. (1982). The use of visual materials in the evaluation of interpretive skills. In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance. Chicago: American Board of Medical Specialties.

    Google Scholar 

  • Scheiber, S. C. (1976). Board certification in psychiatry: An eye toward the future, Psychiatric Forum, 6, 22–25.

    Google Scholar 

  • Schmidt, F. L., Greenthal, A. L., Hunter, J. E., Berner, J. G., and Seaton, W. (1977). Job sample vs. paper-and-pencil trades and technical tests: Adverse impact and examinee attitudes. Personnel Psychology, 30, 187–197.

    Google Scholar 

  • Schoon, C. (1982, October). Update on activities by the Professional Examination Service. Paper presented at the Conference on Professional Competence Evaluation, American Board of Professional Psychology, Washington, DC.

    Google Scholar 

  • Shoemaker, J. T., and Splitter, J. L. (1976). A competency-based model for counselor certification. Counselor Education and Supervision, 267–274.

    Google Scholar 

  • Silzer, R. F. (1978, August). Competency assessment: Use of performance rating scales and assessment centers. Paper presented at the meeting of the American Psychological Association, Toronto, Canada.

    Google Scholar 

  • Small, S. M. (1982). Evaluation methodology for the oral examination of the American Board of Psychiatry and Neurology. In J. S. Lloyd (Ed.), Evaluation of noncognitive skills and clinical performance (pp. 33–41 ). Chicago: American Board of Medical Specialties.

    Google Scholar 

  • Thornton, G. C., III, and Byham, W. C. (1982). Assessment centers and managerial performance. New York: Academic Press.

    Google Scholar 

  • Wernimont, P. F., and Campbell, J. P. (1968). Signs, samples, and criteria. Journal of Applied Psychology, 52, 372–376.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Plenum Press, New York

About this chapter

Cite this chapter

Howard, A. (1987). Work Samples and Simulations in Competency Evaluation. In: Edelstein, B.A., Berler, E.S. (eds) Evaluation and Accountability in Clinical Training. Springer, Boston, MA. https://doi.org/10.1007/978-1-4684-5281-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4684-5281-5_3

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4684-5283-9

  • Online ISBN: 978-1-4684-5281-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics