Abstract
Objective:To determine the reliability and validity of an evaluation form for assessing the bumanistic behavior of internal medicine (IM) housestaff. The form is for use by nurses.
Design:Evaluations were gathered three times during the 1987–88 academic year. Generalizability coefficients (interpreted like traditional reliability coefficients) were generated to establish the form’s reliability, while data from attending physicians and from housestaff evaluation committee members were used to help establish its validity.
Setting:Three hospitals in central Ohio: a large university tertiary care center, a large private hospital, and an urban community hospital.
Participants:The nurse raters were volunteers solicited by their head nurses. The criteria governing their participation were two years of postraduate experience in nursing and regular contact with residents, which was self-determined. All IM residents who had worked on a medicine inpatient service at least once during the months under study were included. A total of 493 nurses and 116 residents participated.
Results:Sixty-four percent of the generalizability coefficients were 0.90 or higher, and 82% were above 0.75, indicating stable, reliable ratings. The nurses’ ratings were positively and significantly correlated with attending faculty’s and evaluation committee members’ ratings (r=0.38, p<0.01; r=0.49, p<0.001).
Conclusions:The evaluation form and the nurses provided consistent, reliable information about medical residents’ humanistic behavior; data from five to six nurses should provide statistically reliable ratings using this form. Also, nurses’ data yielded information somewhat different from those provided by physicians, suggesting that the form is a useful instrument for assessing this dimension of residents’ performance.
Similar content being viewed by others
References
A guide to awareness and evaluation of humanistic qualities in the internist. Portland, OR: American Board of Internal Medicine, 1985.
Butterfield PS, Mazzaferri EL, Sachs L. NUrses as evaluators of medical residents’ humanistic behavior. J Med Educ. 1987;62:842–9.
Dixon WJ, ed. BMDP statistical software. Berkeley, CA: University of California Press, 1981.
Crick JE, Brennan RL. Manual for GENOVA: a generalized analysis of variance system. ACT technical bulletin 43. Iowa City, IA: American College Testing Program, 1983.
Abbott LC. A study of humanism in family physicians. J Fam Pract 1983;16:1141–6.
Merrill JM, Boisaubim EV, Laux L, Lynch EC, Roessler R, Thornby JI. Measuring ‘humanism’ in medical residents. South Med J. 1986;79:141–4.
Linn LS, DiMatteo RM, Cope DW, Robbins A. Measuring physicians’ humanistic attitudes, values, and behaviors. Med Care. 1987;25:504–15.
Shatney CH, Friend BE. Potential role of nurses in assessing house officer performance in the critical care environment. Crit Care Med. 1984;12:117–20.
Blurton RR, Mazzaferri EL. Assessment of interpersonal skills and humanistic qualities in medical residents. J Med Educ. 1985;60:648–50.
Tintinalli JE. Evaluation of emergency medicine residents by nurses. Acad Med. 1989;64:49–50.
Linn LS, Oye RK, Cope DW, DiMatteo MR. Use of nonphysician staff to evaluate humanistic behavior of internal medicine residents and faculty members. J Med Educ. 1986;61:918–20.
Butterfield PS, Pearsol JA. Nurses in resident evaluation: a qualitative study of the participants’ perspectives. Eval Health Professions. 1990;13:453–73.
Author information
Authors and Affiliations
Additional information
Received from the Department of Internal Medicine, The Ohio State University, Columbus, Ohio.
Supported by a grant from the American Board of Internal Medicine.
Rights and permissions
About this article
Cite this article
Butterfield, P.S., Mazzaferri, E.L. A new rating form for use by nurses in assessing residents’ humanistic behavior. J Gen Intern Med 6, 155–161 (1991). https://doi.org/10.1007/BF02598316
Issue Date:
DOI: https://doi.org/10.1007/BF02598316