Abstract
Background
Professionalism is identified as a competency of resident education. Best approaches to teaching and evaluating professionalism are unknown, but feedback about professionalism is necessary to change practice and behavior. Faculty discomfort with professionalism may limit their delivery of feedback to residents.
Objectives
A pilot program to implement a 360-degree evaluation of observable professionalism behaviors and determine how its use impacts faculty feedback to residents.
Design
Internal Medicine (IM) residents were evaluated during ambulatory rotations using a 360-degree assessment of professional behaviors developed by the National Board of Medical Examiners®. Faculty used evaluation results to provide individual feedback to residents.
Patients/Participants
Fifteen faculty members.
Measurements and Main Results
Faculty completed pre- and post-intervention surveys. Using a 7-point Likert scale, faculty reported increased skill in giving general feedback (4.85 vs 4.36, p < .05) and feedback about professionalism (4.71 vs 3.57, p < .01) after the implementation of the 360-degree evaluation. They reported increased comfort giving feedback about professionalism (5.07 vs 4.35, p < .05) but not about giving feedback in general (5.43 vs 5.50).
Conclusions
A 360-degree professionalism evaluation instrument used to guide feedback to residents improves faculty comfort and self-assessed skill in giving feedback about professionalism.
References
ABIM Foundation, ACP-ASIM Foundation, European Federation of Internal Medicine. Medical professionalism in the new millennium: A physician charter. Ann Intern Med. 2002;136:243–6.
Accreditation Council on Graduate Medical Education. ACGME Outcome Project 1999 http://www.acgme.org/outcome/comp/compMin.asp. Accessed March 3, 2008.
Cruess SR , Cruess RL. Professionalism must be taught. BMJ. 1997;315:1674–7.
Jotkowitz AB , Glick S , Porath A. A physician charter on medical professionalism: A challenge for medical education. Eur J Intern Med. 2004;15:5–9.
Reynolds PP. Reaffirming professionalism through the education community. Ann Intern Med. 1994;120:609–14.
Cohen JJ. Professionalism in medical education, an American perspective: From evidence to accountability. Med Educ. 2006;40:607–17.
Cruess RL. Teaching professionalism: theory, principles, and practices. Clin Orthop Relat Res. 2006;449:177–85.
Stern DT. Practicing what we preach? An analysis of the curriculum of values in medical education. Am J Med. 1998;104:569–75.
Ende J. Feedback in clinical medical education. JAMA. 1983;250:777–81.
Hewson MG , Little ML. Giving feedback in medical education: Verification of recommended techniques. J Gen Intern Med. 1998;13:111–6.
Branch WT , Paranjape A. Feedback and reflection: Teaching methods for clinical settings. Acad Med. 2002;77:1185–8.
The National Board of Medical Examiners. Assessment of Professional Behaviors 2006–2007 Field Trial http://professionalbehaviors.nbme.org/OverviewForWeb.pdf. Accessed March 23, 2007.
Lynch DC , Surdyk PM , Eiser AR. Assessing professionalism: A review of the literature. Med Teach. 2004;26:366–73.
Musick DW , McDowell SM , Clark N , Salcido R. Pilot study of a 360-degree assessment instrument for physical medicine & rehabilitation residency programs. Am J Phys Med Rehabil. 2003;82:394–402.
Wood J , Collins J , Burnside ES , et al. Patient, faculty, and self-assessment of radiology resident performance: A 360-degree method of measuring professionalism and interpersonal/communication skills. Acad Radiol. 2004;11:931–9.
Joshi R , Ling FW , Jaeger J. Assessment of a 360-degree instrument to evaluate residents' competency in interpersonal and communication skills. Acad Med. 2004;79:458–63.
Higgins RS , Bridges J , Burke JM , O'Donnell MA , Cohen NM , Wilkes SB. Implementing the ACGME general competencies in a cardiothoracic surgery residency program using 360-degree feedback. Ann Thorac Surg. 2004;77:12–7.
Papadakis MA , Hodgson CS , Teherani A , Kohatsu ND. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Acad Med. 2004;79:244–9.
Papadakis MA , Teherani A , Banach MA , et al. Disciplinary action by medical boards and prior behavior in medical school. N Engl J Med. 2005;353:2673–82.
Acknowledgement
The authors thank the NBME® for use of the Assessment of Professional Behaviors instrument and Dr. Stephen Clyman, Margaret Farrell, and Dr. Matthew Holtman for their assistance in the planning, implementation, and design of this project. We are grateful for the assistance of the staff and faculty at Internal Medicine Associates and the residents in the Internal Medicine Residency Program at Mount Sinai Medical Center.
Conflicts of interest
None disclosed.
Funding
Dr. Stark was supported by grants from the Empire Clinical Research Investigator Program, New York State Department of Health and U.S. Department of Health and Human Services, Health Resources and Services Administration CFDA 93–895.
Author information
Authors and Affiliations
Corresponding author
Appendix: Faculty survey
Appendix: Faculty survey
___________________________________________________________
Please rate your level of skill in giving general feedback to interns/residents:
1 2 3 4 5 6 7
Unskilled Expert
___________________________________________________________
Please rate your level of skill in giving feedback about professionalism to interns/residents:
1 2 3 4 5 6 7
Unskilled Expert
___________________________________________________________
I feel comfortable giving feedback to the interns/residents I work with.
1 2 3 4 5 6 7
Strongly Disagree Strongly Agree
___________________________________________________________
I feel comfortable giving feedback to interns/residents about their knowledge.
1 2 3 4 5 6 7
Strongly Disagree Strongly Agree
___________________________________________________________
I feel comfortable giving feedback to interns/residents about their interpersonal communication skills.
1 2 3 4 5 6 7
Strongly Disagree Strongly Agree
___________________________________________________________
I feel comfortable giving feedback interns/residents about their professional behavior.
1 2 3 4 5 6 7
Strongly Disagree Strongly Agree
___________________________________________________________
I provide feedback to the interns/residents I work with.
1 2 3 4 5 6 7
Never Always
___________________________________________________________
The feedback I give to interns/residents includes an assessment of their medical knowledge.
1 2 3 4 5 6 7
Never Always
___________________________________________________________
The feedback I give to interns/residents includes an assessment of their interpersonal communication skills.
1 2 3 4 5 6 7
Never Always
___________________________________________________________
The feedback I give to interns/residents includes an assessment of their professionalism.
1 2 3 4 5 6 7
Never Always
___________________________________________________________
How important is providing house staff with feedback about medical knowledge?
1 2 3 4 5 6 7
Not at all Important Extremely Important
___________________________________________________________
How important is providing house staff with feedback about interpersonal communication skills?
1 2 3 4 5 6 7
Not at all Important Extremely Important
___________________________________________________________
How important is providing house staff with feedback about professionalism?
1 2 3 4 5 6 7
Not at all Important Extremely Important
___________________________________________________________
Rights and permissions
About this article
Cite this article
Stark, R., Korenstein, D. & Karani, R. Impact of a 360-degree Professionalism Assessment on Faculty Comfort and Skills in Feedback Delivery. J GEN INTERN MED 23, 969–972 (2008). https://doi.org/10.1007/s11606-008-0586-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-008-0586-0