Abstract
Building on our evaluation of a field test (Milanowski & Heneman, 2001), the present study provides a description and evaluation of the first two years of district-wide implementation of a standards-based teacher evaluation system in the Cincinnati public schools. We describe the new system and changes that were made to it as a result of the pilot study. We then focus on two substantive research issues—the inter-rater agreement of classroom observations and teacher reactions to the new system. We found that carefully selected and trained peer evaluators provided ratings that showed moderate to high agreement with ratings by administrators. Teachers' specific reactions to the new system on several dimensions were found to be mostly neutral. Teachers' overall reactions to the new system, however, were less favorable. Based on these results and other research we make several suggestions for how to effectively design and implement a standards-based teacher evaluation system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Armstrong, M. (2000). Performance Management (2nd edn). London: Kogan Page.
Brewster, C., & Railsback, J. (2001). Supporting Beginning Teachers: How Administrators Teachers, and Policymakers Can Help New Teachers Succeed. Portland, OR: Noethwest Regional Educational Laboratory.
Danielson, C. (1996). Enhancing Professional Practice: A Framework for Teaching. Alexandria, VA: Association for Supervision and Curriculum Development.
Danielson, C., & McGreal, T.L. (2000). Teacher Evaluation to Enhance Professional Practice. Alexandria, VA: Association for Supervision and Curriculum Development.
Davis, D.R., Pool, J.E., & Mits-Cash, M. (2000). Issues in Implementing a New Teacher Assessment System in a Large Urban School District: Results of a Qualitative Field Study. Journal of Personnel Evaluation in Education, 14(4), 285–306.
Grote, D. (1996). The Complete Guide to Performance Appraisal. New York: American Management Association.
Hedge, S.W., & Teachout, M.S. (2000). Exploring the Concept of Acceptability as a Criterion for Evaluating Performance Measures. Group and Organization Management, 25(1), 22–4.
Heneman, H.G. Ill, & Milanowski, A.T. (in press) Alignment of Human Resource Practices and Teacher Performance Competencies. Peabody Journal of Education.
Ingersoll, R.M. (2003). Is There Really a Teacher Shortage? Seattle, VA: University of Washington, Center for the Study of Teaching and Policy.
Johnson, S.M. (1990). Teachers at Work: Achieving Success in our Schools. New York: Basic Books.
Keeping, L.M., & Levy, P.E. (2000). Performance Appraisal Reactions: Measurements, Modeling, and Method Bias. Journal of Applied Psychology, 85, 708–723.
Kelly, C., Heneman III, H.G., & Milanowski, A. (2002). Teacher Motivation and School-Based Performance Awards. Educational Administration Quarterly, 38(3), 372–401.
Loftus, S. (2002). New Teacher Excellence: Retaining Our Best. Washington, D.C.: Alliance for Excellent Education.
McConney, A., Ayres, R., Hansen, J.B., & Culbertson, L. (2003). Quest for Quality: Recruitment, Retention, Professional Development, and Performance Evaluation in Baltimore City's Public Schools. Journal of Education for Student Placed at Risk, 8(1), 87–116.
McLaughlin, M.W, & Pfeifer, R.S. (1988). Teacher Evaluation: Improvement Accountability and Effective Learning. New York: Teachers College Press.
Medley, D.M., & Coker, H. (1987). The Accuracy of Principals' Judgments of Teacher Performance. Journal of Educational Research, 80(4), 242–247.
Milanowski, A.T, & Heneman, H.G. III. (2001). Assessment of Teacher Reactions to a Standards-Based Teacher Evaluation System: A Pilot Study. Journal of Personnel Evaluation in Education, 15(3), 193–212.
Mohrman, A.M. Jr., Resnick-West, S.M., & Lawler, E.E. III. (1989). Designing Performance Appraisal Systems: Aligning Appraisals and Organizational Realities. San Francisco: Jossey-Bass.
Peterson, K.D. (2000). Teacher Evaluation: A Comprehensive Guide to New Directions and Practice, 2nd Ed. Thousand Oaks, CA: Corwin Press.
Whitener, S.D., Gruber, K.J., Lynch, H., Tingos, K., Perona, M., & Fondelier, S. (1997). Characteristics of Stayers, Movers, and Leavers: Results from the Teacher Followup Survey. Washington, D.C.: USDE, Office of Educational Research and Improvement.
Wise, A.E., Darling-Hammond, L., McLaughlin, M.W, & Berstein, H.T. (1984). Teacher Evaluation: A Study of Effective Practices. Santa Monica, CA: RAND.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Heneman, H.G., Milanowski, A.T. Continuing Assessment of Teacher Reactions to a Standards-Based Teacher Evaluation System. Journal of Personnel Evaluation in Education 17, 173–195 (2003). https://doi.org/10.1023/B:PEEV.0000032427.99952.02
Issue Date:
DOI: https://doi.org/10.1023/B:PEEV.0000032427.99952.02