Skip to main content

Advertisement

SpringerLink
Log in

Exploring Effectiveness of Classroom Assessments for Students’ Learning in High School Chemistry

  • Published:
Research in Science Education Aims and scope Submit manuscript

Abstract

New notions of science teaching and learning provide challenges for designing and using classroom assessment. Existing assessments are not effective in assessing and supporting desired science learning because they are not designed to capture and aid such learning (NRC 2014; Pellegrino 2013). In addition, it is important to evaluate effectiveness of existing and developed classroom assessments and their usage in supporting desired science learning. Newer notions of validity stress that assessment should have a positive impact on learning and teaching; thus, validity and effectiveness of an assessment should be linked to highlight how an assessment supports learning. Therefore, we suggest that just focusing on the assessment itself, or teachers’ understanding and implementing of assessment, to investigate effectiveness of classroom assessment will be incomplete. This qualitative study focuses on the effectiveness of the designed tasks and of the implementation, according to the teacher and aims to (1) provide a new approach for evaluating effectiveness of developed chemistry assessments and (2) use this approach to illustrate the effectiveness of co-developed assessments by five high school chemistry teachers. We utilized multiple sources of data, including teacher-generated assessments, teachers’ comments on developed assessments, and students’ responses. We designed a rubric to analyze effectiveness and validated it with six expert reviewers. Results showed that the assessments mostly aligned with research-informed principles for effective assessments and helped teachers to achieve their intentions. Our study recommends that teachers develop and utilize various types of classroom assessments that achieve their aims through participation in a collaborative project.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners: implications for policy-based empirical research. Review of Educational Research, 74(1), 1–28.

    Google Scholar 

  • Abell, S. K., & Siegel, M. A. (2011). Assessment literacy: What science teachers need to know and be able to do? In D. Corrigan, J. Dillon, & R. Gunstone (Eds.), The professional knowledge base of science teaching (pp. 205–221). The Netherlands: Springer.

    Google Scholar 

  • Abrahams, I., & Millar, R. (2008). Does practical work really work? A study of the effectiveness of practical work as a teaching and learning method in school science. International Journal of Science Education, 30(14), 1945–1969.

    Google Scholar 

  • Abrahams, I., & Reiss, M. J. (2012). Practical work: its effectiveness in primary and secondary schools in England. Journal of Research in Science Teaching, 49(8), 1035–1055.

    Google Scholar 

  • Abrahams, I., Reiss, M. J., & Sharpe, R. M. (2013). The assessment of practical work in school science. Studies in Science Education, 49(2), 209–251.

    Google Scholar 

  • Ateh, C. M. (2015). Science teachers' elicitation practices: insights for formative assessment. Educational Assessment, 20(2), 112–131.

    Google Scholar 

  • Atkin, J. M., Black, P., Coffey, J., & National Research Council. (2001). Classroom assessment and the national science education standards. Washington, DC: National Academies Press.

    Google Scholar 

  • Avargil, S., Herscovitz, O., & Dori, Y. J. J. (2012). Teaching thinking skills in context-based learning: teachers’ challenges and assessment knowledge. Journal of Science Education and Technology, 21, 207–225.

    Google Scholar 

  • Bartholomew, S. S., & Sandholtz, J. H. (2009). Competing views of teaching in a school-university partnership. Teaching and Teacher Education, 25(1), 155–165.

    Google Scholar 

  • Bell, B. (2007). Classroom assessment of science learning. In S. K. Abell & N. G. Lederman (Eds.), Handbook of research on science education (pp. 1105–1149). Mahwah: Lawrence Erlbaum.

    Google Scholar 

  • Bell, B., & Cowie, B. (2001). Formative assessment and science education. Dordrecht: Kluwer Academic.

    Google Scholar 

  • Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2016). Synthesizing results from empirical research on computer-based scaffolding in stem education: a meta-analysis. Review of Educational Research, 87(2), 309–344.

    Google Scholar 

  • Bennett, R. E. (2011). Formative assessment: a critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25.

    Google Scholar 

  • Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education, 5(1), 7–74.

    Google Scholar 

  • Black, P., & Wiliam, D. (2009). Developing a theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31.

    Google Scholar 

  • Boud, D., Dawson, P., Bearman, M., Bennett, S., Joughin, G., & Molloy, E. (2018). Reframing assessment research: through a practice perspective. Studies in Higher Education, 43(7), 1107–1118.

    Google Scholar 

  • Brantlinger, E., Jimenez, R., Klingner, J., Pugach, M., & Richardson, V. (2005). Qualitative studies in special education. Exceptional Children, 71, 195–207.

    Google Scholar 

  • Brown, E., Gibbs, G., & Glover, C. (2003). Evaluation tools for investigating the impact of assessment regimes on student learning. Bioscience Education, 2(1), 1–7.

    Google Scholar 

  • Clark, R. (1988). School–university relationships: an interpretive review. In K. Sirotnik & J. Goodlad (Eds.), School–university partnerships in action: concepts, cases, and concerns (pp. 32–65). New York: Teachers College Press.

    Google Scholar 

  • Coffey, J. E., Hammer, D., Levin, D. M., & Grant, T. (2011). The missing disciplinary substance of formative assessment. Journal of Research in Science Teaching, 48(10), 1109–1136.

    Google Scholar 

  • Cooper, M. M. (2015). Why ask why? Journal of Chemical Education, 92(8), 1273–1279.

    Google Scholar 

  • Creswell, J. W. (2012). Qualitative inquiry and research design: choosing among five approaches. Sage Publications.

  • Crooks, T. J. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58(4), 438–481.

    Google Scholar 

  • DeBarger, A. H., Penuel, W. R., & Harris, C. J. (2013). Designing NGSS assessments to evaluate the efficacy of curriculum interventions. Austin: Educational Testing Service.

    Google Scholar 

  • Dori, Y.J. & Avargil, S. (2015). Teachers’ understanding of assessment. In R. Gunstone (Ed.) Encyclopedia of science education. Springer Reference (www.springerreference.com) Springer-Verlag Berlin Heidelberg. https://doi.org/10.1007/SpringerReference3032482013-08-21.

  • Easterday, M. W., Lewis, D. R. & Gerber E. M. (2014). Design-based research process: problems, phases, and applications. ICLS 2014 Proceedings, 317-324.

  • Eaton, T. T. (2009). Engaging students and evaluating learning progress using collaborative exams in introductory courses. Journal of Geoscience Education, 57(2), 113–120.

    Google Scholar 

  • Edwards, F. (2013). Quality assessment by science teachers: five focus areas. Science Education International, 24(2), 212–226.

    Google Scholar 

  • Elton, L., & Johnston, B. (2002). Assessment in universities: a critical review of research. York: Learning and Teaching Support Network (LTSN) Generic Centre.

    Google Scholar 

  • Furtak, E. M. (2012). Linking a learning progression for natural selection to teachers' enactment of formative assessment. Journal of Research in Science Teaching, 49(9), 1181–1210.

    Google Scholar 

  • Furtak, E. M., Heredia, S., Morrison, D., & Renga, I. (2012). Teacher development in the collaborative design of common formative assessment. Paper presented at the American Educational Research Association. Vancouver, BC, Canada.

  • Gearhart, M., Nagashima, S., Pfotenhauer, J., Clark, S., Schwab, C., Vendlinski, T., Osmundson, E., Herman, J., & Bernbaum, D. J. (2006). Developing expertise with classroom assessment in K-12 science: learning to interpret student work. Interim findings from a 2-year study. Educational Assessment, 11(3&4), 237–263.

    Google Scholar 

  • Gibbs, G., & Simpson, C. (2005). Conditions under which assessment supports students’ learning. Learning and teaching in higher education, 1, 3–31.

    Google Scholar 

  • Gottheiner, D. G., & Siegel, M. A. (2012). Experienced middle school science teachers’ assessment literacy: Investigating knowledge of students’ conceptions in genetics and ways to shape instruction. Journal of Science Teacher Education, 23, 531–557.

    Google Scholar 

  • Harshman, J., & Yezierski, E. (2015). Guiding teaching with assessments: high school chemistry teachers’ use of data-driven inquiry. Chemistry Education Research and Practice, 16(1), 93–103.

    Google Scholar 

  • Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

    Google Scholar 

  • Haug, B. S., & Ødegaard, M. (2015). Formative assessment and teachers' sensitivity to student responses. International Journal of Science Education, 37(4), 629–654.

    Google Scholar 

  • Herman, J., Osmundson, E., Dai, Y., Ringstaff, C., & Timms, M. (2015). Investigating the dynamics of formative assessment: relationships between teacher knowledge, assessment practice and learning. Assessment in Education: Principles, Policy & Practice, 22(3), 344–367. https://doi.org/10.1080/0969594X.2015.1006521.

    Article  Google Scholar 

  • Horn, I. S., & Little, J. W. (2010). Attending to problems of practice: routines and resources for professional learning in teachers’ workplace interactions. American Educational Research Journal, 47(1), 181–217.

    Google Scholar 

  • Izci, K. (2013). Investigating high school chemistry teachers’ perceptions, knowledge and practices of classroom assessment. (Unpublished PhD Thesis), Columbia: University of Missouri-Columbia

  • Kang, H., & Anderson, C. W. (2015). Supporting preservice science teachers’ ability to attend and respond to student thinking by design. Science Education, 99(5), 863–895.

    Google Scholar 

  • Kang, H., Thompson, J., & Windschitl, M. (2014). Creating opportunities for students to show what they know: the role of scaffolding in assessment tasks. Science Education, 98(4), 674–704. https://doi.org/10.1002/sce.21123.

    Article  Google Scholar 

  • Kislov, R., Harvey, G., & Walshe, K. (2011). Collaborations for leadership in applied health research and care: lessons from the theory of communities of practice. Implementation Science, 6(64), 1–10.

    Google Scholar 

  • Koh, K., Burke, L. E. C., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: a focus on assessment task design. Language teaching research., 22(3), 264–288.

    Google Scholar 

  • LePage, P., Boudreau, S., Maier, S., Robinson, J., & Cox, H. (2001). Exploring the complexities of the relationship between K-12 and college faculty in a nontraditional professional development program. Teaching and Teacher Education, 17(2), 195–211.

    Google Scholar 

  • Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills: Sage.

    Google Scholar 

  • Liou, P. Y., & Bulut, O. (2017). The effects of item format and cognitive domain on students’ science performance in TIMSS 2011. Research in Science Education. https://doi.org/10.1007/s11165-017-9682-7.

  • Liu, O., Lee, H., Hofstetter, C., & Linn, M. C. (2008). Assessing knowledge integration in science: construct, measures, and evidence. Educational Assessment, 13(1), 23.

    Google Scholar 

  • Lyon, E. G. (2011). Beliefs, practices, and reflection: exploring a science teacher’s classroom assessment through the assessment triangle model. Journal of Science Teacher Education, 22(5), 417–435.

    Google Scholar 

  • Lyon, E. G. (2013). Learning to assess science in linguistically diverse classrooms: tracking growth in secondary science preservice teachers’ assessment expertise. Science Education, 97(3), 442–467. https://doi.org/10.1002/21059.

    Article  Google Scholar 

  • McKenney, S. (2018). How can the learning sciences (better) impact policy and practice? Journal of the Learning Sciences, 27(1), 1–7.

    Google Scholar 

  • Namdar, B., & Shen, J. (2015). Modeling-oriented assessment in K-12 science education: a synthesis of research from 1980 to 2013 and new directions. International Journal of Science Education, 37(7), 993–1023.

    Google Scholar 

  • National Research Council. (2001). Knowing what students know: The science and design of educational assessment. Committee on the Foundations of Assessment. In J. W. Pellegrino, N. Chudowsky, & R. Glaser (Eds.), Board on Testing and Assessment, Center for Education. Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academy Press.

    Google Scholar 

  • National Research Council. (2007). Taking science to school: learning and teaching science in grades K-8. Washington, D.C.: The National Academies Press.

    Google Scholar 

  • National Research Council. (2012). A framework for K-12 science education: practices, crosscutting concepts, and core ideas. Washington, D.C.: The National Academies Press.

    Google Scholar 

  • National Research Council. (2014). Developing assessments for the next generation science standards. Washington, D.C.: The National Academies Press.

    Google Scholar 

  • Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

    Google Scholar 

  • NSTA (2015). Educators evaluating the quality of instructional products (EQuIP) rubric for lessons and units: Science (Version 2.0). Retrieved from http://www.nextgenscience.org/sites/ngss/files/EQuIP%20Rubric%20for%20Science%20052714.pdf.

  • Opfer, J. E., Nehm, R. H., & Ha, M. (2012). Cognitive foundations for science assessment design: knowing what students know about evolution. Journal of Research in Science Teaching, 49(6), 744–777.

    Google Scholar 

  • Pellegrino, J. W. (2013). Proficiency in science: assessment challenges and opportunities. Science, 340, 320–340. https://doi.org/10.1126/science.1232065.

    Article  Google Scholar 

  • Penfield, R. D., & Lee, O. (2010). Test-based accountability: potential benefits and pitfalls of science assessment with student diversity. Journal of Research in Science Teaching, 47(1), 6–24.

    Google Scholar 

  • Penuel, W. R., & Yarnall, L. (2005). Designing handheld software to support classroom assessment: analysis of conditions for teacher adoption. The Journal of Technology, Learning and Assessment, 3(5), 50–70.

    Google Scholar 

  • Popham, J. W. (2007). Instructional insensitivity of tests: Accountability’s dire drawback. Phi Delta Kappan, 89(2), 146–155.

  • Puntambekar, S., & Kolodner, J. L. (2005). Toward implementing distributed scaffolding: helping students learn from design. Journal of Research in Science Teaching, 42, 185–217.

    Google Scholar 

  • Quellmalz, E. S., Timms, M. J., Silberglitt, M. D., & Buckley, B. C. (2012). Science assessments for all: integrating science simulations into balanced state science assessment systems. Journal of Research in Science Teaching, 49(3), 363–393.

    Google Scholar 

  • Ruiz-Primo, M. A., & Furtak, E. M. (2007). Exploring teachers' informal formative assessment practices and students' understanding in the context of scientific inquiry. Journal of Research in Science Teaching, 44(1), 57–84.

    Google Scholar 

  • Ruiz-Primo, M. A., Li, M., Wills, K., Giamellaro, M., Lan, M. C., Mason, H., & Sands, D. (2012). Developing and evaluating instructionally sensitive assessments in science. Journal of Research in Science Teaching, 49(6), 691–712.

    Google Scholar 

  • Sandlin, B., Harshman, J., & Yezierski, E. (2015). Formative assessment in high school chemistry teaching: investigating the alignment of teachers’ goals with their items. Journal of Chemical Education, 92(10), 1619–1625.

    Google Scholar 

  • Sato, M., Wei, R. C., & Darling-Hammond, L. (2008). Improving teachers’ assessment practices through professional development: the case of National Board Certification. American Educational Research Journal, 45(3), 669–700.

    Google Scholar 

  • Shaharabani, Y. F., & Tal, T. (2017). Teachers’ practice a decade after an extensive professional development program in science education. Research in Science Education, 47(5), 1031–1053.

    Google Scholar 

  • Shavelson, R. J., Young, D. B., Ayala, C. C., Brandon, P. R., Furtak, E. M., Ruiz-Primo, M. A., et al. (2008). On the impact of curriculum-embedded formative assessment on learning: a collaboration between curriculum and assessment developers. Applied Measurement in Education, 21(4), 295–314.

    Google Scholar 

  • Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29, 4–14.

    Google Scholar 

  • Siegel, M. A. (2007). Striving for equitable classroom assessments for linguistic minorities: Strategies for and effects of revising life science items. Journal of Research in Science Teaching, 44(6), 864–881.

    Google Scholar 

  • Siegel, M. A. (2012). Filling in the Distance Between Us: Group Metacognition During Problem Solving in a Secondary Education Course. Journal of Science Education and Technology, 21(3), 325–341.

    Google Scholar 

  • Siegel, M. A. (2014). Developing preservice teachers’ expertise in equitable assessment for English learners. Journal of Science Teacher Education, 25(3), 289–308. https://doi.org/10.1007/s10972013-9365-9.

    Article  Google Scholar 

  • Siegel, M. A., & Wissehr, C. (2011). Preparing for the plunge: Preservice teachers assessment literacy. (2011). Journal of Science Teacher Education, 22, 371–391. https://doi.org/10.1007/s10972-011-9231-6.

    Article  Google Scholar 

  • Siegel, M. A., Markey, D., & Swann, S. (2005). Life science assessments for English learners: A teacher’s resource. Berkeley: University of California.

    Google Scholar 

  • Siegel, M. A., Roberts, T. M., Freyermuth, S. K., Witzig, S. B., & Izci, K. (2015). Aligning assessment to instruction: Collaborative group testing in large enrollment science classes. Journal of College Science Teaching, 44(3), 74–82.

    Google Scholar 

  • Songer, N. B., & Gotwals, A. (2012). Guiding explanation construction by children at the entry points of learning progressions. Journal of Research in Science Teaching, 49(2), 141–165.

    Google Scholar 

  • Stiggins. (2001). Student-involved classroom assessment (3rd ed.). Upper Saddle River: Prentice-Hall.

    Google Scholar 

  • Stiggins, R., & Chappuis, J. (2005). Using student-involved classroom assessment to close achievement gaps. Theory Into Practice, 44(1), 11–18.

    Google Scholar 

  • Talanquer, V., Bolger, M., & Tomanek, D. (2015). Exploring prospective teachers' assessment practices: noticing and interpreting student understanding in the assessment of written work. Journal of Research in Science Teaching, 52(5), 585–609.

    Google Scholar 

  • Voogt, J., Laferrière, T., Breuleux, A., Itow, R. C., Hickey, D. T., & McKenney, S. (2015). Collaborative design as a form of professional development. Instructional Science, 43(2), 259–282.

    Google Scholar 

  • Wenger, E. (1998). Communities of practice: learning, meaning and identity. Cambridge: University of Cambridge.

    Google Scholar 

  • Wenger, E., McDermott, R. A., & Snyder, W. (2002). Cultivating communities of practice: a guide to managing knowledge. Brighton: Harvard Business Press.

    Google Scholar 

  • Wu, P. H., Wu, H. K., & Hsu, Y. S. (2014). Establishing the criterion-related, construct, and content validities of a simulation-based assessment of inquiry abilities. International Journal of Science Education, 36(10), 1630–1650.

    Google Scholar 

  • Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: a reconceptualization. Teaching and Teacher Education, 58, 149–162.

    Google Scholar 

  • Yin, R. K. (2009). Case study research: Design and methods (3rd ed.). Thousand Oaks: Sage Publications, Inc..

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Educational Sciences, Ereğli College of Education, Necmettin Erbakan University, Konya, Turkey

    Kemal Izci

  2. Department of Secondary Science and Mathematics Education, Mugla Sıtkı Koçman University, Mugla, Turkey

    Nilay Muslu

  3. Department of Learning, Teaching, & Curriculum: MU Science Education Center, University of Missouri, Columbia, MO, USA

    Shannon M. Burcks & Marcelle A. Siegel

  4. Department of Biochemistry, University of Missouri, Columbia, MO, USA

    Marcelle A. Siegel

Authors
  1. Kemal Izci
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nilay Muslu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shannon M. Burcks
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marcelle A. Siegel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kemal Izci.

Electronic supplementary material

ESM 1

(DOCX 1805 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Izci, K., Muslu, N., Burcks, S.M. et al. Exploring Effectiveness of Classroom Assessments for Students’ Learning in High School Chemistry. Res Sci Educ 50, 1885–1916 (2020). https://doi.org/10.1007/s11165-018-9757-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11165-018-9757-0

Keywords

Search

Navigation