Skip to main content
SpringerLink
Log in

Assessing Classroom Emotional Climate in STEM classrooms: developing and validating a questionnaire

  • Original Paper
  • Published:
Learning Environments Research Aims and scope Submit manuscript

Abstract

In an attempt to engage more students in Science, Technology, Engineering and Mathematics (STEM) subjects, schools are encouraged by STEM educators and professionals to introduce students to STEM through projects which integrate skills from each of the STEM disciplines. Because little is known about the learning environment of STEM classrooms, we developed and validated a Classroom Emotional Climate (CEC) questionnaire. Initially, the questionnaire was pilot tested with six focus groups of students from three schools to obtain feedback to incorporate into a revision of the CEC. Next, the modified CEC questionnaire was administered to 698 students participating in STEM activities in 57 classes in 20 schools. Exploratory factor analysis (principal component analysis) led to reduction of the CEC to 41 items in seven dimensions: Consolidation, Collaboration, Control, Motivation, Care, Challenge and Clarity. The structure of the CEC was then further explored using confirmatory factor analysis. Internal consistency reliability, concurrent validity (ability to differentiate between classrooms), discriminant validity (scale intercorrelations) and predictive validity (associated with student attitudes) were satisfactory. Finally, Rasch analysis of data for each dimension revealed good model fit and unidimensionality of the items describing each latent variable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Aldridge, J. M., & Fraser, B. J. (2008). Outcomes-focused learning environments: Determinants and effects. Rotterdam: Sense Publishers.

    Book  Google Scholar 

  • Aldridge, J. M., Fraser, B. J., Bell, L., & Dorman, J. P. (2012). Using a new learning environment questionnaire for reflection in teacher action research. Journal of Science Teacher Education, 23, 259–290.

    Article  Google Scholar 

  • Alhija, F. A. N. (2010). Factor analysis: An overview and some contemporary advances. In P. L. Peterson, E. Baker, & B. McGaw (Eds.), International encyclopedia of education (3rd ed., pp. 162–170). London: Elsevier.

    Chapter  Google Scholar 

  • Allen, J., Gregory, A., Mikami, A., Lun, J., Hamre, B. K., & Pianta, R. C. (2013). Observations of effective teacher–student interactions in secondary school classrooms: Predicting student achievement with the classroom assessment scoring system–secondary. School Psychology Review, 42(1), 76–98.

    Article  Google Scholar 

  • Bartlett, M. S. (1950). Tests of significance in factor analysis. British Journal of Psychology, 3, 77–85.

    Google Scholar 

  • Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Boone, W. J., Staver, J. R., & Yale, M. S. (Eds.). (2014). Rasch analysis in the human sciences. Dordrecht: Springer.

    Google Scholar 

  • Brown, T. A. (2014). Confirmatory factor analysis for applied research (2nd ed.). New York: Guilford.

    Google Scholar 

  • Byrne, B. (1998). Structural equation modeling with LISREL, PRELIS and SIMPLIS: Basic concepts, application and programming. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Byrne, B. M. (2002). Structural equation modeling with EQS. London: Taylor & Francis.

    Google Scholar 

  • Cerny, C. A., & Kaiser, H. F. (1977). A study of a measure of sampling adequacy for factor-analytic correlation matrices. Mutlivariate Behavioral Research, 12(1), 43–47.

    Article  Google Scholar 

  • Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). London: Routledge.

    Google Scholar 

  • Daniels, D. H., & Shumow, L. (2003). Child development and classroom teaching: A review of the literature and implications for educating teachers. Jounal of Applied Developmental Psychology, 23, 495–526.

    Article  Google Scholar 

  • Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Buttner, G. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1–9. https://doi.org/10.1016/j.learninstruc.2013.07.001.

    Article  Google Scholar 

  • Ferguson, R. F. (2010). Student perceptions and the MET Project. Bill & Melinda Gates Foundation. Retrieved from https://k12education.gatesfoundation.org/resource/met-project-student-perceptions on 4 April 2020.

  • Ferguson, R. F. (2012). Can student surveys measure teaching quality? Phi Delta Kappan, 94(3), 24–28.

    Article  Google Scholar 

  • Ferguson, R. F., & Danielson, C. (2014). How framework for teaching and Tripod 7Cs evidence distinguish key components of effective teaching. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems (pp. 98–143). San Francisco: Jossey-Bass.

    Google Scholar 

  • Fraser, B. J. (1981). Test of Science Related Attitudes (TOSRA). Melbourne: Australian Council for Educational Research.

    Google Scholar 

  • Fraser, B. J. (1984). Differences between preferred and actual classroom environment as perceived by primary students and teachers. British Journal of Educational Psychology, 54(3), 336–339.

    Article  Google Scholar 

  • Fraser, B. J. (1988). Classroom environment instrument: Development, validity and applications. Learning Environments Research, 1(1), 7–33.

    Article  Google Scholar 

  • Fraser, B. J. (2012). Classroom learning environments: Retrospect, context and prospect. In B. J. Fraser, K. G. Tobin, & C. J. McRobbie (Eds.), Second international handbook of science education (Vol. 2, pp. 1191–1239). New York: Springer.

    Chapter  Google Scholar 

  • Fraser, B. J. (2014). Classroom learning environments: Historical and contemporary perspectives. In N. G. Lederman & S. K. Abell (Eds.), Handbook of research on science education (Vol. II, pp. 104–117). New York: Routledge.

    Google Scholar 

  • Fraser, B. J. (2019). Milestones in the evolution of the learning environments field over the past three decades. In D. B. Zandvliet & B. J. Fraser (Eds.), Thirty years of learning environments (pp. 1–19). Leiden: Brill | Sense.

    Google Scholar 

  • Fraser, B. J., & Aldridge, J. M. (2017). Improving classrooms through assessment of learning environments. In J. P. Bakken (Ed.), Classrooms: Assessment practices for teachers and student improvement strategies (Vol. 1, pp. 91–107). New York: Nova.

    Google Scholar 

  • Fraser, B. J., & Fisher, D. L. (1982). Predicting students’ outcomes from their perceptions of classroom psychosocial environment. American Educational Research Journal, 19, 498–518.

    Article  Google Scholar 

  • Fraser, B. J., & Fisher, D. L. (1983a). Development and validation of short forms of some instruments measuring student perceptions of actual and preferred classroom learning environment. Science Education, 67(1), 115–131.

    Article  Google Scholar 

  • Fraser, B. J., & Fisher, D. L. (1983b). Student achievement as a function of person–environment fit: A regression surface analysis. British Journal of Educational Psychology, 53, 89–99.

    Article  Google Scholar 

  • Fraser, B. J., Giddings, G. J., & McRobbie, C. J. (1995). Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environments. Journal of Research in Science Teaching, 32, 399–422.

    Article  Google Scholar 

  • Fraser, B. J., & Kahle, J. B. (2007). Classroom, home and peer environment influences on student outcomes in science and mathematics: An analysis of systemic reform data. International Journal of Science Education, 29, 189–1909.

    Article  Google Scholar 

  • Hair, J. F., Jr., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice-Hall.

    Google Scholar 

  • Hamre, B. K., & Pianta, R. C. (2007). Learning opportunities in preschool and early elementary classrooms. In R. C. Pianta, M. J. Cox, & K. L. Snow (Eds.), School readiness and the transition to kindergarten in the era of accountability (pp. 49–83). Baltimore, MD: Brookes.

    Google Scholar 

  • Honey, M., Pearson, G., & Schweingruber, H. (Eds.). (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. Washington, DC: The National Academies Press.

    Google Scholar 

  • Johnson, C. C., Mohr-Schroeder, M. J., Moore, T. J., & English, L. (Eds.). (2020). Handbook of research on STEM education. London: Routledge.

    Google Scholar 

  • Jöreskog, K. G., & Sörbom, D. (2018). LISREL10: User’s reference guide. Chicago: Scientific Software Inc.

    Google Scholar 

  • Khine, M. S. (Ed.). (2015). Attitude measurements in science education: Classic and contemporary approaches. Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Kind, P., Jones, K., & Barmby, P. (2007). Developing attitudes towards science measures. International Journal of Science Education, 29(7), 871–893. https://doi.org/10.1080/09500690600909091.

    Article  Google Scholar 

  • Koch, A., Polnick, B., & Irby, B. (Eds.). (2014). Girls and women in STEM: A never ending story. Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Kuhfeld, M. (2017). When students grade their teachers: A validity analysis of the Tripod student survey. Educational Assessment, 22(4), 1–22. https://doi.org/10.1080/10627197.2017.1381555.

    Article  Google Scholar 

  • Lee, S. S. U., Fraser, B. J., & Fisher, D. L. (2003). Teacher–student interactions in Korean high school science classrooms. International Journal of Science and Mathemataics Education, 1(1), 67–85.

    Article  Google Scholar 

  • Lightburn, M. E., & Fraser, B. J. (2007). Classroom environment and student outcomes among students using anthropometry activities in high school science. Research in Science and Technological Education, 25, 153–166.

    Article  Google Scholar 

  • Linacre, J. M. (1997). KR-20 or Rasch reliability: Which tells the “truth”? Rasch Measurement Transactions, 11(3), 580–581.

    Google Scholar 

  • Linacre, J. M. (2002). What do infit, outfit, mean-square, and standardized mean? Rasch Measurement Transactions, 16(2), 878.

    Google Scholar 

  • Linacre, J. M. (2007). A user’s guide to WINSTEPS: Rasch-model computer program. Chicago: MESA.

    Google Scholar 

  • Linacre, J. M. (2019). Winsteps (Version 4.4.7). Chicago: Winsteps.com.

    Google Scholar 

  • Loof, H., Struyf, A., Pauw, J., & Petegem, P. (2019). Teachers’ motivating style and students’ motivation and engagement in STEM: The relationship between three key educational concepts. Research in Science Education. https://doi.org/10.1007/s11165-019-9830-3.

    Article  Google Scholar 

  • Means, B., Wang, H., Young, V., Peters, V. L., & Lynch, S. J. (2016). STEM-focused high schools as a strategy for enhancing readiness for postsecondary STEM programs. Journal of Research in Science Teaching, 53(5), 709–736.

    Article  Google Scholar 

  • Moos, R. H., & Trickett, E. J. (1974). Classroom Environment Scale manual. Palo Alto, CA: Consulting Psychologists Press.

    Google Scholar 

  • Moote, J. K. (2019). Investigating the impact of classroom climate on UK school students taking part in a science inquiry-based learning programme–CREST. Research Papers in Education. https://doi.org/10.1080/02671522.2019.1568533.

    Article  Google Scholar 

  • Moote, J. K., Williams, J. M., & Sproule, J. (2013). When students take control: Investigating the impact of the CREST inquiry-based learning program on self-regulated processes and related motivations in young science students. Journal of Cognitive Education and Psychology, 12(2), 178–196.

    Article  Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2016). TIMSS 2015 international results in mathematics. Retrieved March 20, 2020, from Boston College, TIMSS & PIRLS International Study Center website: http://timssandpirls.bc.edu/timss2015/internationalresults/.

  • Nadelson, L. S., & Seifert, A. L. (2017). Integrated STEM defined: Contexts, challenges, and the future. The Journal of Educational Research, 110(3), 221–223. https://doi.org/10.1080/00220671.2017.1289775.

    Article  Google Scholar 

  • OECD (Organisation for Economic Co-operation and Development). (2016). PISA 2015 results (Volume I): Excellence and equity in education. Paris: OECD Publishing.

    Google Scholar 

  • Office of Chief Scientist. (2016). Australia’s STEM workforce. Canberra: Australian Government.

    Google Scholar 

  • Parker, L. H., Rennie, L. J., & Fraser, B. J. (Eds.). (1996). Gender, science and mathemataics: Shortening the shadow. London: Falmer Press.

    Google Scholar 

  • Pekrun, R., & Linnenbrink-Garcia, L. (Eds.). (2014). International handbook of emotions in education. New York: Routledge.

    Google Scholar 

  • Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119. https://doi.org/10.3102/0013189X09332374.

    Article  Google Scholar 

  • Pianta, R. C., La Paro, K. M., & Hamre, B. K. (2008). Classroom Assessment Scoring SystemTM: Manual K-3. Baltimore, MD: Brookes.

    Google Scholar 

  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago.

    Google Scholar 

  • Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104(3), 700–712. https://doi.org/10.1037/a0027268.

    Article  Google Scholar 

  • Rowley, J. F. S., Phillips, S. F., & Ferguson, R. F. (2019). The stability of student ratings of teacher instructional practice: Examining the one-year stability of the 7Cs composite. School Effectiveness and School Improvement, 30(4), 549–562. https://doi.org/10.1080/09243453.2019.1620293.

    Article  Google Scholar 

  • Sinatra, G. M., Mukhopadhyay, A., & Allbright, T. N. (2017). Speedometry: A vehicle for promoting interest and engagement through integrated STEM instruction. The Journal of Educational Research, 110(3), 308–316. https://doi.org/10.1080/00220671.2016.1273178.

    Article  Google Scholar 

  • Smith, E. V. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3, 205–231.

    Google Scholar 

  • Spearman, J., & Watt, H. G. M. (2013). Perception shapes experience: The influence of actual and perceived classroom environment dimensions on girls’ motivations for science. Learning Environments Research, 16(2), 217–238. https://doi.org/10.1007/s10984-013-9129-7.

    Article  Google Scholar 

  • Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). New York: Routledge.

    Google Scholar 

  • Taylor, P. C., Fraser, B. J., & Fisher, D. L. (1997). Monitoring constructivist classroom learning environments. International Journal of Educational Research, 27, 293–302.

    Article  Google Scholar 

  • Thibaut, L., Ceuppens, S., De Loof, H., De Meester, J., Goovaerts, L., Struyf, A., et al. (2018). Integrated STEM education: A systematic review of instructional practices in secondary education. European Journal of STEM Education. https://doi.org/10.20897/ejsteme/85525.

    Article  Google Scholar 

  • Urdan, T., & Schoenfelder, E. (2006). Classroom effects on student motivation: Goal structures, social relationships, and competence beliefs. Journal of School Psychology, 44, 331–349.

    Article  Google Scholar 

  • Wagner, D., Gollner, R., Helmke, A., Trautwein, U., & Ludtke, O. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1–11. https://doi.org/10.1016/j.learninstruc.2013.03.003.

    Article  Google Scholar 

  • Walberg, H. J., & Anderson, G. J. (1968). Classroom climate and individual learning. Journal of Educational Psychology, 59, 414–419.

    Article  Google Scholar 

  • Wallace, T. L. B., Kelcey, B., & Ruzek, E. (2016). What can student perception surveys tell us about teaching? Empirically testing the underlying structure of the tripod student perception survey. American Educational Research Journal, 53(6), 1834–1868. https://doi.org/10.3102/0002831216671864.

    Article  Google Scholar 

  • Wolfe, E. W., & Smith, E. V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part II—Validation activities. Journal of Applied Measurement, 8, 204–234.

    Google Scholar 

  • Wright, B. D. (1999). Fundamental measurement for psychology. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know (pp. 65–104). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Wright, B. D., & Masters, G. N. (2002). Number of person or item strata. Rasch Measurement Transactions, 16, 888.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Curtin University, Perth, WA, 6845, Australia

    Barry J. Fraser, Felicity I. McLure & Rekha B. Koul

Authors
  1. Barry J. Fraser
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Felicity I. McLure
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rekha B. Koul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Barry J. Fraser.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fraser, B.J., McLure, F.I. & Koul, R.B. Assessing Classroom Emotional Climate in STEM classrooms: developing and validating a questionnaire. Learning Environ Res 24, 1–21 (2021). https://doi.org/10.1007/s10984-020-09316-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10984-020-09316-z

Keywords

Search

Navigation