Skip to main content
SpringerLink
Log in

Conceptual and Methodological Accomplishments of ILSAs, Remaining Criticism and Limitations

  • Living reference work entry
  • First Online:
International Handbook of Comparative Large-Scale Studies in Education

Part of the book series: Springer International Handbooks of Education ((SIHE))

  • 20 Accesses

Abstract

This chapter summarizes conceptual, methodological, and empirical accomplishments and limitations of international large-scale assessments (ILSAs) in education taking into account, among others, the lessons learned from the previous chapters of this handbook. Our intention is to provide a balanced view: On the one hand, we highlight how ILSAs over decades have provided unique contributions to educational research, while on the other hand, we identify limitations of ILSAs and why they may even be harmful to education in some cases.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • Addey, C., Sellar, S., Steiner-Khamsi, G., Lingard, B., & Verger, A. (2017). The rise of international large-scale assessments and rationales for participation. Compare: A Journal of Comparative and International Education, 47(3), 434–452.

    Article  Google Scholar 

  • Ainley, J., & Schulz, W. (2020). Reliability and validity of international large-scale assessment: Understanding IEA’s comparative studies of student achievement. In H. Wagemaker (Ed.), Framework development in international large-scale assessment studies (pp. 23–36). Springer International Publishing.

    Google Scholar 

  • Anders, J., Has, S., Jerrim, J., Shure, N., & Ziegler, L. (2021). Is Canada really an education superpower? The impact of non-participation on results from PISA 2015. Educational Assessment, Evaluation and Accountability, 33, 229–249.

    Article  Google Scholar 

  • Anderson, L. W., Ryan, D. W., & Shapiro, B. J. (1989). The IEA classroom environment study. Pergamon Press.

    Google Scholar 

  • Auld, E., & Morris, P. (2019). The OECD’s assessment of global competence: Measuring and making global elites. In L. C. Engel, C. Maxwell, & M. Yemini (Eds.), Beyond the established boundaries: The machinery of school internationalization in action (pp. 17–35). Routledge.

    Chapter  Google Scholar 

  • Avvisati, F., Le Donné, N., & Paccagnella, M. (2019). A meeting report: Cross-cultural comparability of questionnaire measures in large-scale international surveys. Measurement Instruments for the Social Sciences, 1(1), 8.

    Article  Google Scholar 

  • Bateson, M. C. (1994). Peripheral visions: Learning along the way. Harper Collins.

    Google Scholar 

  • Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., et al. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180.

    Article  Google Scholar 

  • Beck, U. (1992). Risk society: Towards a new modernity. SAGE.

    Google Scholar 

  • Beller, M. (2013). Technologies in large-scale assessments: New directions, challenges, and opportunities. In M. Von Davier, E. Gonzalez, & I. Kirsch (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research (pp. 25–45). Springer.

    Chapter  Google Scholar 

  • Berliner, D. C. (2020). The implications of understanding that PISA is simply another standardized achievement test. In G. Fan & T. S. Popkewitz (Eds.), Handbook of education policy studies (pp. 239–258). Springer.

    Chapter  Google Scholar 

  • Best, M., Knight, P., Lietz, P., Lockwood, C., Nugroho, D., & Tobin, M. (2013). The impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries: Final report. EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.

    Google Scholar 

  • Blikstad-Balas, M. (2014). Vague concepts in the educational sciences: Implications for researchers. Scandinavian Journal of Educational Research, 58(5), 528–539.

    Article  Google Scholar 

  • Bloem, S. (2015). PISA for low- and middle-income countries. Compare: A Journal of Comparative and International Education, 45(3), 481–486.

    Article  Google Scholar 

  • Blömeke, S., & Olsen, R. V. (2018). På vei mot et mer sammenhengende målingssystem. Acta Didactica, 12(4), 1.

    Article  Google Scholar 

  • Blömeke, S., & Paine, L. (2008). Getting the fish out of the water: Considering benefits and problems of doing research on teacher education at an international level. Teaching and Teacher Education, 24(4), 2027–2037.

    Article  Google Scholar 

  • Bloom, B. S. (1969). Cross-National Study of educational attainment (Vol. 2, Booklet 5): Stage I of the I.E.A. investigation in six subject areas. Office of Education.

    Google Scholar 

  • Bourdieu, P. (1986). The forms of capital. In J. Richardson (Ed.), Handbook of theory and research for the sociology of education (pp. 241–258). Greenwood.

    Google Scholar 

  • Brese, F., & Mirazchiyski, P. (2013). Measuring Students’ family background in large-scale international education studies (=Issues and methodologies in large-scale assessments: Special issue 2). IERI Monograph Series.

    Google Scholar 

  • Carmichael, S. B., Martino, G., Porter-Magee, K., & Wilson, W. S. (2010). The state of state standards – And the common Core – In 2010. Thomas B. Fordham Institute.

    Google Scholar 

  • Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64(8), 723–733.

    Article  Google Scholar 

  • Clausen, M. (2002). Instructional quality: A matter of perspective? Waxmann.

    Google Scholar 

  • Cobb, P., & Jackson, K. (2011). Assessing the quality of the common core state standards for mathematics. Educational Researcher, 40, 183–185.

    Article  Google Scholar 

  • Cresswell, J., Schwantner, U., & Waters, C. (2015). A review of international large-scale assessments in education: Assessing component skills and collecting contextual data. World Bank.

    Book  Google Scholar 

  • Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Plenum.

    Book  Google Scholar 

  • Domínguez, M., Vieira, M.-J., & Vidal, J. (2012). The impact of the programme for international student assessment on academic journals. Assessment in Education: Principles, Policy and Practice, 19(4), 393–409.

    Google Scholar 

  • Engel, L., Rutkowski, D., & Thompson, G. (2019). Toward an international measure of global competence? A critical look at the PISA 2018 framework. Globalisation, Societies and Education, 17(2), 117–131.

    Article  Google Scholar 

  • Fend, H. (1980). Theorie der Schule. Urban & Schwarzenberg.

    Google Scholar 

  • Figazzolo, L. (2009). Testing, ranking, reforming: Impact of PISA 2006 on the education policy debate. Educational International.

    Google Scholar 

  • Fischer, J., Praetorius, A. K., & Klieme, E. (2019). The impact of linguistic similarity on cross-cultural comparability of students’ perceptions of teaching quality. Educational Assessment, Evaluation and Accountability, 31, 201–220.

    Article  Google Scholar 

  • Fischman, G. E., Topper, A. M., Silova, I., Goebel, J., & Holloway, J. L. (2019). Examining the influence of international large-scale assessments on national education policies. Journal of Education Policy, 34(4), 470–499.

    Article  Google Scholar 

  • Foshay, A. W., Thorndike, R. L., Hotyat, F., Pidgeon, D. A., & Walker, D. A. (1962). Educational achievements of thirteen-year-olds in twelve countries: Results of an international research project, 1959–61. UNESCO Institute for Education.

    Google Scholar 

  • Fraillon, J., Ainley, J., Schulz, W., Duckworth, D., & Friedman, T. (2019). IEA International Computer and Information Literacy Study 2018 assessment framework. Springer.

    Book  Google Scholar 

  • Frey, A., & Hartig, J. (2020). Methodological challenges of international student assessment. In H. Harju-Luukkainen, N. McElvany, & J. Stang (Eds.), Monitoring of student achievement in the 21st century. Springer.

    Google Scholar 

  • Fusarelli, L. D., & Johnson, B. (2004). Educational governance and the new public management. Public Administration and Management, 9(2), 118–127.

    Google Scholar 

  • Gail, J. (1986). The use of calculators and computers in mathematics classes in twenty countries: A source document. Center for Education Statistics.

    Google Scholar 

  • Garden, R. A. (1987). The second IEA mathematics study. Comparative Education Review, 31(1), 47–68.

    Article  Google Scholar 

  • Giddens, A. (1973). The class structure of the advanced societies. Hutchinson.

    Google Scholar 

  • Goldstein, H. (1995). Interpreting international comparisons of student achievement. UNESCO.

    Google Scholar 

  • Goodlad, J. I., & Richter, M. N. (1966). The development of a conceptual system dealing with problems of curriculum and instruction. University of California.

    Google Scholar 

  • Greer, W. (2018). The 50 year history of the Common Core. The Journal of Educational Foundations, 31, 100–117.

    Google Scholar 

  • Grek, S. (2009). Governing by numbers: The PISA “effect” in Europe. Journal of Education Policy, 24(1), 23–37.

    Article  Google Scholar 

  • Gustafsson, J.-E. (2018). International large-scale assessments: Current status and ways forward. Scandinavian Journal of Educational Research, 62(3), 328–332.

    Article  Google Scholar 

  • Gustafsson, J.-E., & Rosén, M. (2014). Quality and credibility of international studies. In R. Strietholt, W. Bos, J.-E. Gustafsson, & M. Rosén (Eds.), Educational policy evaluation through international comparative assessments (pp. 19–32). Waxmann.

    Google Scholar 

  • Hamilton, M. (2017). How international large-scale skills assessments engage with national actors: Mobilising networks through policy, media and public knowledge. Critical Studies in Education, 58(3), 280–294.

    Article  Google Scholar 

  • Hanushek, E. A., & Wößmann, L. (2010). Education and economic growth. In P. Peterson, E. Baker, & B. McGaw (Eds.), International encyclopedia of education (Vol. 2, pp. 245–252). Elsevier.

    Chapter  Google Scholar 

  • Hargreaves, A., & Braun, H. (2013). Data-driven improvement and accountability. National Education Policy Center.

    Google Scholar 

  • Hastedt, D. (2020). History and current state of international student assessment. In H. Harju-Luukkainen, N. McElvany, & J. Stang (Eds.), Monitoring student achievement in the 21st century: European policy perspectives and assessment strategies (pp. 21–37). Springer.

    Chapter  Google Scholar 

  • Heckman, J. J., Stixrud, J., & Urzúa, S. (2006). The effects of cognitive and noncognitive abilities on labor market outcomes and social behavior. Journal of Labor Economics, 24(3), 411–482.

    Article  Google Scholar 

  • Hencke, J., Rutkowski, L., & Neuschmidt, O. (2009). Curriculum coverage and scale correlation on TIMSS 2003. IERI Monograph Series, 2, 85–112.

    Google Scholar 

  • Hopfenbeck, T. N., El Lenkeit, J., Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353.

    Article  Google Scholar 

  • Horkheimer, M., & Adorno, T. W. (1948). Dialectic of enlightenment: Philosophical fragments. Stanford University Press. (2002).

    Google Scholar 

  • Howie, S. (2012). High-stakes testing in South Africa: Friend or foe? Assessment in Education: Principles, Policy & Practice, 19(1), 81–98.

    Google Scholar 

  • Husén, T. (1967). International study of achievement in mathematics: A comparison of twelve countries (Vol. 1‚ 2). Almqvist and Wiksell.

    Google Scholar 

  • Husén, T., & Postlethwaite. (1985). The international encyclopedia of education: Research and studies. Pergamon Press.

    Google Scholar 

  • Ikeda, M., & Echazarra, A. (2020). International student assessment: Aims, approaches, and challenges. In H. Harju-Luukkainen, N. McElvany, & J. Stang (Eds.), Monitoring student achievement in the 21st century: European policy perspectives and assessment strategies (pp. 9–20). Springer.

    Chapter  Google Scholar 

  • International Labour Office, International Monetary Fund, Organisation for Economic Co-operation and Development, European Union, United Nations, & World Bank. (2020). Consumer price index manual: Concepts and methods. Washington, DC.

    Google Scholar 

  • Jiang, Y., Zhang, J., & Xin, T. (2019). Toward education quality improvement in China: A brief overview of the National Assessment of Education Quality. Journal of Educational and Behavioral Statistics, 44, 733–751.

    Article  Google Scholar 

  • Johansson, S. (2016). International large-scale assessments: What uses, what consequences? Educational Research, 58, 139–148.

    Article  Google Scholar 

  • Kamens, D. H., & Benavot, A. (2011). National, regional and international learning assessments: Trends among developing countries, 1960–2009. Globalisation, Societies and Education, 9(2), 285–300.

    Article  Google Scholar 

  • Kautz, T., Heckman, J. J., Diris, R., ter Weel, B., & Borghans, L. (2014). Fostering and measuring skills: Improving cognitive and non-cognitive skills to promote lifetime success (=IZA discussion papers, 8696). Institute for the Study of Labor.

    Google Scholar 

  • Keeves, J. P. (1992). Learning science in a changing world: Cross-national studies of science achievement 1970 to 1984. IEA.

    Google Scholar 

  • Keeves, J. P., & Lietz, P. (2011). The relationship of IEA to some developments in educational research methodology and measurement during the years from 1962 to 1992. In C. Papanastasiou, T. Plomp, & E. Papanastasiou (Eds.), IEA 1958–2008: 50 years of experiences and memories (pp. 217–251). IEA.

    Google Scholar 

  • Kirsch, I., Lennon, M., von Davier, M., Gonzalez, E., & Yamamoto, K. (2013). On the growing importance of international large-scale assessments. In M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research (pp. 1–11). Springer.

    Google Scholar 

  • Klieme, E. (2013). The role of large-scale assessments in research on educational effectiveness and school development. In M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research (pp. 115–147). Springer.

    Chapter  Google Scholar 

  • Klieme, E., Schuemer, G., & Knoll, S. (2001). Mathematics instruction at secondary level: Task culture and instructional design. In Bundesministerium für Bildung und Forschung (Ed.), TIMSS – Impulse fuer Schule und Unterricht: Forschungsbefunde, Reforminitiativen, Praxisberichte und video-Dokumente (pp. 43–57). BMBF.

    Google Scholar 

  • Klieme, E., Lipowsky, F., Rakoczy, K., & Ratzka, N. (2006). Quality dimensions and effectiveness of mathematics instruction: Theoretical background and selected findings of the Pythagoras project. In M. Prenzel & L. Allolio-Naecke (Eds.), Research on educational quality of schools: Final report of the DFG priority program (pp. 127–146). Waxmann.

    Google Scholar 

  • Koretz, D. (2019). Measuring Postsecondary Achievement: Lessons from Large-Scale Assessments in the K-12 Sector. Higher Education Policy, 32, 513–536. https://doi.org/10.1057/s41307-019-00142-4.

  • Kuger, S., Klieme, E., Jude, N., & Kaplan, D. (Eds.). (2016). Assessing contexts of learning: An international perspective. Springer International Publishing.

    Google Scholar 

  • Leung, F. K. S. (2011). The significance of IEA studies for education in East Asia. In C. Papanastasiou, T. Plomp, & E. Papanastasiou (Eds.), IEA 1958–2008: 50 years of experiences and memories (pp. 389–410). IEA.

    Google Scholar 

  • Levin, H. M. (2013). The utility and need for incorporating noncognitive skills into large-scale educational assessments. In M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research (pp. 67–86). Springer.

    Chapter  Google Scholar 

  • Lockheed, M. E. (2011). Reflections on IEA from the perspective of a World Bank official. In C. Papanastasiou, T. Plomp, & E. Papanastasiou (Eds.), IEA 1958–2008: 50 years of experiences and memories (pp. 711–720). IEA.

    Google Scholar 

  • Lockheed, M. (2015). Why do countries participate in international large-scale assessments? The case of PISA (=Policy research working paper; 7447). World Bank.

    Google Scholar 

  • Lockheed, M. E., Prokic-Breuer, T., & Shadrova, A. (2015). The experience of middle-income countries participating in PISA 2000–2015. OECD.

    Book  Google Scholar 

  • Loveless, T. (2014). PISA’s China problem continues: A response to Schleicher, Zhang, and Tucker. The Brown Center Chalkboard Series Archive.

    Google Scholar 

  • Martin, M. O. (1996). Third international mathematics and science study: An overview. In M. O. Martin & D. L. Kelly (Eds.), Third International Mathematics and Science Study (TIMSS) technical report, volume I: Design and development (pp. 1–20). Chestnut Hill, MA.

    Google Scholar 

  • McDonnell, L. M. (1995). Opportunity to learn as a research concept and a policy instrument. Educational Evaluation and Policy Analysis, 17(3), 305–322.

    Article  Google Scholar 

  • Moschner, B., Kiper, H., & Kattmann, U. (2003). PISA 2000 als Herausforderung: Perspektiven für Lehren und Lernen. Schneider Verlag.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Gonzalez, E. J., & Chrostowski, S. J. (2004). TIMSS 2003 international mathematics report: Findings from IEA's trends in international mathematics and science study at the fourth and eighth grades. Boston College.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Goh, S., & Cotter, K. (Eds.). (2016). TIMSS 2015 encyclopedia: Education policy and curriculum in mathematics and science. Boston College, TIMSS & PIRLS International Study Center.

    Google Scholar 

  • National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. United States Department of Education.

    Google Scholar 

  • National Governors Association, Council of Chief State School Officers, & Achieve. (2008). Benchmarking for success: Ensuring U.S. students receive a world-class education. National Governors Association.

    Google Scholar 

  • NCTM. (2000). Principles and standards for school mathematics. NCTM.

    Google Scholar 

  • OECD. (2007). PISA 2006: Science competencies for Tomorrow's world: Volume 1: Analysis. OECD Publishing.

    Book  Google Scholar 

  • OECD. (2008). External Evaluation of the Policy Impact of PISA: 26th Meeting of the PISA Governing Board (=EDU/PISA/GB(2008)35/REV1). OECD.

    Google Scholar 

  • OECD. (2014). PISA 2012 results: What students know and can do (volume I, revised edition, February 2014) – Student performance in mathematics, Reading and science. OECD Publishing.

    Google Scholar 

  • OECD. (2016). The PISA 2015 field trial mode-effect study. OECD Publishing.

    Google Scholar 

  • OECD. (2017). PISA 2015 results (volume V): Collaborative problem solving. OECD Publishing.

    Book  Google Scholar 

  • OECD. (2018a). Equity in education: Breaking down barriers to social mobility. OECD Publishing.

    Book  Google Scholar 

  • OECD. (2018b). PISA for development assessment and analytical framework: Reading, mathematics and science. OECD Publishing.

    Book  Google Scholar 

  • OECD (2018c). Preparing our youth for an inclusive and sustainable world: The OECD PISA global competence framework.

    Google Scholar 

  • OECD. (2019a). TALIS 2018 technical report. OECD Publishing.

    Google Scholar 

  • OECD. (2019b). OECD future of education and skills 2030: OECD learning compass 2030. OECD.

    Google Scholar 

  • Olmsted, P. P., & Weikart, D. P. (Eds.). (1994). Families speak: Early childhood care and education in 11 countries. The IEA preprimary project, phase 1. High/Scope Press.

    Google Scholar 

  • Olsen, R. V., & Bjørnsson, J. K. (2018). Fødselsmåned og skoleprestasjoner. In J. K. Björnsson & R. V. Olsen (Eds.), Tjue år med TIMSS og PISA i Norge: Trender og nye analyser (pp. 76–93). Universitetsforlaget.

    Chapter  Google Scholar 

  • Olsen, R. V., & Nilsen, T. (2017). Standard setting in PISA and TIMSS and how these procedures can be used nationally. In S. Blömeke & J.-E. Gustafsson (Eds.), Standard setting in education: The Nordic countries in an international perspective (pp. 69–84). Springer.

    Chapter  Google Scholar 

  • Page, S. (2005). What's new about the new public management? Administrative change in the human services. Public Administration Review, 65(6), 713–727.

    Article  Google Scholar 

  • Paine, L., Blömeke, S., & Aydarova, O. (2016). Teachers and teaching in the context of globalization. In D. Gitomer & C. Bell (Eds.), The handbook of research on teaching (5th ed., pp. 717–786). American Educational Research Association.

    Chapter  Google Scholar 

  • Pettersson, D. (2020). A comparativistic narrative of expertise: International large-scale assessments as the encyclopaedia of educational knowledge. In G. Fan & T. S. Popkewitz (Eds.), Handbook of education policy studies (pp. 311–329). Springer.

    Chapter  Google Scholar 

  • Pizmony-Levy, O. (2013). Testing for all: The emergence and development of international assessment of student achievement, 1958–2012 (Ph.D. Dissertation, Indiana University).

    Google Scholar 

  • Pizmony-Levy, O. (2015). Power, conflict, and change in world society: The case of International Association for the Evaluation of educational achievement. Normal University, China.

    Google Scholar 

  • Pizmony-Levy, O., & Bjorklund, P., Jr. (2018). International assessments of student achievement and public confidence in education: Evidence from a cross-national study. Oxford Review of Education, 44(2), 239–257.

    Article  Google Scholar 

  • Popkewitz, T. S. (2020). International assessments of student performance: The paradoxes of benchmarks and empirical evidence for national policy. In G. Fan & T. S. Popkewitz (Eds.), Handbook of education policy studies (pp. 295–310). Springer.

    Chapter  Google Scholar 

  • Porter, A. C. (2002). Measuring the content of instruction: Uses in research and practice. Educational Researcher, 31, 3–14.

    Article  Google Scholar 

  • Ramirez, F. O., Schofer, E., & Meyer, J. W. (2018). International tests, national assessments, and educational development (1970–2012). Comparative Education Review, 62, 344–364.

    Article  Google Scholar 

  • Ritzen, J. (2013). International large-scale assessments as change agents. In M. Von Davier, E. Gonzalez, & I. Kirsch (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research (pp. 13–24). Springer.

    Chapter  Google Scholar 

  • Robitaille, D. F., Schmidt, W. H., & Raizen, S. A. (1993). TIMSS monograph no.1: Curriculum frameworks for mathematics and science. Pacific Educational Press.

    Google Scholar 

  • Robitzsch, A., Lüdtke, O., Goldhammer, F., Kroehne, U., & Köller, O. (2020). Reanalysis of the German PISA data: A comparison of different approaches for trend estimation with a particular emphasis on mode effects. Frontiers in Psychology, 11, 884.

    Article  Google Scholar 

  • Rutkowski, D., & Rutkowski, L. (2013). Measuring socioeconomic background in PISA: One size might not fit all. Research in Comparative and International Education, 8(3), 259–278.

    Article  Google Scholar 

  • Schmidt, W. H., McKnight, C. C., Valverde, G. A., Houang, R. T., & Wiley, D. E. (1997a). Many visions, many aims (Volume I): A cross-national investigation of curricular intentions in school mathematics. Kluwer Academic Publishers.

    Book  Google Scholar 

  • Schmidt, W. H., Raizen, S. A., Britton, E. D., Bianchi, L. J., & Wolfe, R. G. (1997b). Many visions, many aims, (Volume II): A cross-national investigation of curricular intentions in school science. Kluwer.

    Book  Google Scholar 

  • Schmidt, W. H., Wang, H. A., & McKnight, C. C. (2005). Curriculum coherence: An examination of US mathematics and science content standards from an international perspective. Journal of Curriculum Studies, 37(5), 525–529.

    Article  Google Scholar 

  • Schmidt, W. H., Cogan, L. S., & Zoido, P. (2013). Schooling matters: Opportunity to learn in PISA 2012 (=OECD education working papers; 95). OECD Publishing.

    Google Scholar 

  • Schmidt, W. H., Houang, R. T., Cogan, L. S., & Solorio, M. L. (2018). Schooling across the globe: What we have learned from 60 years of mathematics and science international assessments. Cambridge University Press.

    Book  Google Scholar 

  • Schulz, W., Ainley, J., Fraillon, J., Kerr, B., & Losito, B. (2010). ICCS 2009 International Report: Civic knowledge, attitudes, and engagement among lower-secondary school students in 38 countries. IEA.

    Google Scholar 

  • Sibberns, H. (2020). Technology and assessment. In H. Wagemaker (Ed.), Reliability and validity of international large-scale assessment: Understanding IEA’s comparative studies of student achievement (pp. 169–186). Springer International Publishing.

    Chapter  Google Scholar 

  • Skedsmo, G., Rönnberg, L., & Ydesen, C. (2021). National testing and accountability in the Scandinavian welfare states: Education policy translations in Norway, Denmark, and Sweden. In A. Verger, S. Grek, & C. Maroy (Eds.), World yearbook of education: Accountability and datafication in the governance of education (pp. 113–129). Routledge.

    Google Scholar 

  • Takayama, K. (2018). How to mess with PISA: Learning from Japanese kokugo curriculum experts. Curriculum Inquiry, 48(2), 220–237.

    Article  Google Scholar 

  • Tatto, M. T., & Senk, S. (2011). The mathematics education of future primary and secondary teachers: Methods and findings from the Teacher Education and Development Study in Mathematics. Journal of Teacher Education, 62(2), 121–137.

    Article  Google Scholar 

  • Teig, N., Scherer, R., & Kjærnsli, M. (2020). Identifying patterns of students’ performance on simulated inquiry tasks using PISA 2015 log-file data. Journal of Research in Science Teaching, 57, 1400–1429.

    Article  Google Scholar 

  • Tobin, M., Lietz, P., Nugroho, D., Vivekanandan, R., & Nyamkhuu, T. (2015). Using large-scale assessments of students’ learning to inform education policy: Insights from the Asia-Pacific region. ACER.

    Google Scholar 

  • Torney-Purta, J., & Amadeo, J.-A. (2013). International large-scale assessments: Challenges in reporting and potentials for secondary analysis. Research in Comparative and International Education, 8(3), 248–258.

    Article  Google Scholar 

  • Torney-Purta, J., Lehmann, R., Oswald, H., & Schulz, W. (2001). Citizenship and education in twenty-eight countries: Civic knowledge and engagement at age 14. IEA.

    Google Scholar 

  • Travers, K. J., & Westbury, I. (1989). The IEA study of mathematics I: Analysis of mathematics curricula. Pergamon Press.

    Google Scholar 

  • UNESCO. (2020). Global education monitoring report 2020: Inclusion and education – All means all. UNESCO.

    Google Scholar 

  • UNESCO Institute for Statistics. (2019). Combining data on out-of-school children, completion and learning to offer a more comprehensive view on SDG 4 (=Information paper; 61). UNESCO.

    Google Scholar 

  • Unwin, A., & Yandell, J. (2016). PISA-envy, Pearson and Starbucks-style schools. New Internationalist, 491, 42–43.

    Google Scholar 

  • Van de Gaer, E., Grisay, A., Schulz, W., & Gebhardt, E. (2012). The reference group effect: An explanation of the paradoxical relationship between academic achievement and self-confidence across countries. Journal of Cross-Cultural Psychology, 43(8), 1205–1228.

    Article  Google Scholar 

  • van de Vijver, F., & He, J. (2016). Bias assessment and prevention in non-cognitive outcome measures in PISA questionnaires. In S. Kuger, E. Klieme, N. Jude, & D. Kaplan (Eds.), Assessing contexts of learning world-wide: An international perspective (pp. 229–253). Springer Science.

    Chapter  Google Scholar 

  • Von Davier, M., Gonzalez, E., & Schulz, W. (2020). Ensuring validity in international comparisons using state-of-the-art psychometric methodologies. In H. Wagemaker (Ed.), Reliability and validity of international large-scale assessments: Understanding IEA’s comparative studies of student achievement (pp. 187–219). Springer international publishing. (=IEA research for education; 10).

    Chapter  Google Scholar 

  • Wagemaker, H. (Ed.). (2020). Reliability and validity of international large-scale assessment: Understanding IEA’s comparative studies of student achievement. Springer International Publishing.

    Google Scholar 

  • Wagner, D. A. (2010). Quality of education, comparability, and assessment choice in developing countries. Compare, 40(6), 741–760.

    Article  Google Scholar 

  • Wagner, D. A., Babson, A., & Murray, K. M. (2011). How much is learning measurement worth? Current Issues in Comparative Education, 14, 3–23.

    Google Scholar 

  • Waldow, F. (2010). The dream of “Becoming clever the Scandinavian way”: Three propositions on Finland’s role as projection surface in the present debate on education. Zeitschrift für Pädagogik, 56(4), 497–511.

    Google Scholar 

  • Walker, D. A. (1976). The IEA six subject survey: An empirical study of education in twenty-one countries. Halsted.

    Google Scholar 

  • Yamamoto, K., Shin, H. J., & Khorramdel, L. (2018). Multistage adaptive testing design in international large-scale assessments. Educational Measurement: Issues and Practices, 37(4), 16–27.

    Article  Google Scholar 

  • Ydesen, C., & Andreasen, K. E. (2020). Historical roots of the global testing culture in education. Nordic Studies in Education, 40(2), 149–166.

    Article  Google Scholar 

  • Zieger, L., Sims, S., & Jerrim, J. (2019). Comparing teachers’ job satisfaction across countries: A multiple-pairwise measurement invariance approach. Educational Measurement: Issues and Practice, 38, 75–85.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Oslo, Oslo, Norway

    Sigrid Blömeke, Trude Nilsen & Rolf V. Olsen

  2. University of Gothenburg, Gothenburg, Sweden

    Jan-Eric Gustafsson

Authors
  1. Sigrid Blömeke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Trude Nilsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rolf V. Olsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jan-Eric Gustafsson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sigrid Blömeke .

Editor information

Editors and Affiliations

  1. University of Oslo, Blindern, Oslo, Norway

    Trude Nilsen

  2. IEA Hamburg, Hamburg, Hamburg, Germany

    Agnes Stancel-Piątak

  3. University of Gothenburg, Gothenburg, Sweden

    Jan-Eric Gustafsson

Section Editor information

  1. University of Oslo, Oslo, Norway

    Sigrid Blömeke

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Blömeke, S., Nilsen, T., Olsen, R.V., Gustafsson, JE. (2022). Conceptual and Methodological Accomplishments of ILSAs, Remaining Criticism and Limitations. In: Nilsen, T., Stancel-Piątak, A., Gustafsson, JE. (eds) International Handbook of Comparative Large-Scale Studies in Education. Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-38298-8_22-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-38298-8_22-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-38298-8

  • Online ISBN: 978-3-030-38298-8

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics

Search

Navigation