Skip to main content
SpringerLink
Log in

International Large-Scale Computer-Based Studies on Information Technology Literacy in Education

  • Living reference work entry
  • First Online:
Second Handbook of Information Technology in Primary and Secondary Education

Part of the book series: Springer International Handbooks of Education ((SIHE))

  • 198 Accesses

Abstract

The first international large-scale study in Information Technology (IT) literacy was conducted in 1987, and a broad range of studies that assess IT literacy and related areas of digital learning have followed. This chapter discusses recent developments in international large-scale studies of IT literacy-related achievement with a focus on their shared necessary attributes and the associated challenges with operationalizing these attributes in the test instruments. Two key attributes addressed are: (i) that the test contents reflect real-world use of Information and Communications Technology (ICT) and (ii) that the tests make use of the dynamic functionality and multimodal opportunities afforded by the computer-based environment. Challenges associated with these attributes include ensuring that the individual tasks within each assessment are independent of each other, maintaining a standardized test-taker experience, providing test-takers with plausible feedback from the computer-based environment, and maintaining construct validity. Examples are discussed of how the common challenges in creating the test instruments are addressed in the design of the instruments with some further discussion of possible future directions in large-scale international studies related to IT literacy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • Ainley, J. (2018). Computer literacy in the curriculum: Are students computer literate? In J. Voogt, G. Knezek, R. Christensen, & K.-W. Lai (Eds.), Second handbook of information technology in primary and secondary education. Cham: Springer International Publishing.

    Google Scholar 

  • Anderson, R. (2008). Handbook of research on new literacies. In J. Coiro, M. Knobel, C. Lankshear, & D. J. Leu (Eds.). New York: Lawrence Erlbaum.

    Google Scholar 

  • Angeli, C., Voogt, J., Fluck, A., Webb, M. E., Cox, M. J., Malyn-Smith, J., & Zagami, J. (2016). A K-6 computational thinking curriculum framework: Implications for teacher knowledge. Educational Technology & Society, 19(3), 47–57.

    Google Scholar 

  • Berezner, A., & Adams, R. J. (2017). Why large-scale assessments use scaling and item response theory. In P. Lietz, J. C. Creswell, K. Rust, & R. J. Adams (Eds.), Implementation of large-scale education assessments. Chichester, Wiley.

    Chapter  Google Scholar 

  • Bocconi, S., Chioccariello, A., Dettori, G., Ferrari, A., Engelhardt, K., Kampylis, P., & Punie, Y. (2016). Developing computational thinking in compulsory education. Implications for policy and practice. EUR – Scientific and Technical Research Reports. https://doi.org/10.2791/792158.

  • Finch, W. H., & Jeffers, H. (2016). A Q3-based permutation test for assessing local independence. Applied Psychological Measurement, 40(2), 157–160.

    Article  Google Scholar 

  • Foshay, A. W. (1962). In A. W. Foshay, R. L. Thorndike, F. Hotyat, D. A. Pidgeon, & D. A. Walker (Eds.), Educational achievements of thirteen-year-olds in twelve countries. Results of an international research project, 1959–1961. Hamburg: UNESCO Institute for Education.

    Google Scholar 

  • Fraillon, J., Schulz, W., & Ainley, J. (2013). International computer and information literacy study: Assessment framework. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA).

    Google Scholar 

  • Fraillon, J., Ainley, J., Schulz, W., Friedman, T., & Gebhardt, E. (2014). Preparing for life in a digital age. The IEA international computer and literacy information study international report. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA).

    Google Scholar 

  • Fraillon, J., Schulz, W., Friedman, T., Ainley, J., & Gebhardt, E. (Eds.). (2015). International computer and literacy information study 2013 technical report. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA).

    Google Scholar 

  • Griffin, P., & Care, E. (Eds.). (2015). Assessment and teaching of 21st century skills: Methods and approach. Dordrecht: Springer.

    Google Scholar 

  • Griffin, P., McGaw, B., & Care, E. (2012). Assessment and teaching of 21st century skills. Dordrecht: Springer.

    Book  Google Scholar 

  • Haßler, B., Major, L., & Hennessy, S. (2016). Tablet use in schools: A critical review of the evidence for learning outcomes. Journal of Computer Assisted Learning, 32(2), 139–156.

    Article  Google Scholar 

  • Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015). A framework for teachable collaborative problem solving skills. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21stcentury skills: Methods and approach (pp. 37–56). Dordrecht: Springer.

    Google Scholar 

  • Kozma, R. B. (Ed.). (2003). Technology, innovation, and educational change: A global perspective. A report of the Second Information Technology in Education Study Module 2. Eugene: ISTE.

    Google Scholar 

  • LaRoche, S., & Foy, P. (2017). Sample implementation in PIRLS 2016. In M. O. Martin, I. V. S. Mullis, & M. Hooper (Eds.), Methods and procedures in PIRLS 2016 (pp. 5.1–5.126). Retrieved from Boston College, TIMSS & PIRLS International Study Center website: https://timssandpirls.bc.edu/publications/pirls/2016-methods/chapter-5.html.

  • Law, N., Pelgrum, W. J., & Plomp, T. (Eds.). (2008). Pedagogy and ICT use in schools around the world: Findings from the IEA SITES 2006 study. Hong Kong: CERC-Springer.

    Google Scholar 

  • Lennon, M., Kirsch, I., Von Davier, M., Wagner, M., & Yamamoto, K. (2003). Feasibility study for the PISA ICT literacy assessment. Report to network A. Princeton: Educational Testing Service. Retrieved from: https://files.eric.ed.gov/fulltext/ED504154.pdf.

    Google Scholar 

  • Mendelovits, J. (2017). Test developmnent. In P. Lietz, J. C. Creswell, K. Rust, & R. J. Adams (Eds.), Implementation of large-scale education assessments. Chichester, Wiley.

    Google Scholar 

  • Mendelovits, J., Ramalingam, D., & Lumley, T. (2012). Print and digital reading in PISA 2009: Comparison and contrast. http://research.acer.edu.au/pisa/6.

  • Mullis, I. V. S., & Martin, M. O. (Eds.). (2015). PIRLS 2016 assessment framework (2nd ed.). Chestnut Hill: Boston College.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2017). ePIRLS 2016 International Results in Online Informational Reading. Chestnut Hill MA: Boston College.

    Google Scholar 

  • OECD. (2010). PISA computer-based assessment of student skills in science. Paris: OECD Publishing.

    Book  Google Scholar 

  • OECD. (2011). PISA 2009 results: Digital technologies and performance (Volume VI). Paris: OECD Publishing.

    Google Scholar 

  • OECD. (2013). OECD skills outlook 2013: First results from the survey of adult skills. Paris: OECD Publishing. https://doi.org/10.1787/9789264204256-en.

    Book  Google Scholar 

  • OECD. (2014). Technical report of the survey of adult skills (PIAAC). Paris: OECD Publishing.

    Google Scholar 

  • Pelgrum, W. J., & Anderson, R. (1999). ICT and the emerging paradigm for life long learning. A worldwide educational assessment of infrastructure, goals and practices. Amsterdam: IEA.

    Google Scholar 

  • Pelgrum, W. J., & Plomp, T. (Eds.). (1993). The IEA study of computers in education. Implementation of an innovation in 21 education systems. Oxford: Pergamon Press.

    Google Scholar 

  • Pelgrum, W. J., & Plomp, T. (2008). Methods for large-scale international studies on ICT in Education. In J. Voogt & G. Knezek (Eds.), International handbook of information technology in primary and secondary education (pp. 1053–1066). New York: Springer.

    Chapter  Google Scholar 

  • Pelgrum, W. J., Janssen-Reinen, I. A. M., & Plomp, T. (Eds.). (1993). Schools, teachers, students and computers. A cross-national perspective: IEA-Comped Study Stage 2. Enschede: University of Twente.

    Google Scholar 

  • Robinsohn, S. B. (1962). In A. W. Foshay, R. L. Thorndike, F. Hotyat, D. A. Pidgeon, & D. A. Walker (Eds.), Educational achievements of thirteen-year-olds in twelve countries. Results of an international research project, 1959–1961. Hamburg: UNESCO Institute for Education.

    Google Scholar 

  • Turner, R. (2017). Processing responses to open-ended survey questions. In P. Lietz, J. C. Creswell, K. Rust, & R. J. Adams (Eds.), Implementation of large-scale education assessments. Chichester, Wiley.

    Chapter  Google Scholar 

  • United Nations. (2016). Global indicator framework for the Sustainable Development Goals and targets for the 2030 Agenda for Sustainable Development. Annex: A/RES/21/313. Accessed from: https://unstats.un.org/sdgs/indicators/Global%20Indicator%20Framework_A.RES.71.313%20Annex.pdf.

  • Walker, M. (2017). Computer based delivery of cognitive assessment and questionnaires. In P. Lietz, J. C. Creswell, K. Rust, & R. J. Adams (Eds.), Implementation of large-scale education assessments. Chichester, Wiley.

    Chapter  Google Scholar 

  • Wilson, M., & Scalise, K. (2015). Assessment of learning in digital networks. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: Methods and approach (pp. 57–81). Dordrecht: Springer.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Australian Council for Educational Research, Camberwell, VIC, Australia

    Julian Fraillon

Authors
  1. Julian Fraillon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Julian Fraillon .

Editor information

Editors and Affiliations

  1. University of Amsterdam , Amsterdam, The Netherlands

    Joke Voogt

  2. University of North Texas , Denton, Texas, USA

    Gerald Knezek

  3. University of North Texas , Denton, Texas, USA

    Rhonda Christensen

  4. University of Otago , Dunedin, New Zealand

    Kwok-Wing Lai

Section Editor information

  1. King's College London, London, UK

    Margaret Cox

  2. Department of Child Development and Education, University of Amsterdam/ Windesheim University of Applied Sciences, Amsterdam, The Netherlands

    Joke Voogt

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Fraillon, J. (2018). International Large-Scale Computer-Based Studies on Information Technology Literacy in Education. In: Voogt, J., Knezek, G., Christensen, R., Lai, KW. (eds) Second Handbook of Information Technology in Primary and Secondary Education . Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-319-53803-7_80-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-53803-7_80-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-53803-7

  • Online ISBN: 978-3-319-53803-7

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics

Search

Navigation