Skip to main content
SpringerLink
Log in

Analysing Performance in Authentic Digital Scenarios

  • Chapter
  • First Online:
Authentic Learning Through Advances in Technologies

Part of the book series: Lecture Notes in Educational Technology ((LNET))

Abstract

When components of authentic learning are enabled by technology and the event-level interactions of learners are recorded as a historical stream of items, a voluminous and varied data record of the performance in the scenario rapidly accumulates into a transcript. This transcript, the context in which it was created, and based on it, the purposes, intentions, and practical utilities of making interpretations and inferences about what someone knows and can do is key to analysing performance in authentic digital scenarios. However, an effective assessment system not only provides a signifier of what people know via a classification and token such as a grade or badge, but also provides evidence of actions, artefacts, and processes, how knowledge was formed over time, and how well the person is able to apply the knowledge in specific situations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Baker, E. L. (2007). 2007 presidential address the end(s) of testing. Educational Researcher, 36(6), 309–317. doi:10.3102/0013189X07307970.

    Article  Google Scholar 

  • Baker, E. L., Chung, G. K. W. K., & Delacruz, G. C. (2008). Design and validation of technology-based performance assessments. In J. M. Spector, M. D. Merrill, J. J. G. van Merriënboer, & M. P. Driscoll (Eds.), Handbook of research on educational communications and technology (pp. 595–604). New York, NY: Taylor & Francis Group.

    Google Scholar 

  • Bandura, A. (1997). Self-efficacy. New York, NY: W. H. Freeman & Company.

    Google Scholar 

  • Behrens, J., Mislevy, R. J., Dicerbo, K., & Levy, R. (2012). Technology-based assessments for 21st century skills: Theoretical and practical implications from modern research. In M. Mayrath, J. Clarke-Midura, D. Robinson, & G. Schraw (Eds.), Technology-based assessments for 21st Century skills (pp. 13–54). Charlotte, NC: Information Age Publishers.

    Google Scholar 

  • Berland, M., Baker, R. S., & Bilkstein, P. (2014). Educational data mining and learning analytics: Applications to constructionist research. Technology, Knowledge and Learning, 19(1–2), 205–220. doi:10.1007/s10758-014-9223-7.

    Article  Google Scholar 

  • Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (2000). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.

    Google Scholar 

  • Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42.

    Article  Google Scholar 

  • Caliskan, H. (2012). Inquiry learning. In N. M. Seel (Ed.), The encyclopedia of the sciences of learning (pp. 1571–1573). New York, NY: Springer.

    Google Scholar 

  • Clarke-Midura, J., Code, J., Dede, C. J., Mayrath, M., & Zap, N. (2012). Thinking outside the bubble: Virtual performance assessments for measuring complex learning. In M. Mayrath, J. Clarke-Midura, D. Robinson, & G. Schraw (Eds.), Technology-based assessments for 21st century skills: Theoretical and practical implications from modern research (pp. 125–148). Charlotte, NC: Information Age Publishers.

    Google Scholar 

  • Clarke-Midura, J., Mayrath, M., & Dede, C. J. (2010). Measuring inquiry: New methods, promises & challenges. Paper presented at the 9th International Conference of the Learning Sciences, Chicago, IL.

    Google Scholar 

  • Csikszentmihalyi, M. (1996). Creativity: Flow and the psychology of discovery and invention. New York, NY: HarperCollins.

    Google Scholar 

  • Drachsler, H., Hummel, H., & Koper, R. (2008). Personal recommender systems for learners in lifelong learning: Requirements, techniques, and model. International Journal of Learning Technologies, 3(4), 404–423.

    Article  Google Scholar 

  • Dummer, P., & Ifenthaler, D. (2005). Planning and assessing navigation in model-centered learning environments. Why learners often do not follow the path laid out for them. In G. Chiazzese, M. Allegra, A. Chifari, & S. Ottaviano (Eds.), Methods and technologies for learning (pp. 327–334). Southampton, UK: WIT Press.

    Google Scholar 

  • Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61(3), 443–463. doi:10.1007/s11423-013-9297-2.

    Article  Google Scholar 

  • Eseryel, D., Law, V., Ifenthaler, D., Ge, X., & Miller, R. B. (2014). An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning. Journal of Educational Technology & Society, 17(1), 42–53.

    Google Scholar 

  • Funke, J. (2012). Complex problem solving. In N. M. Seel (Ed.), The encyclopedia of the sciences of learning (Vol. 3, pp. 682–685). New York, NY: Springer.

    Google Scholar 

  • Galbraith, D. (1999). Writing as a knowledge-constituting process. In M. Torrance & D. Galbraith (Eds.), Knowing what to write. Conceptual processes in text production (pp. 139–160). Amsterdam: University Press.

    Google Scholar 

  • Gibson, D. C. (2010). Bridging informal and formal learning: Experiences with participatory media. In Y. K. Baek (Ed.), Gaming for classroom-based learning: Digital role playing as a motivator of study (pp. 84–99). Hershey, PA: IGI Global.

    Chapter  Google Scholar 

  • Gibson, D. C., & Clarke-Midura, J. (2015). Some psychometric and design implications of game-based learning analytics. In P. Isaias, J. M. Spector, D. Ifenthaler, & D. G. Sampson (Eds.), E-Learning systems, environments and approaches: Theory and implementation (pp. 247–261). New York, NY: Springer.

    Google Scholar 

  • Gibson, D. C., & Jakl, P. (2015). Theoretical considerations for game-based e-learning analytics. In T. Reiners & L. C. Wood (Eds.), Gamification in education and business (pp. 403–416). New York, NY: Springer.

    Google Scholar 

  • Grotzer, T. A., Powell, M. M., Derbiszewska, K. M., Courter, C. J., Kamarainen, A. M., Metcalf, S. J., et al. (2015). Turning transfer inside out: The affordances of virtual worlds and mobile devices in real world contexts for teaching about causality across time and distance in ecosystems. Technology, Knowledge and Learning, 20(1), 43–69. doi:10.1007/s10758-014-9241-5.

    Article  Google Scholar 

  • Hanewald, R., & Ifenthaler, D. (2014). Digital knowledge mapping in educational contexts. In D. Ifenthaler & R. Hanewald (Eds.), Digital knowledge maps in education. Technology enhanced support for teachers and learners (pp. 1–15). New York, NY: Springer.

    Google Scholar 

  • Hickey, D. T., & Zuiker, S. J. (2012). Multilevel assessment for discourse, understanding, and achievement. Journal of the Learning Sciences, 21(4), 522–582. doi:10.1080/10508406.2011.652320.

    Article  Google Scholar 

  • Ifenthaler, D. (2008). Practical solutions for the diagnosis of progressing mental models. In D. Ifenthaler, P. Pirnay-Dummer, & J. M. Spector (Eds.), Understanding models for learning and instruction. essays in honor of Norbert M. Seel (pp. 43-61). New York: Springer.

    Google Scholar 

  • Ifenthaler, D. (2010a). Relational, structural, and semantic analysis of graphical representations and concept maps. Educational Technology Research and Development, 58(1), 81–97. doi:10.1007/s11423-008-9087-4.

    Article  Google Scholar 

  • Ifenthaler, D. (2010b). Scope of graphical indices in educational diagnostics. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 213–234). New York, NY: Springer.

    Chapter  Google Scholar 

  • Ifenthaler, D. (2011). Intelligent model-based feedback. Helping students to monitor their individual learning progress. In S. Graf, F. Lin, Kinshuk, & R. McGreal (Eds.), Intelligent and adaptive systems: Technology enhanced support for learners and teachers (pp. 88–100). Hershey, PA: IGI Global.

    Google Scholar 

  • Ifenthaler, D. (2014). Toward automated computer-based visualization and assessment of team-based performance. Journal of Educational Psychology, 106(3), 651–665. doi:10.1037/a0035505.

    Article  Google Scholar 

  • Ifenthaler, D., Adcock, A. B., Erlandson, B. E., Gosper, M., Greiff, S., & Pirnay-Dummer, P. (2014). Challenges for education in a connected world: Digital learning, data rich environments, and computer-based assessment - Introduction to the inaugural special issue of technology, knowledge and learning. Technology, Knowledge and Learning, 19(1–2), 121–126. doi:10.1007/s10758-014-9228-2.

    Article  Google Scholar 

  • Ifenthaler, D., Eseryel, D., & Ge, X. (2012). Assessment for game-based learning. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning. Foundations, innovations, and perspectives (pp. 3–10). New York, NY: Springer.

    Google Scholar 

  • Ifenthaler, D., & Pirnay-Dummer, P. (2014). Model-based tools for knowledge assessment. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 289–301). New York, NY: Springer.

    Chapter  Google Scholar 

  • Ifenthaler, D., & Seel, N. M. (2013). Model-based reasoning. Computers & Education, 64, 131–142. doi:10.1016/j.compedu.2012.11.014.

    Article  Google Scholar 

  • Ifenthaler, D., & Widanapathirana, C. (2014). Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning, 19(1–2), 221–240. doi:10.1007/s10758-014-9226-4.

    Article  Google Scholar 

  • Indurkhya, N., & Damerau, F. J. (Eds.). (2010). Handbook of natural language processing (2nd ed.). Boca Raton, FL: CRC Press.

    Google Scholar 

  • Johnson-Laird, P. N. (1989). Mental models. In M. I. Posner (Ed.), Foundations of cognitive science (pp. 469–499). Cambridge, MA: MIT Press.

    Google Scholar 

  • Lave, J. (1991). Situating learning in communities of practice. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 63–82). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • Mayrath, M., Clarke-Midura, J., & Robinson, D. (2012). Introduction to technology-based assessments for 21st centry skills. In M. Mayrath, J. Clarke-Midura, D. Robinson, & G. Schraw (Eds.), Technology-based assessments for 21st century skills (pp. 1–12). Charlotte, NC: Information Age Publishers.

    Google Scholar 

  • Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003a). On the structure of educational assessments. The Journal of The Bertrand Russell Archives, 1(1), 3–62.

    Google Scholar 

  • Mislevy, R. J., Steinberg, L. S., Almond, R. G., & Lukas, J. F. (2006). Concepts, terminology, and basic models of evidence-centered design. In D. M. Williamson, I. I. Bejar, & R. J. Mislevy (Eds.), Automated scoring of complex tasks in computer-based testing (pp. 15–48). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Mislevy, R. J., Wilson, M. R., Ercikan, K., & Chudowsky, N. (2003). Psychometric principles in student assessment. In T. Kellaghan & D. L. Stufflebeam (Eds.), international handbook of educational evaluation (Vol. 9, pp. 489–531). Dordrecht: Kluwer Academic Publishers.

    Google Scholar 

  • Nasraoui, O. (2006). A multi-layered and multi-faceted framework for mining evolving web clickstreams. Adaptive and Personalized Semantic Web, 14, 11–35. doi:10.1007/3-540-33279-0_2.

    Article  Google Scholar 

  • Pereira, F. C. N., & Pollack, M. E. (1991). Incremental interpretation. Artificial Intelligence, 50(1), 37–82. doi:10.1016/0004-3702(91)90090-7.

    Article  Google Scholar 

  • Romero, C., & Ventura, S. (2015). Technology, knowledge and learning. In J. A. Larusson, B. White (Eds.), Learning analytics: From research to practice. doi:10.1007/s10758-015-9244-x.

  • Rosen, Y. (2014). Comparability of conflict opportunities in human-to-human and human-to-agent online collaborative problem solving. Technology, Knowledge and Learning, 19(1–2), 147–164. doi:10.1007/s10758-014-9229-1.

    Article  Google Scholar 

  • Rosen, Y. (2015). Computer-based assessment of collaborative problem solving: Exploring the feasibility of human-to-agent approach. International Journal of Artificial Intelligence in Education, 25(3), 380–406. doi:10.1007/s40593-015-0042-3.

    Article  Google Scholar 

  • Rule, A. C. (2006). Editorial: The components of authentic learning. Journal of Authentic Learning, 3(1), 1–10.

    Google Scholar 

  • Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.

    Article  Google Scholar 

  • Shaffer, D. W. (2006). Epistemic frames for epistemic games. Computers & Education, 46, 223–234. doi:10.1016/j.compedu.2005.11.003.

    Article  Google Scholar 

  • Shaffer, D. W., Hatfield, D., Svarovsky, G. N., Nash, P., Nulty, A., Bagley, E., et al. (2009). Epistemic network analysis: A prototype for 21st-century assessment of learning. International Journal of Learning and Media, 1(2), 33–53.

    Article  Google Scholar 

  • Webb, M., & Gibson, D. C. (2015). Technology enhanced assessment in complex collaborative settings. Education and Information Technologies. doi:10.1007/s10639-015-9413-5.

    Google Scholar 

  • Webb, M., Gibson, D. C., & Forkosh-Baruch, A. (2013). Challenges for information technology supporting educational assessment. Journal of Computer Assisted learning, 29(5), 451–462. doi:10.1111/jcal.12033.

    Article  Google Scholar 

  • Wygotski, L. S. (1969). Denken und Sprechen Mit einer Einleitung von Thomas Luckmann. Übersetzt von Gerhard Sewekow. Stuttgart: Fischer Verlag.

    Google Scholar 

  • Young, M. J. (1993). Instructional design for situated learning. Educational Technology Research and Development, 41(1), 43–58.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Curtin University, Perth, WA, Australia

    David C. Gibson & Dirk Ifenthaler

Authors
  1. David C. Gibson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dirk Ifenthaler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David C. Gibson .

Editor information

Editors and Affiliations

  1. Smart Learning Institute, Beijing Normal University , Beijing, China

    Ting-Wen Chang

  2. Smart Learning Institute, Beijing Normal University, Beijing, China

    Ronghuai Huang

  3. Athabasca University , Edmonton, Alberta, Canada

    Kinshuk

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this chapter

Cite this chapter

Gibson, D.C., Ifenthaler, D. (2018). Analysing Performance in Authentic Digital Scenarios. In: Chang, TW., Huang, R., Kinshuk (eds) Authentic Learning Through Advances in Technologies. Lecture Notes in Educational Technology. Springer, Singapore. https://doi.org/10.1007/978-981-10-5930-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5930-8_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5929-2

  • Online ISBN: 978-981-10-5930-8

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation