Skip to main content

Action-Based Learning Assessment in Virtual Training Environments

  • Chapter
  • First Online:
Authentic Virtual World Education

Abstract

Action-based learning plays an important role in today’s education, with assessment being an inevitable aspect that presently requires extensive financial and human expert resources. A major research area is dedicated to the development and implementation of systems to perform an automated or at least support formative assessment of human actions in action-based learning. That is, recognising and comparing the performed actions of the learner with the previously recorded actions undertaken by experts. Human actions are classified according to the developed taxonomy of human actions to facilitate a formative feedback for the learner. The action-based learning assessment method analyses the action sequences of the learners according to reference solutions (generated by experts) and automatically provides formative feedback to improve learner performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ahmed, A., Maqsood, M., Saif, H., & Salman, A. (2012). Affordable interactive virtual reality system for the Dynamic Hip Screw surgery training in vitro. In Proceedings of the IASTED International Conference on Computer Graphics and Imaging, CGIM 2012 (pp. 248–253). Crete, Greece: Acta Press.

    Google Scholar 

  • Al-Smadi, M., Gütl, C., & Kannan, R. (2010). Modular assessment system for modern learning settings: Mass. International Journal of Computer Applications, 1(9), 37–43.

    Article  Google Scholar 

  • Barab, S. A., Squire, K. D., & Dueber, W. (2000). A co-evolutionary model for supporting the emergence of authenticity. Educational Technology Research and Development, 48(2), 37–62.

    Article  Google Scholar 

  • Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. Berlin: Springer.

    Google Scholar 

  • Bastiaens, T., Wood, L. C., & Reiners, T. (2014). New landscapes and new eyes: the role of virtual world design for supply chain education. Ubiquitous Learning: An International Journal, 6(1), 37–49.

    Google Scholar 

  • Bresciani, M. J., Morsi, K., Tucker, M., Siprut, M., Stewart, K., & Duncan, A. (2010). Designing and implementing an assessment plan for a virtual engineering lab. Eludamos. Journal for Computer Game Culture, 4(2), 277–285.

    Google Scholar 

  • Chen, X., Lin, Y., Wang, C., Shen, G., & Wang, X. (2012). A virtual training system using a force feedback haptic device for oral implantology. In Z. Pan, A. Cheok, W. Müller, M. Chang, & M. Zhang (Eds.), Transactions on Edutainment VIII (Vols. 1–7220, pp. 232–240). Berlin, Heidelberg: Springer.

    Google Scholar 

  • Chodos, D., Stroulia, E., King, S., & Carbonaro, M. (2014). A framework for monitoring instructional environments in a virtual world. British Journal of Educational Technology, 45(1), 24–35.

    Article  Google Scholar 

  • Craighead, J. (2008). Distributed, game-based, intelligent tutoring systems: The next step in computer based training? In International Symposium on Collaborative Technologies and Systems (pp. 247–256). Irvine, CA: IEEE.

    Google Scholar 

  • Dede, C., & Lewis, M. (1995). Assessment of emerging educational technologies that might assist and enhance school-to-work transitions. Washington, DC, USA: Office of Technology Assessment, U.S. Congress.

    Google Scholar 

  • Dede, C., Salzman, M., Loftin, R. B., & Sprague, D. (1999). Multisensory immersion as a modelling environment for learning complex scientific concepts. In W. Feurzeig & N. Roberts (Eds.), Modelling and simulation in science and mathematics education (pp. 282–319). New York: Springer.

    Chapter  Google Scholar 

  • Doering, A. (2006). Adventure learning: Transformative hybrid online education. Distance Education, 27(2), 197–215.

    Article  Google Scholar 

  • Dunwell, I., de Freitas, S., Jarvis, S., & de Freitas, S. (2011). Four-dimensional consideration of feedback in serious games. In S. de Freitas & P. Maharg (Eds.), Digital games and learning (pp. 42–62). London, UK: Bloomsbury Publishing.

    Google Scholar 

  • Fardinpour, A., & Dreher, H. (2012). Towards developing Automated Assessment in Virtual Learning Environments. In P. Kommers, T. Issa & P. Isaías (Eds.), Proceedings of the IADIS International Conference Internet Technologies and Society 2012 (pp. 211–216). Perth, Australia: IADIS Press.

    Google Scholar 

  • Fardinpour, A., & Reiners, T. (2014). The taxonomy of goal-oriented actions in virtual training environments. Procedia Technology, 1, 38–46. doi:10.1016/j.protcy.2014.02.007.

    Article  Google Scholar 

  • Fardinpour, A., Reiners, T., & Dreher, H. (2013). Action-based learning assessment: Evaluating goal-oriented actions in virtual training environments. In H. Carter, M. Gosper and J. Hedberg (Eds.), Electric Dreams. Proceedings Ascilite 2013 Sydney. (pp. 267–277). Sydney, Australia: Macquarie University and ascilite. Retrieved from http://www.ascilite.org/conferences/sydney13/program/papers/Fardinpour.pdf.

  • Filigenzi, M. T., Orr, T. J., & Ruff, T. M. (2000). Virtual reality for mine safety training. Applied Occupational and Environmental Hygiene, 15(6), 465–469. doi:10.1080/104732200301232.

    Article  Google Scholar 

  • Fleishman, E. A. (1975). Toward a taxonomy of human performance. American Psychologist, 30(12), 1127–1149. doi:10.1037/0003-066X.30.12.1127.

    Article  Google Scholar 

  • Goldman, A. I. (1970). A theory of human action. Upper Saddle River, NJ: Prentice-Hall.

    Google Scholar 

  • Gregory, S., Dalgarno, B., Campbell, M., Reiners, T., Knox, V., & Masters, M. (2011). Changing directions through VirtualPREX: Engaging pre-service teachers in virtual professional experience. In G. Williams, N. Brown, B. Pittard, & B. Cleland (Eds.), Changing demands, changing directions. Proceedings Ascilite Hobart 2011 (pp. 491–501). Hobart, Australia: University of Tasmania and ascilite. Retrieved from http://www.ascilite.org/conferences/hobart11/downloads/VPREXAscilitePresentationpptx.pdf.

  • Gunn, C. (2006). Collaborative virtual sculpting with haptic feedback. Virtual Reality, 10(2), 73–83. doi:10.1007/s10055-006-0044-4.

    Article  Google Scholar 

  • Herrington, A., & Herrington, J. (2006). Authentic learning environments in higher education. Hershey, PA: IGI Global.

    Book  Google Scholar 

  • Herrington, J., Oliver, R., & Reeves, T. C. (2003). Patterns of engagement in authentic online learning environments. Australian Journal of Educational Technology, 19(1), 59–71.

    Google Scholar 

  • Herrington, J., Reeves, T. C., & Oliver, R. (2010). A guide to authentic e-learning. New York, NY: Routledge.

    Google Scholar 

  • Hewitt, A. M., Spencer, S. S., Mirliss, D., & Twal, R. (2010). Incident and disaster management training: Collaborative learning opportunities using virtual world scenarios. In E. Asimakopoulou & N. Bessis (Eds.), Advanced ICTs for disaster management and threat detection: Collaborative and distributed frameworks (pp. 179–200). Hershey, PA: Information Science Reference.

    Chapter  Google Scholar 

  • Hockenmeyer, C., Nussbaumer, A., Lövquist, E., Aboulafia, A., Breen, D., Shorten, G., & Albert, D. (2009). Applying a web and simulation-based system for adaptive competence assessment of spinal anaesthesia. In M. Spaniol, Q. Li, R. Klamma, & R. H. Lau (Eds.), Advances in Web Based Learning: ICWL 2009 (Vol. 5686, pp. 182–191). Berlin: Springer. doi:10.1007/978-3-642-03426-8_23

  • Janesick, V. J. (2006). Authentic assessment primer. New York, NY, USA: Peter Lang.

    Google Scholar 

  • Kizil, M. (2003). Virtual reality applications in the Australian minerals industry. In F. A. Camisani-Calzolari (Ed.), Application of computers and operations research in the minerals industries (pp. 569–574). Cape Town, South Africa: The South African Institute of Mining and Metallurgy.

    Google Scholar 

  • Lasky, B., & Tempone, I. (2004). Practising what we teach: Vocational teachers learn to research through applying action learning techniques. Journal of Further and Higher Education, 28(1), 79–94.

    Article  Google Scholar 

  • Masters, Y., Gregory, S., Reiners, T., Knox, V., & Dalgarno, B. (2013). VirtualPREX: Developing teaching skills in second life. In C. DeCoursey & S. Garrett (Eds.), Studies in virtual world learning and practice (pp. 69–94). Oxford, UK: Inter-Disciplinary Press.

    Google Scholar 

  • Meyer, C. A. (1992). What’s the difference between “Authentic” and “Performance” assessment? Educational Leadership, 49(8), 39–40.

    Google Scholar 

  • Naidu, S. (2007). Instructional designs for distance education. In M. G. Moore (Ed.), Handbook of distance education (pp. 247–258). Mahwah, NJ, USA: L. Erlbaum Associates.

    Google Scholar 

  • Naidu, S. (2010). Using scenario-based learning to promote situated learning and develop professional knowledge. In E. P. Errington (Ed.), Preparing graduates for the professions using scenario-based learning (pp. 39–49). Brisbane, Australia: Post Pressed.

    Google Scholar 

  • Naidu, S., & Bedgood, D., Jr. (2012). Action-based learning. In N. Seel (Ed.), Encyclopaedia of the sciences of learning (pp. 75–77). Boston, MA, USA: Springer, US.

    Google Scholar 

  • Reiners, T., & Wood, L. C. (2013). Immersive virtual environments to facilitate authentic education in Logistics and supply chain management. In Y. Kats (Ed.), Learning management systems and instructional design: Metrics, standards, and applications (pp. 323–343). Hershey, PA: IGI Global.

    Chapter  Google Scholar 

  • Reiners, T., Wood, L. C., & Dron, J. (2014). From chaos towards sense: A learner-centric narrative virtual learning space. In J. Bishop (Ed.), Gamification for human factors integration: Social, educational, and psychological issues (pp. 242–258). Hershey, PA: IGI Global.

    Chapter  Google Scholar 

  • Reiners, T., Wood, L.C., Gregory, S., Petter, N., Teräs, H., Gütl, C., Chang, V., Herrington, J. (2013). nDiVE: The story of how Logistics and Supply Chain Management should be taught. In M. Gosper, J. Hedberg, & H. Carter (Eds.), Electric Dreams. Proceedings ascilite 2013 Sydney (pp. 734–744).

    Google Scholar 

  • Rickel, J., Johnson, W. L., Way, A., & Rey, M. (1998). STEVE: A pedagogical agent for virtual reality. The second international conference on autonomous agents (pp. 332–333). New York, NY, USA: ACM.

    Chapter  Google Scholar 

  • Robertson, T. (1997). Cooperative work and lived cognition: a taxonomy of embodied actions. In Proceedings of European Conferences on Computer-Supported Cooperative Work (Vol. 97, pp. 205–220). Lancaster, UK: Springer Netherlands.

    Google Scholar 

  • Robertson, T. (2000). Building bridges: negotiating the gap between work practice and technology design. International Journal of Human-Computer Studies, 53(1), 121–146. doi:10.1006/ijhc.2000.0373.

    Article  Google Scholar 

  • Rogers, C. R. (1951). Client-centered therapy: its current practice, implications, and theory. Oxford, UK: Houghton Mifflin.

    Google Scholar 

  • Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18, 119–144.

    Article  Google Scholar 

  • Schank, R. (1997). Virtual learning: A revolutionary approach to building a highly skilled workforce. New York: McGraw-Hill.

    Google Scholar 

  • Scriven, M. (1967). The methodology of evaluation. In R. W. Tyler, R. M. Gagne, & M. Scriven (Eds.), Perspectives of curriculum evaluation (pp. 39–83). Chicago, IL: Rand-McNally.

    Google Scholar 

  • Shen, R., Tang, Y., & Zhang, T. (2001). The intelligent assessment system in web-based distance learning education. In 31st Annual Frontiers in Education Conference, (Vol. 1, p. TIF 7–11). Reno, NV, USA: IEEE.

    Google Scholar 

  • Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias & J. D. Fletcher (Eds.), Computer games and instruction (pp. 503–524). Charlotte, NC: Information Age Publishers.

    Google Scholar 

  • Shute, V. J., & Glaser, R. (1990). Large-scale evaluation of an intelligent tutoring system: Smithtown. Interactive Learning Environments, 1(1), 51–76.

    Article  Google Scholar 

  • Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). Mahwah, NJ: Routledge, Taylor and Francis.

    Google Scholar 

  • Smith, P. E. (1987). Simulating the classroom with media and computers past efforts. Future Possibilities. Simulation & Gaming, 18(3), 395–413.

    Google Scholar 

  • Thompson, C. W. F., & Hagstrom, F. (2011). Modeling healthcare: Logistics in a virtual world. IEEE Internet Computing, 12(4), 100–104.

    Google Scholar 

  • Twinning, P. (2009). Exploring the educational potential of virtual worlds: Some reflections from the SPP. British Journal of Educational Technology, 40(3), 496–514.

    Article  Google Scholar 

  • Verhulsdonck, G., & Morie, J. (2009). Virtual Chironomia: Developing Standards for Non-verbal Communication in Virtual Worlds. Journal of Virtual Worlds Research, 2(3). Retrieved from http://jvwr-ojs-utexas.tdl.org/jvwr/index.php/jvwr/article/view/657

  • Wiggins, G. (1990). The case for authentic assessment (pp. 1–6). Washington, DC, USA: ERIC Digest.

    Google Scholar 

  • Wilson, B. G. (Ed.). (1996). Constructivist learning environments: Case studies in instructional design. Englewood Cliffs, NJ, USA: Educational Technology Publications.

    Google Scholar 

  • Wood, L. C., & Reiners, T. (2013). Game-based elements to upgrade bots to non-player characters in support of educators. In A. Hebbel-Seeger, T. Reiners, & D. Schäfer (Eds.), Synthetic worlds: Emerging technologies in education and economics (pp. 257–277). Berlin, Germany: Springer.

    Google Scholar 

  • Wriedt, S., Reiners, T., & Ebeling, M. (2008). How to teach and demonstrate topics of supply chain management in virtual worlds. In J. Luca & E. R. Weippl (Eds.), Proceedings of ED-MEDIA 2008. World Conference on Educational Multimedia, Hypermedia & Telecommunications, Vienna, Austria (pp. 5501–5508). Chesapeake, VA: AACE.

    Google Scholar 

Download references

Acknowledgements

The Australian Government Office has provided support for the production of this publication for Learning and Teaching (Grant: Development of an authentic training environment to support skill acquisition in logistics and supply chain management, ID: ID12-2498). The views expressed in this publication do not necessarily reflect the views of the Australian Government Office for Learning and Teaching.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ali Fardinpour .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this chapter

Cite this chapter

Fardinpour, A., Reiners, T., Wood, L.C. (2018). Action-Based Learning Assessment in Virtual Training Environments. In: Gregory, S., Wood, D. (eds) Authentic Virtual World Education. Springer, Singapore. https://doi.org/10.1007/978-981-10-6382-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-6382-4_6

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-6381-7

  • Online ISBN: 978-981-10-6382-4

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics