skip to main content
10.1145/3419249.3420182acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Learning Success in Immersive Virtual Reality Training Environments: Practical Evidence from Automotive Assembly

Published:26 October 2020Publication History

ABSTRACT

Learning success in assembly training using immersive virtual reality technologies depends on multiple factors ranging from quality levels of process and technical documentation, visual 3D rendering quality, maturity of didactic concepts to individual differences and attitudes of workers and trainers. In this paper, we present the results of a field study conducted in an automotive factory to evaluate an immersive virtual reality training environment (VTE). Set up under real training conditions, the VTE was operated by trainers to train novice assembly line workers on a specific task: the assembly of a vehicle center console. Using a between-subject design we compare training performance in terms of skill transfer and retention between workers being trained in the VTE to workers who had been trained conventionally on the physical car. Our results suggest positive transfer of the acquired procedures from the VTE to physical assembly and even performance improvements over time. We discuss learning success in the VTE in contrast to user experience feedback and the implemented sequence steps for mounting assembly parts, based on comprehensive behavioral data. Finally, reflections on trainer feedback lead the way to implications for the adaption of didactic strategies and operational procedures towards increasing overall effectiveness of VTE-supported assembly training.

References

  1. Mariano Alcañiz, Elena Parra, and Irene Alice Chicchi Giglioli. 2018. Virtual reality as an emerging methodology for leadership assessment and training. Frontiers in Psychology 9, SEP (2018), 1–7. https://doi.org/10.3389/fpsyg.2018.01658Google ScholarGoogle Scholar
  2. Christoph Anthes, Markus Wiedemann, and Dieter Kranzlmüller. 2016. State of the Art of Virtual Reality Technology. In 2016 IEEE Aerospace Conference. IEEE, Big Sky, Montana, United States, 1–19. https://doi.org/10.1109/AERO.2016.7500674Google ScholarGoogle Scholar
  3. Cyril Bossard, Gilles Kermarrec, Cédric Buche, and Jacques Tisseau. 2008. Transfer of learning in virtual environments: a new challenge?Virtual Reality 12, 3 (sep 2008), 151–161. https://doi.org/10.1007/s10055-008-0093-yGoogle ScholarGoogle Scholar
  4. Doug A. Bowman, Joseph L. Gabbard, and Deborah Hix. 2002. A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods. Presence: Teleoperators and Virtual Environments 11, 4(2002), 404–424. https://doi.org/10.1162/105474602760204309Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. D. A. Bowman and R. P. McMahan. 2007. Virtual Reality: How Much Immersion Is Enough?Computer 40, 7 (2007), 36–43.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sebastian Büttner, Henrik Mucha, Markus Funk, Thomas Kosch, Mario Aehnelt, Sebastian Robert, and Carsten Röcker. 2017. The design space of augmented and virtual reality applications for assistive environments in manufacturing: a visual approach. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. 433–440.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Patrick Carlson, Anicia Peters, Stephen Gilbert, Judy Vance, and Andy Luse. 2015. Virtual Training: Learning Transfer of Assembly Tasks. IEEE Transactions on Visualization and Computer Graphics 21, 6(2015), 770–782. https://doi.org/10.1109/TVCG.2015.2393871.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Barney Dalgarno and Mark J W Lee. 2010. What are the learning affordances of 3-D virtual environments?British Journal of Educational Technology 41, 1 (2010), 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.xGoogle ScholarGoogle Scholar
  9. Antonino Gomes De Sa and Gabriel Zachmann. 1999. Virtual reality as a tool for verification of assembly and maintenance processes. Computers & Graphics 23, 3 (1999), 389–403.Google ScholarGoogle ScholarCross RefCross Ref
  10. Carlo Galimberti and Gloria Belloni. 2003. Three-dimensional virtual environments for cybertherapy: a psychosocial approach to effective usability. Cyberpsychology & Behavior 6, 3 (2003), 229–236.Google ScholarGoogle ScholarCross RefCross Ref
  11. Franck Ganier, Charlotte Hoareau, and Jacques Tisseau. 2014. Evaluation of procedural learning transfer from a virtual environment to a real situation: A case study on tank maintenance training. Ergonomics 57, 6 (2014), 828–843. https://doi.org/10.1080/00140139.2014.899628Google ScholarGoogle ScholarCross RefCross Ref
  12. N. Gavish, T. Gutiérrez, S. Webel, J. Rodrıguez, M. Peveri, U. Bockholt, and F. Tecchia. 2015. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environments 23(6) (2015), 778–798.Google ScholarGoogle Scholar
  13. Andrzej Grabowski and Jarosław Jankowski. 2015. Virtual Reality-based pilot training for underground coal miners. Safety science 72(2015), 310–314.Google ScholarGoogle Scholar
  14. Mehdi Hafsia, Eric Monacelli, and Hugo Martin. 2018. Virtual Reality Simulator for Construction Workers. In Proceedings of the Virtual Reality International Conference - Laval Virtual (Laval, France) (VRIC ’18). Association for Computing Machinery, New York, NY, USA, Article 11, 7 pages. https://doi.org/10.1145/3234253.3234298Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, North-Holland, 139–183.Google ScholarGoogle Scholar
  16. S. Hermawati, G. Lawson, M. D’Cruz, F. Arlt, J. Apold, L. Andersson, M. G. Lövgren, and L. Malmsköld. 2015. Understanding the complex needs of automotive training at final assembly lines. Applied Ergonomics 46, 1997 (2015), 144–157.Google ScholarGoogle Scholar
  17. Charlotte Hoareau, Ronan Querrec, Cédric Buche, and Franck Ganier. 2017. Evaluation of internal and external validity of a virtual environment for learning a long procedure. International Journal of Human–Computer Interaction 33, 10(2017), 786–798.Google ScholarGoogle Scholar
  18. Ilanit Hochmitz and Nirit Yuviler-Gavish. 2011. Physical fidelity versus cognitive fidelity training in procedural skills acquisition. Human Factors 53, 5 (2011), 489–501. https://doi.org/10.1177/0018720811412777Google ScholarGoogle ScholarCross RefCross Ref
  19. Sankar Jayaram, Hugh I Connacher, and Kevin W Lyons. 1997. Virtual assembly using virtual reality techniques. Computer-aided design 29, 8 (1997), 575–584.Google ScholarGoogle Scholar
  20. Donald Kirkpatrick and James Kirkpatrick. 2006. Evaluating training programs: The four levels. Berrett-Koehler Publishers.Google ScholarGoogle Scholar
  21. Konstantinos Koumaditis and Francesco Chinello. 2019. Investigating the Role of Task Complexity in Virtual Immersive Training (VIT) Systems. In SIGGRAPH Asia 2019 Posters (Brisbane, QLD, Australia) (SA ’19). Association for Computing Machinery, New York, NY, USA, Article 37, 2 pages. https://doi.org/10.1145/3355056.3364587Google ScholarGoogle Scholar
  22. Glyn Lawson, Davide Salanitri, and Brian Waterfield. 2016. Future directions for the development of virtual reality within an automotive manufacturer. Applied Ergonomics 53(2016), 323–330. https://doi.org/10.1016/j.apergo.2015.06.024Google ScholarGoogle ScholarCross RefCross Ref
  23. Markus Löchtefeld, Antonio Krüger, and Hans Gellersen. 2016. DeceptiBike: Assessing the Perception of Speed Deception in a Virtual Reality Training Bike System. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 40, 10 pages. https://doi.org/10.1145/2971485.2971513Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. María Murcia-López and Anthony Steed. 2018. A comparison of virtual and physical training transfer of bimanual assembly tasks. IEEE Transactions on Visualization and Computer Graphics 24, 4(2018), 1574–1583. https://doi.org/10.1109/TVCG.2018.2793638Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Dimitris Nathanael, Stergios Mosialos, and George-C. Vosniakos. 2016. Development and evaluation of a virtual training environment for on-line robot programming. International Journal of Industrial Ergonomics 53 (2016), 274–283. https://doi.org/10.1016/j.ergon.2016.02.004Google ScholarGoogle ScholarCross RefCross Ref
  26. S. Y. Oh, K. Shriram, B. Laha, S. Baughman, E. Ogle, and J. Bailenson. 2016. Immersion at scale: Researcher’s guide to ecologically valid mobile experiments. In 2016 IEEE Virtual Reality (VR). 249–250.Google ScholarGoogle Scholar
  27. David Martinez Oliveira, Sandra Castro Cao, Xulio Fernandez Hermida, and Fernando Martin Rodriguez. 2007. Virtual Reality System for Industrial Training. 2007 IEEE International Symposium on Industrial ElectronicsJuly (2007), 1715–1720. https://doi.org/10.1109/ISIE.2007.4374863Google ScholarGoogle Scholar
  28. Raimund Schatz, Georg Regal, Stephanie Schwarz, Stefan Suettc, and Marina Kempf. 2018. Assessing the QoE Impact of 3D Rendering Style in the Context of VR-based Training. In 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, Cagliari, Italy, 1–6. https://doi.org/10.1109/QoMEX.2018.8463411Google ScholarGoogle ScholarCross RefCross Ref
  29. Mel Slater and Sylvia Wilbur. 1997. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments 6, 6(1997), 603–616.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Xing Su, Phillip S. Dunston, Robert W. Proctor, and Xiangyu Wang. 2013. Influence of training schedule on development of perceptual-motor control skills for construction equipment operators in a virtual training system. Automation in Construction 35 (2013), 439–447. https://doi.org/10.1016/j.autcon.2013.05.029Google ScholarGoogle ScholarCross RefCross Ref
  31. Yaiza Vélaz, Jorge Rodríguez Arce, Teresa Gutiérrez, Alberto Lozano-Rodero, and Angel Suescun. 2014. The influence of interaction technology on the learning of assembly tasks using virtual reality. Journal of Computing and Information Science in Engineering 14, 4(2014), 041007.Google ScholarGoogle ScholarCross RefCross Ref
  32. Bernhard Weber, Mikel Sagardia, Thomas Hulin, and Carsten Preusche. 2013. Visual, vibrotactile, and force feedback of collisions in virtual environments: effects on performance, mental workload and spatial orientation. In International Conference on Virtual, Augmented and Mixed Reality. Springer, 241–250.Google ScholarGoogle ScholarCross RefCross Ref
  33. Eugen Yin-Cheung Wong, Kaylee Hao Kong, and Ray Tak-Yin Hui. 2017. The influence of learners’ openness to IT experience on the attitude and perceived learning effectiveness with virtual reality technologies. In IEEE 6th International Conference on Teaching, Assessment, and Learning for Engineering (TALE. IEEE, IEEE, Hong Kong, 118–123.Google ScholarGoogle Scholar

Index Terms

  1. Learning Success in Immersive Virtual Reality Training Environments: Practical Evidence from Automotive Assembly
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            NordiCHI '20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society
            October 2020
            1177 pages
            ISBN:9781450375795
            DOI:10.1145/3419249

            Copyright © 2020 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 26 October 2020

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            NordiCHI '20 Paper Acceptance Rate89of399submissions,22%Overall Acceptance Rate379of1,572submissions,24%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format