Abstract
Mixed reality has been gaining traction lately and has been used in areas such as education, engineering, and architecture, among others. Education is an important part of our lives, and we must prepare the best education possible for the next generation. To support that, the teaching and learning process must be adjusted to match the current cohort of learners for whom the traditional teaching and learning process is no longer effective. Using mixed reality systems for teaching and learning will provide more experience during learning and increase the learning outcomes for students. The objective of this systematic literature review is to give a holistic view of mixed reality systems in education, starting from how they are used and implemented, to how their efficacy is measured. This SLR paper uses the Kitchenham methodology and has seven research questions related to mixed reality systems in education, with 99 articles in total having been collected from January 2021 to February 2022 and reviewed according to the inclusion and exclusion criteria; as a result, 40 articles were selected.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ade-Ojo, G. O., Markowski, M., Essex, R., Stiell, M., & Jameson, J. (2022). A systematic scoping review and textual narrative synthesis of physical and mixed-reality simulation in pre-service teacher training. Journal of Computer Assisted Learning, 38(3), 861–874. https://doi.org/10.1111/jcal.12653
Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1–11. https://doi.org/10.1016/j.edurev.2016.11.002
Anderson, T., & Shattuck, J. (2012). Design-based research: A decade of progress in education research? Educational Researcher, 41(1), 16–25. https://doi.org/10.3102/0013189X11428813
Antoniou, P. E., Dafli, E., Arfaras, G., & Bamidis, P. D. (2017). Versatile Mixed Reality Educational Spaces; A Medical Education Implementation Case. Proceedings - 2016 15th International Conference on Ubiquitous Computing and Communications and 2016 8th International Symposium on Cyberspace and Security, IUCC-CSS 2016, 132–137. https://doi.org/10.1109/IUCC-CSS.2016.026
Astriani, M. S., Pradono, S., & Saragih, H. (2010). IT blueprint for education institution. Proceedings - 2010 2nd International Conference on Advances in Computing, Control and Telecommunication Technologies, ACT 2010, 180–184. https://doi.org/10.1109/ACT.2010.41
Birt, J., & Cowling, M. (2017). Toward future “mixed reality” learning spaces for steam education. International Journal of Innovation in Science and Mathematics Education, 25(4), 1–16.
Birt, J., Moore, E., & Cowling, M. (2017). Improving paramedic distance education through mobile mixed reality simulation. Australasian Journal of Educational Technology, 33(6), 69–83.
Birt, J., Stromberga, Z., Cowling, M., & Moro, C. (2018). Mobile mixed reality for experiential learning and simulation in medical and health sciences education. Information (switzerland), 9(2), 1–14. https://doi.org/10.3390/info9020031
Campbell, A. G., Santiago, K., Hoo, D., & Mangina, E. (2017). Future mixed reality educational spaces. FTC 2016 - Proceedings of Future Technologies Conference, December, 1088–1093. https://doi.org/10.1109/FTC.2016.7821738
Chang, C. W., Lee, J. H., Wang, C. Y., & Chen, G. D. (2010). Improving the authentic learning experience by integrating robots into the mixed-reality environment. Computers and Education, 55(4), 1572–1578. https://doi.org/10.1016/j.compedu.2010.06.023
Chen, S. C., & Duh, H. (2018). Mixed reality in education: Recent developments and future trends. Proceedings - IEEE 18th International Conference on Advanced Learning Technologies, ICALT 2018, 367–371. https://doi.org/10.1109/ICALT.2018.00092
Chief, E. I., Editors, I., Donovan, E., & Feng, M. (2018). Mixed-Reality Teaching Experiences Improve Preservice Special Education Students’ Perceptions of their Ability to Manage a Classroom. 11. http://jvwresearch.org
Cole, P., & Association, X. (2019). Augmented and Virtual Reality Survey 2019 Report. 3.
Dalinger, T., Thomas, K. B., Stansberry, S., & Xiu, Y. (2020). A mixed reality simulation offers strategic practice for pre-service teachers. Computers and Education. https://doi.org/10.1016/j.compedu.2019.103696
Dascalu, M. I., Moldoveanu, A., & Shudayfat, E. A. (2014). Mixed reality to support new learning paradigms. 2014 18th International Conference on System Theory, Control and Computing, ICSTCC 2014, 692–697. https://doi.org/10.1109/ICSTCC.2014.6982498
Dede, C. J., Jacobson, J., & Richards, J. (2017). Introduction: Virtual, Augmented, and Mixed Realities in Education (pp. 1–16). https://doi.org/10.1007/978-981-10-5490-7_1
Duan, X., Kang, S. J., Choi, J. I., & Kim, S. K. (2020). Mixed reality system for virtual chemistry lab. KSII Transactions on Internet and Information Systems, 14(4), 1673–1688. https://doi.org/10.3837/TIIS.2020.04.014
Fiore, A., Mainetti, L., & Vergallo, R. (2014). An Innovative Educational Format Based on a Mixed Reality Environment: A Case Study and Benefit Evaluation. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (Vol. 138, pp. 93–100). https://doi.org/10.1007/978-3-319-13293-8_12
Fotouhi-Ghazvini, F., Earnshaw, R., Moeini, A., Robison, D., & Excell, P. (2011). From E-Learning to M-Learning - the use of mixed reality games as a new educational paradigm. International Journal of Interactive Mobile Technologies (IJIM), 5(2), 17. https://doi.org/10.3991/ijim.v5i2.1463
Garzotto, F., Torelli, E., Vona, F., & Aruanno, B. (2019). HoloLearn: Learning through mixed reality for people with cognitive disability. Proceedings - 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018, 189–190. https://doi.org/10.1109/AIVR.2018.00042
Ghosh, S. K. (2016). The Use of Virtual, Augmented and Mixed Reality in Anatomy Education. In Academic Medicine (Vol. 91, Issue 10). https://doi.org/10.1097/acm.0000000000001339
Hauze, S. W., Hoyt, H. H., Frazee, J. P., Greiner, P. A., & Marshall, J. M. (2019). Enhancing nursing education through affordable and realistic holographic mixed reality: The virtual standardized patient for clinical simulation. Advances in Experimental Medicine and Biology, 1120, 1–13. https://doi.org/10.1007/978-3-030-06070-1_1
Herring, M. C., Koehler, M. J., & Mishra, P. (2016). Handbook of technological pedagogical content knowledge (TPACK) for educators: Second edition. In: Mary C. Herring, Matthew J. Koehler, Punya Mishra (Eds) Handbook of Technological Pedagogical Content Knowledge (TPACK) for Educators: Second Edition (Issue February). https://doi.org/10.4324/9781315771328
Hoffmann, M., Meisen, T., & Jeschke, S. (2016). Shifting virtual reality education to the next level – experiencing remote laboratories through mixed reality. Engineering Education. https://doi.org/10.1007/978-3-319-46916-4
Holstein, K., McLaren, B. M., & Aleven, V. (2018). Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Vol. 10947 LNAI. Springer International Publishing. https://doi.org/10.1007/978-3-319-93843-1_12
Horst, R., & Dorner, R. (2018). Opportunities for Virtual and Mixed Reality Knowledge Demonstration. Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality. ISMAR-Adjunct, 2018, 381–385. https://doi.org/10.1109/ISMAR-Adjunct.2018.00110
Jingen Liang, L., & Elliot, S. (2021). A systematic review of augmented reality tourism research: What is now and what is next? Tourism and Hospitality Research, 21(1), 15–30. https://doi.org/10.1177/1467358420941913
John, B., & Kurian, J. (2019). Making the World a Better Place with Mixed Reality in Education. Australasian Conference on Information Systems, 344–354.
Juraschek, M., Büth, L., Posselt, G., & Herrmann, C. (2018). Mixed Reality in Learning Factories. Procedia Manufacturing, 23(2017), 153–158. https://doi.org/10.1016/j.promfg.2018.04.009
Ke, F., Lee, S., & Xu, X. (2016). Teaching training in a mixed-reality integrated learning environment. Computers in Human Behavior, 62, 212–220. https://doi.org/10.1016/j.chb.2016.03.094
Kim, K. J., Choi, M. J., & Kim, K. J. (2021). Effects of nursing simulation using mixed reality: A scoping review. In Healthcare (Switzerland) (Vol. 9, Issue 8). MDPI. https://doi.org/10.3390/healthcare9080947
Kitchenham, B. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering. https://www.researchgate.net/publication/302924724
Knierim, P., Kosch, T., Hoppe, M., & Schmidt, A. (2018). Challenges and Opportunities of Mixed Reality Systems in Education. Mensch Und Computer 2018 - Workshopband, September 2018, 1–6.
Kolb, D. A., Boyatzis, R. E., & Mainemelis, C. (2014). Experiential learning theory: Previous research and new directions. Perspectives on Thinking, Learning, and Cognitive Styles, 216, 227–247. https://doi.org/10.4324/9781410605986-9
Kommetter, C., & Ebner, M. (2019). A Pedagogical Framework for Mixed Reality in Classrooms based on a Literature Review. EdMedia + Innovate Learning 2019, 901–911.
Kucera, E., Haffner, O., & Leskovsky, R. (2018). Interactive and virtual/mixed reality applications for mechatronics education developed in unity engine. Proceedings of the 29th International Conference on Cybernetics and Informatics, K and I 2018, 2018-Janua(January), 1–5. https://doi.org/10.1109/CYBERI.2018.8337533
Leonard, S. N., & Fitzgerald, R. N. (2018). Holographic learning: A mixed reality trial of Microsoft Hololens in an Australian secondary school. Research in Learning Technology, 26(1063519), 1–12.
Lindgren, R., & Moshell, J. M. (2011). Supporting children’s learning with body-based metaphors in a mixed reality environment. Proceedings of IDC 2011 - 10th International Conference on Interaction Design and Children, 177–180. https://doi.org/10.1145/1999030.1999055
Lindgren, R., Tscholl, M., Wang, S., & Johnson, E. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Computers and Education, 95, 174–187. https://doi.org/10.1016/j.compedu.2016.01.001
Listiawan, T., Purwanto, P., & As’Ari, A. R., & Muksar, M. (2018). Mathematics Teachers Technological Content Knowledge (TCK) in using Dynamic Geometry Software. Journal of Physics: Conference Series, 1114(1), 012121. https://doi.org/10.1088/1742-6596/1114/1/012121
Maas, M. J., & Hughes, J. M. (2020). Virtual, augmented and mixed reality in K–12 education: A review of the literature. Technology, Pedagogy and Education, 29(2), 231–249. https://doi.org/10.1080/1475939X.2020.1737210
Machover, C., & Tice, S. E. (1997). Virtual reality - Virtual Reality. IEEE Computer Graphics and Application, 1, 15–16.
Martín-Gutiérrez, J., & Contero, M. (2011). Mixed reality for learning standard mechanical elements. Proceedings of the 2011 11th IEEE International Conference on Advanced Learning Technologies, ICALT 2011, 372–374. https://doi.org/10.1109/ICALT.2011.117
Mateu, J., Lasala, M. J., & Alamán, X. (2014). VirtualTouch: A tool for developing mixed reality educational applications and an example of use for inclusive education. International Journal of Human-Computer Interaction, 30(10), 815–828. https://doi.org/10.1080/10447318.2014.927278
Mateu, J., Lasala, M. J., & Alamán, X. (2015). Developing mixed reality educational applications: The virtual touch toolkit. Sensors (switzerland), 15(9), 21760–21784. https://doi.org/10.3390/s150921760
Microsoft Holoportation Team. (n.d.). HoloportationTM - Microsoft Research. Retrieved January 27, 2022, from https://www.microsoft.com/en-us/research/project/holoportation-3/
Ministry of Education Culture Research and Technology. (2021). Program Sekolah Menengah Sekolah Kejuruan Pusat Keunggulan. www.kemdikbud.go.id
Morgan, H. (2014). Review of research: the education system in finland: a success story other countries can emulate. Childhood Education, 90(6), 453–457. https://doi.org/10.1080/00094056.2014.983013
Neuman, L. W. (2012). Basics of Social Research: Qualitative and Quantitative (3rd ed.). Pearson. https://www.pearson.com/store/p/basics-of-social-research-pearson-new-international-edition/P200000005112/9781292020341
Nicola, S., & Stoicu-Tivadar, L. (2018). Mixed reality supporting modern medical education. Studies in Health Technology and Informatics, 255, 242–246. https://doi.org/10.3233/978-1-61499-921-8-242
Niess, M. L. (2011). Investigating TPACK: Knowledge growth in teaching with technology. Journal of Educational Computing Research, 44(3), 299–317. https://doi.org/10.2190/EC.44.3.c
Pamungkas, S. F., Widiastuti, I., & Suharno. (2019). Kolb’s experiential learning for vocational education in mechanical engineering: A review. AIP Conference Proceedings, 2114. https://doi.org/10.1063/1.5112427
Pellas, N., Kazanidis, I., & Palaigeorgiou, G. (2020). A systematic literature review of mixed reality environments in K-12 education. Education and Information Technologies, 25(4), 2481–2520. https://doi.org/10.1007/s10639-019-10076-4
Pittara, M., Matsangidou, M., Stylianides, K., Petkov, N., & Pattichis, C. S. (2020). Virtual Reality for Pain Management in Cancer: A Comprehensive Review. In IEEE Access (Vol. 8, pp. 225475–225489). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ACCESS.2020.3044233
Quint, F., Sebastian, K., & Gorecky, D. (2015). A Mixed-reality Learning Environment. Procedia Computer Science, 75(Vare), 43–48. https://doi.org/10.1016/j.procs.2015.12.199
Suryodiningrat, S. P., Prabowo, H., Meyliana, & Hidayanto, A. N. (2021). Mixed Reality System for Teaching and Learning: A Systematic Literature Review. Proceedings - 2021 IEEE 5th International Conference on Information Technology, Information Systems and Electrical Engineering: Applying Data Science and Artificial Intelligence Technologies for Global Challenges During Pandemic Era, ICITISEE 2021. https://doi.org/10.1109/ICITISEE53823.2021.9655922
Tang, Y. M., Au, K. M., Lau, H. C. W., Ho, G. T. S., & Wu, C. H. (2020). Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Reality, 24(4), 797–807. https://doi.org/10.1007/s10055-020-00427-9
The Oculus Team. (n.d.). Introducing Oculus Quest. Retrieved December 24, 2022, from https://www.oculus.com/blog/introducing-oculus-quest-our-first-6dof-all-in-one-vr-system-launching-spring-2019/
Touel, S., Marfisi-Schottman, I., & George, S. (2020). Analysis of Mixed Reality Tools for Learning Math in Primary and Secondary School. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12517 LNCS, 112–121. https://doi.org/10.1007/978-3-030-63464-3_11
Tseng, C.-Y., Shu, Y., Huang, T.-C., Hsu, W.-C., & Chien, P.-L. (2021). Integration of Mixed Reality in Teaching and Learning Effectiveness: A Systematic Literature Review of the Analyses (pp. 85–94). https://doi.org/10.1007/978-3-030-91540-7_10
Uhomoibhi, J., Onime, C., & Wang, H. (2020). A study of developments and applications of mixed reality cubicles and their impact on learning. International Journal of Information and Learning Technology, 37(1–2), 15–31. https://doi.org/10.1108/IJILT-02-2019-0026
Vasilevski, N., & Birt, J. (2020). Analysing construction student experiences of mobile mixed reality enhanced learning in virtual and augmented reality environments. Research in Learning Technology, 28, 1–23.
Weng, C., Rathinasabapathi, A., Weng, A., & Zagita, C. (2019). Mixed Reality in Science Education as a Learning Support: A Revitalized Science Book. Journal of Educational Computing Research. https://doi.org/10.1177/0735633118757017
White, J. (n.d.). Microsoft at MWC Barcelona: Introducing Microsoft HoloLens 2 -. Retrieved December 24, 2022, from https://blogs.microsoft.com/blog/2019/02/24/microsoft-at-mwc-barcelona-introducing-microsoft-hololens-2/
Xu, X., Lu, Y., Vogel-Heuser, B., & Wang, L. (2021). Industry 4.0 and Industry 5.0—Inception, conception and perception. Journal of Manufacturing Systems, 61(October), 530–535. https://doi.org/10.1016/j.jmsy.2021.10.006
Yannier, N., Hudson, S. E., & Koedinger, K. R. (2020). Active learning is about more than hands-on: a mixed-reality ai system to support STEM education. International Journal of Artificial Intelligence in Education, 30(1), 74–96. https://doi.org/10.1007/s40593-020-00194-3
Yardley, S., Teunissen, P. W., & Dornan, T. (2012). Experiential learning: Transforming theory into practice. Medical Teacher, 34(2), 161–164. https://doi.org/10.3109/0142159X.2012.643264
Zakharov, P. V., Vdovin, R. S., Markidonov, A. V., Kochkin, A. S., & Vdovin, A. S. (2020). Virtual and mixed reality in the study of the geometry of the crystal lattice. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1515/2/022001
Funding
This research has been funded, supported, facilitated, and supervised by Bina Nusantara University.
Author information
Authors and Affiliations
Contributions
All authors conceived, planned the experiment, and carried out the experiment. SPS, AR, HP, and HBS contributed to the interpretation of the results. AR, HP, HBS, and TH supervise the research. SPS and AR took the lead in writing the manuscript. All authors provided critical feedback and helped shape the research, analysis, and manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no conflicts of interest.
Research involving human participants and/or animals
The research has not involved human or animal experiments.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethical statements
We hereby declare that this manuscript is the result of our independent creation under the reviewer’s comments. Except for the quoted contents, this manuscript does not contain any research achievements that have been published or written by other individual or groups. We are the only authors of this manuscript. The legal responsibility of this statement shall be borne by us.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Suryodiningrat, S.P., Ramadhan, A., Prabowo, H. et al. Mixed reality systems in education: a systematic literature review. J. Comput. Educ. (2023). https://doi.org/10.1007/s40692-023-00281-z
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40692-023-00281-z