Skip to main content

Virtual Reality Simulator for Police Training with AI-Supported Cover Detection

  • Conference paper
  • First Online:
Serious Games (JCSG 2023)

Abstract

Training of different scenarios is essential to prepare emergency services for real-world situations. In this paper, we introduce a virtual reality (VR) simulator specifically designed to enhance the training of police officers in the context of apartment search and area securing, including the evaluation of potential threats or hazards. At this point, multiple police officers train simultaneously by employing virtual reality headsets and full-body suits, enabling them to see and interact with each other’s avatars. We additionally developed a configuration tool to enable operational trainers to easily create new buildings with custom interiors. Moreover, we developed an algorithm that automatically recognizes possible dangerous areas, especially when police officers have no cover. In this case, a non-player character is spawned, representing either neutral individuals or potential assailants, strategically placed to confront police officers and accentuate tactical mistakes. Field tests have substantiated the efficacy of our approach, demonstrating a high \(F_1\) score of 0.93 in identifying tactical mistakes made by police officers. Furthermore, the training outcomes have revealed that virtual training is comparable to traditional training in terms of maximum recovered area. These findings demonstrate the immense potential of VR-based simulators for police training, as they enable the creation of various scenarios and thus increase the number of training sessions. The simulator is particularly attractive also due to alternate training scenarios with individual difficulty levels making it suitable for students and special units.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    RE-liON: https://re-lion.com, last accessed on May 4, 2023.

  2. 2.

    THALES: https://www.thalesgroup.com/en/europe/germany/defence-security-germany-missionenabler, last accessed on May 4, 2023.

  3. 3.

    Refense: https://www.refense.com, last accessed on May 4, 2023.

  4. 4.

    TriCAT: https://tricat.net/en/imedtasim/, last accessed on May 4, 2023.

  5. 5.

    XVR: https://www.xvrsim.com/en/, last accessed on May 4, 2023.

  6. 6.

    CryEngine: https://www.cryengine.com, last accessed on April 3, 2023.

  7. 7.

    HTC Vive Pro Eye: https://www.vive.com/us/product/vive-pro-eye/overview/, last accessed on April 3, 2023.

  8. 8.

    Teslasuit: https://teslasuit.io, last accessed on April 3, 2023.

References

  1. Beils, M.: Virtual Reality im Einsatztraining: Wie die Polizei NRW Pionierarbeit als Teil eines EU-Projekts leistet (2019). https://polizei.nrw/sites/default/files/2022-08/Streife_03_2022_09_Web.pdf. Accessed 25 Apr 2023

  2. Bertram, J., Moskaliuk, J., Cress, U.: Virtual training: making reality work? Comput. Hum. Behav. 43, 284–292 (2015). https://doi.org/10.1016/j.chb.2014.10.032

    Article  Google Scholar 

  3. Caserman, P., Schmidt, P., Göbel, T., Zinnäcker, J., Kecke, A., Göbel, S.: Impact of full-body avatars in immersive multiplayer virtual reality training for police forces. IEEE Trans. Games 14(4), 706–714 (2022). https://doi.org/10.1109/TG.2022.3148791

    Article  Google Scholar 

  4. CeFaan, K., Hartmann, J., Sowa, E.: EXCLUSIVE: NYPD is testing virtual reality training drills for real-life scenarios like active shooters (2019). https://abc7ny.com/nypd-uses-virtual-reality-to-train-for-active-shooters/5269109/. Accessed 21 Apr 2023

  5. Dörner, R., Göbel, S., Effelsberg, W., Wiemeyer, J.: Serious Games: Foundations. Concepts and Practice. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40612-1

  6. Eller, C., Bittner, T., Dombois, M., Rüppel, U.: Collaborative immersive planning and training scenarios in VR. In: Smith, I.F.C., Domer, B. (eds.) EG-ICE 2018. LNCS, pp. 164–185. Springer International Publishing, Cham (2018). https://doi.org/10.1007/978-3-319-91635-4_9

    Chapter  Google Scholar 

  7. Faul, F., Erdfelder, E., Lang, A.G., Buchner, A.: G* power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39(2), 175–191 (2007). https://doi.org/10.3758/BF03193146

    Article  Google Scholar 

  8. Giessing, L.: The potential of virtual reality for police training under stress: a SWOT analysis. In: Interventions, Training, and Technologies for Improved Police Well-being and Performance, pp. 102–124. IGI Global (2021). https://doi.org/10.4018/978-1-7998-6820-0.ch006

  9. Li, C., Liang, W., Quigley, C., Zhao, Y., Yu, L.F.: Earthquake safety training through virtual drills. IEEE Trans. Visual Comput. Graphics 23(4), 1275–1284 (2017). https://doi.org/10.1109/TVCG.2017.2656958

    Article  Google Scholar 

  10. Moskaliuk, J., Bertram, J., Cress, U.: Impact of virtual training environments on the acquisition and transfer of knowledge. Cyberpsychol. Behav. Soc. Netw. 16(3), 210–214 (2013). https://doi.org/10.1089/cyber.2012.0416

    Article  Google Scholar 

  11. Murtinger, M., Jaspaert, E., Schrom-Feiertag, H., Egger-Lampl, S.: CBRNe training in virtual environments: SWOT analysis & practical guidelines. Int. J. Saf. Secur. Eng. 11(4), 295–303 (2021). https://doi.org/10.18280/ijsse.110402

  12. Murtinger, M., Uhl, J., Schrom-Feiertag, H., Nguyen, Q., Harthum, B., Tscheligi, M.: Assist the VR trainer - real-time dashboard and after-action review for police VR training. In: 2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), pp. 69–74 (2022). https://doi.org/10.1109/MetroXRAINE54828.2022.9967532

  13. Narciso, D., Melo, M., Rodrigues, S., Cunha, J.P.S., Bessa, M.: Impact of different stimuli on user stress during a virtual firefighting training exercise. In: 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE), pp. 813–818 (2020). https://doi.org/10.1109/BIBE50027.2020.00138

  14. Nguyen, Q., Jaspaert, E., Murtinger, M., Schrom-Feiertag, H., Egger-Lampl, S., Tscheligi, M.: Stress out: translating real-world stressors into audio-visual stress cues in VR for police training. In: Ardito, C., et al. (eds.) INTERACT 2021. LNCS, vol. 12933, pp. 551–561. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85616-8_32

    Chapter  Google Scholar 

  15. Shewaga, R., Uribe-Quevedo, A., Kapralos, B., Lee, K., Alam, F.: A serious game for anesthesia-based crisis resource management training. Comput. Entertain. 16(2) (2018). https://doi.org/10.1145/3180660

  16. Uhl, J.C., Murtinger, M., Zechner, O., Tscheligi, M.: Threat assessment in police VR training: multi-sensory cues for situation awareness. In: 2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), pp. 432–437 (2022). https://doi.org/10.1109/MetroXRAINE54828.2022.9967692

  17. Zechner, O., Kleygrewe, L., Jaspaert, E., Schrom-Feiertag, H., Hutter, R.I.V., Tscheligi, M.: Enhancing operational police training in high stress situations with virtual reality: experiences, tools and guidelines. Multimodal Technol. Interact. 7(2), 14 (2023). https://doi.org/10.3390/mti7020014

    Article  Google Scholar 

  18. Zyda, M.: From visual simulation to virtual reality to games. Computer 38(9), 25–32 (2005). https://doi.org/10.1109/MC.2005.297

    Article  Google Scholar 

Download references

Acknowledgements

This project was funded by the German Federal Ministry of Education and Research under the research for civil security program (Grant Numbers: 13N15546 [HöMS], 13N15547 [TU Darmstadt], and 13N15548 [Crytek GmbH]).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Polona Caserman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Caserman, P. et al. (2023). Virtual Reality Simulator for Police Training with AI-Supported Cover Detection. In: Haahr, M., Rojas-Salazar, A., Göbel, S. (eds) Serious Games. JCSG 2023. Lecture Notes in Computer Science, vol 14309. Springer, Cham. https://doi.org/10.1007/978-3-031-44751-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44751-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44750-1

  • Online ISBN: 978-3-031-44751-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics