Georg Regal
Markus Murtinger
ABSTRACT
In this position paper, we discuss possibilities to support emergency personnel in incidents involving chemical, biological, radioactive, nuclear, and explosive (CBRNE) materials. Based on related work we formulate ideas for augmenting human capabilities in the CBRNE domain. We envision augmentation of physical capabilities (human-machine symbiosis, augmented strength), augmentation of cognitive capabilities (assistance systems, enhanced situation awareness), and augmentation of human senses (augmented vision, hearing, and haptics, augmented taste and smell) as promising directions for future research activities.
- Julie A. Adams. 2005. Human-Robot Interaction Design: Understanding User Needs and Requirements. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 49. Sage Journals, 447–451. https://doi.org/10.1177/154193120504900349 arXiv:https://doi.org/10.1177/154193120504900349Google Scholar
Cross Ref
- Kazuma Aoyama, Nobuhisa Miyamoto, Satoru Sakurai, Hiroyuki Iizuka, Makoto Mizukami, Masahiro Furukawa, Taro Maeda, and Hideyuki Ando. 2021. Electrical Generation of Intranasal Irritating Chemosensation. IEEE Access 9(2021), 106714–106724. https://doi.org/10.1109/ACCESS.2021.3100851Google ScholarCross Ref
- Matthias Baldauf, Peter Fröhlich, and Siegfried Hutter. 2010. KIBITZER: A Wearable System for Eye-Gaze-Based Mobile Urban Exploration. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). ACM, New York, NY, USA, Article 9, 5 pages. https://doi.org/10.1145/1785455.1785464Google ScholarDigital Library
- Jas Brooks, Shan-Yuan Teng, Jingxuan Wen, Romain Nith, Jun Nishida, and Pedro Lopes. 2021. Stereo-Smell via Electrical Trigeminal Stimulation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA, Article 502, 13 pages. https://doi.org/10.1145/3411764.3445300Google ScholarDigital Library
- Anthony Carton and Lucy E. Dunne. 2013. Tactile Distance Feedback for Firefighters: Design and Preliminary Evaluation of a Sensory Augmentation Glove. In Proceedings of the 4th Augmented Human International Conference (Stuttgart, Germany) (AH ’13). ACM, New York, NY, USA, 58–64. https://doi.org/10.1145/2459236.2459247Google ScholarDigital Library
- Parag Chatterjee, Leandro J. Cymberknop, and Ricardo L. Armentano. 2018. IoT-Based eHealth Toward Decision Support System for CBRNE Events. In Enhancing CBRNE Safety & Security: Proceedings of the SICC 2017 Conference, Andrea Malizia and Marco D’Arienzo (Eds.). Springer, Cham, 183–188.Google ScholarCross Ref
- Michiel P. de Looze, Tim Bosch, Frank Krause, Konrad S. Stadler, and Leonard W. O’Sullivan. 2016. Exoskeletons for industrial application and their potential effects on physical work load. Ergonomics 59, 5 (2016), 671–681. https://doi.org/10.1080/00140139.2015.1081988 arXiv:https://doi.org/10.1080/00140139.2015.1081988PMID: 26444053.Google ScholarCross Ref
- LuAnn McClernan Duffus. 2019. Exoskeleton Requirements for Firefighters. Ph. D. Dissertation. Ohio University.Google Scholar
- Sebastian Egger-Lampl, Cornelia Gerdenitsch, Lisa Deinhard, Raimund Schatz, and Philipp Hold. 2019. Assembly instructions with AR: towards measuring interactive assistance experience in an industry 4.0 context. In 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX). IEEE.Google ScholarCross Ref
- Mica R Endsley and Daniel J Garland. 2000. Situation awareness analysis and measurement. CRC Press.Google ScholarCross Ref
- Douglas C Engelbart. 1962. Augmenting human intellect: A conceptual framework. Menlo Park, CA (1962).Google Scholar
- Okan Erat, Werner Alexander Isop, Denis Kalkofen, and Dieter Schmalstieg. 2018. Drone-augmented human vision: Exocentric control for drones exploring hidden areas. IEEE transactions on visualization and computer graphics 24, 4(2018), 1437–1446.Google Scholar
- Kevin Fan, Jean-Marc Seigneur, Suranga Nanayakkara, and Masahiko Inami. 2016. Electrosmog Visualization through Augmented Blurry Vision. In Proceedings of the 7th Augmented Human International Conference 2016 (Geneva, Switzerland) (AH ’16). ACM, New York, NY, USA, Article 35, 2 pages. https://doi.org/10.1145/2875194.2875203Google ScholarDigital Library
- Johannes Göllner, Andreas Peer, Christian Meurers, Gernot Wurzer, Christian Schönauer, Hannes Kaufmann, and Chris Bösch. 2019. Virtual Reality CBRN Defence. In Meeting Proceedings of the Simulation and Modelling Group Symposium, Vol. 171. 1–25.Google Scholar
- Yoni Halperin, Galit Buchs, Shachar Maidenbaum, Maya Amenou, and Amir Amedi. 2016. Social Sensing: A Wi-Fi Based Social Sense for Perceiving the Surrounding People. In Proceedings of the 7th Augmented Human International Conference 2016 (Geneva, Switzerland) (AH ’16). ACM, New York, NY, USA, Article 42, 2 pages. https://doi.org/10.1145/2875194.2875228Google ScholarDigital Library
- Surina Hariri, Nur Ain Mustafa, Kasun Karunanayaka, and Adrian David Cheok. 2016. Electrical Stimulation of Olfactory Receptors for Digitizing Smell. In Proceedings of the 2016 Workshop on Multimodal Virtual and Augmented Reality (Tokyo, Japan) (MVAR ’16). ACM, New York, NY, USA, Article 4, 4 pages. https://doi.org/10.1145/3001959.3001964Google ScholarDigital Library
- David Heslop. 2019. Beyond traditional CBRN force protection–a future of CBRN hardened super-soldiers?Global Biosecurity 1, 1 (2019).Google Scholar
- Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013. Augmented Manufacturing: A Study with Impaired Persons on Assistive Systems Using in-Situ Projection. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments (Rhodes, Greece) (PETRA ’13). ACM, New York, NY, USA, Article 21, 8 pages. https://doi.org/10.1145/2504335.2504356Google ScholarDigital Library
- Tomas Lazna. 2018. The visualization of threats using the augmented reality and a remotely controlled robot. IFAC-PapersOnLine 51, 6 (2018), 444–449.Google ScholarCross Ref
- Lei Liu and Pamela J. Hinds. 2009. Transactive Memory Systems: A Perspective on Coordination in Human-Robot Incident Response Teams. In Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction (La Jolla, California, USA) (HRI ’09). ACM, New York, NY, USA, 269–270. https://doi.org/10.1145/1514095.1514170Google ScholarDigital Library
- Pawełt Maciejewski, Małgorzata Gawlik-Kobylińska, Jacek Lebiedź, Witold Ostant, and Doğan Aydın. 2020. To Survive in a CBRN Hostile Environment: Application of CAVE Automatic Virtual Environments in First Responder Training. In Proceedings of the 3rd International Conference on Applications of Intelligent Systems (Las Palmas de Gran Canaria, Spain) (APPIS 2020). ACM, New York, NY, USA, Article 16, 5 pages. https://doi.org/10.1145/3378184.3378212Google ScholarDigital Library
- Andrea Malizia and 2013/2014 CBRNe Masters Group. 2016. Disaster management in case of CBRNe events: an innovative methodology to improve the safety knowledge of advisors and first responders. Defense & Security Analysis 32, 1 (2016), 79–90.Google ScholarCross Ref
- Elke Mattheiss, Georg Regal, Christian Vogelauer, and Hugo Furtado. 2020. 3D Audio Navigation - Feasibility and Requirements for Older Adults. In Computers Helping People with Special Needs, Klaus Miesenberger, Roberto Manduchi, Mario Covarrubias Rodriguez, and Petr Peňáz (Eds.). Springer, 323–331.Google Scholar
- Takashi Miyaki and Jun Rekimoto. 2016. LiDARMAN: Reprogramming Reality with Egocentric Laser Depth Scanning. In ACM SIGGRAPH 2016 Emerging Technologies. ACM, New York, NY, USA. https://doi.org/10.1145/2929464.2929481Google ScholarDigital Library
- Annette Mossel, Christian Schoenauer, Mario Froeschl, Andreas Peer, Johannes Goellner, and Hannes Kaufmann. 2021. Immersive training of first responder squad leaders in untethered virtual reality. Virtual Reality 25, 3 (2021), 745–759.Google ScholarDigital Library
- Kurt Mudie, Daniel Billing, Alessandro Garofolini, Thomas Karakolis, and Michael LaFiandra. 2021. The need for a paradigm shift in the development of military exoskeletons. European Journal of Sport Science(2021), 1–8.Google Scholar
- Markus Murtinger, Emma Jaspaert, Helmut Schrom-Feiertag, and Sebastian Egger-Lampl. 2021. CBRNe training in virtual environments: SWOT analysis & practical guidelines. International Journal of Safety and Security Engineering 11, 4(2021), 295–303.Google ScholarCross Ref
- Hiromi Nakamura and Homei Miyashita. 2011. Augmented Gustation Using Electricity. In Proceedings of the 2nd Augmented Human International Conference (Tokyo, Japan) (AH ’11). ACM, New York, NY, USA, Article 34, 2 pages. https://doi.org/10.1145/1959826.1959860Google ScholarDigital Library
- Martin Pielot, Oliver Krull, and Susanne Boll. 2010. Where is My Team: Supporting Situation Awareness with Tactile Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). ACM, New York, NY, USA, 1705–1714. https://doi.org/10.1145/1753326.1753581Google ScholarDigital Library
- Nimesha Ranasinghe, David Tolley, Thi Ngoc Tram Nguyen, Liangkun Yan, Barry Chew, and Ellen Yi-Luen Do. 2019. Augmented flavours: Modulation of flavour experiences through electric taste augmentation. Food Research International 117 (2019), 60–68.Google ScholarCross Ref
- GlobalData Thematic Research. 2021. CBRNE Defence: Technology trends. https://www.army-technology.com/comment/cbrne-defence-technology-trends/ Accessed: 2022-02-16.Google Scholar
- Frank E. Schneider and Dennis Wildermuth. 2017. Using robots for firefighters and first responders: Scenario specification and exemplary system description. In 2017 18th International Carpathian Control Conference (ICCC). IEEE, 216–221. https://doi.org/10.1109/CarpathianCC.2017.7970400Google Scholar
- Christian Schönauer, Emanuel Vonach, Georg Gerstweiler, and Hannes Kaufmann. 2013. 3D Building Reconstruction and Thermal Mapping in Fire Brigade Operations. In Proceedings of the 4th Augmented Human International Conference (Stuttgart, Germany) (AH ’13). ACM, New York, NY, USA, 202–205. https://doi.org/10.1145/2459236.2459271Google ScholarDigital Library
- Sue Ann Seah, Diego Martinez Plasencia, Peter D. Bennett, Abhijit Karnik, Vlad Stefan Otrocol, Jarrod Knibbe, Andy Cockburn, and Sriram Subramanian. 2014. SensaBubble: A Chrono-Sensory Mid-Air Display of Sight and Smell. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). ACM, New York, NY, USA, 2863–2872. https://doi.org/10.1145/2556288.2557087Google ScholarDigital Library
- David L Smyth, James Fennell, Sai Abinesh, Nazli B Karimi, Frank G Glavin, Ihsan Ullah, Brett Drury, and Michael G Madden. 2018. A virtual environment with multi-robot navigation, analytics, and decision support for critical incident investigation. arXiv preprint arXiv:1806.04497(2018).Google Scholar
- Charles Spence, Marianna Obrist, Carlos Velasco, and Nimesha Ranasinghe. 2017. Digitizing the chemical senses: Possibilities & pitfalls. International Journal of Human-Computer Studies 107 (2017), 62–74. https://doi.org/10.1016/j.ijhcs.2017.06.003Google ScholarDigital Library
- Ihsan Ullah, Sai Abinesh, David L Smyth, Nazli B Karimi, Brett Drury, Frank G Glavin, and Michael G Madden. 2018. A virtual testbed for critical incident investigation with autonomous remote aerial vehicle surveying, artificial intelligence, and decision support. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 216–221.Google Scholar
- Augmented CBRNE Responder - Directions for Future Research
Recommendations
How should metaverse augment humans with disabilities?
AH2022: 13th Augmented Human International ConferenceThe metaverse is a new paradigm made possible by emerging technologies like virtual reality, augmented reality, and blockchains. Humans with disabilities should not be excluded from the metaverse and should have equitable access to it. However, it is ...
Augmented Human: Augmented Reality and Beyond
AltMM'18: Proceedings of the 3rd International Workshop on Multimedia Alternate RealitiesWill Augmented Reality (AR) allow us to access digital information, experience others' stories, and thus explore alternate realities? AR has recently attracted attention again due to the rapid advances in related multimedia technologies as well as ...
Augmented Foot: A Comprehensive Survey of Augmented Foot Interfaces
AHs '21: Proceedings of the Augmented Humans International Conference 2021Augmented foot interfaces have been studied since the beginning of wearable computers. The worlds’ first wearable computer was an instrumented shoe that consisted of a toe operated switch with a wireless module. Since then, academic research and ...
Comments