Nico Li
Stephen Cartwright
Ehud Sharlin
ABSTRACT
We present Flying Frustum, a 3D spatial interface that enables control of semi-autonomous UAVs (Unmanned Aerial Vehicles) using pen interaction on a physical model of the terrain, and that spatially situates the information streaming from the UAVs onto the physical model. Our interface is based on a 3D printout of the terrain, which allows the operator to enter goals and paths to the UAV by drawing them directly on the physical model. In turn, the UAV's streaming reconnaissance information is superimposed on the 3D printout as a view frustum, which is situated according to the UAV's position and orientation on the actual terrain. We argue that Flying Frustum's 3D spatially situated interaction can potentially help improve human-UAV awareness and enhance the overall situational awareness. We motivate our design approach for Flying Frustum, discuss previous related work in CSCW and HRI, present our preliminary prototype using both handheld and headset augmented reality interfaces, reflect on Flying Frustum's strengths and weaknesses, and discuss our plans for future evaluation and prototype improvements.
Supplemental Material
- Goodrich, Michael A., and Alan C. Schultz. "Human-robot interaction: a survey." Foundations and trends in human-computer interaction 3 (2007): 203--275. Google Scholar
Digital Library
- Mitchell, P. M., M. L. Cummings, and T. B. Sheridan. "Management of multiple dynamic human supervisory control tasks." 10th International Command and Control Research and Technology Symposium. 2005.Google Scholar
- Lily Camera. (2015, May 25). Retrieved from https://www.lily.cameraGoogle Scholar
- Amazon Prime Air. (2015, May 25). Retrieved from http://www.amazon.com/b?node=8037720011Google Scholar
- Drury, Jill L., Laurel Riek, and Nathan Rackliffe. "A decomposition of UAV-related situation awareness." Proceedings of the HRI'06. ACM, 2006. Google ScholarDigital Library
- Drury, Jill L., and Stacey D. Scott. "Awareness in unmanned aerial vehicle operations." The International C2 Journal 2.1 (2008): 1--10.Google Scholar
- Endsley, Mica R. "Theoretical underpinnings of situation awareness: A critical review." Situation awareness analysis and measurement (2000): 3--32.Google Scholar
- Drury, Jill L., Justin Richer, Nathan Rackliffe, and Michael A. Goodrich. Comparing situation awareness for two unmanned aerial vehicle human interface approaches. MITRE CORP BEDFORD MA, 2006. Retrieved from http://www.dtic.mil/dtic/tr/fulltext/u2/a456256.pdfGoogle Scholar
- Nielsen, Curtis W., Michael Goodrich, and Robert W. Ricks. "Ecological interfaces for improving mobile robot teleoperation." Robotics, IEEE Transactions on 23.5 (2007): 927--941. Google ScholarDigital Library
- Gutwin, Carl, and Saul Greenberg. "A descriptive framework of workspace awareness for real-time groupware." Computer Supported Cooperative Work (CSCW) 11.3--4 (2002): 411--446. Google ScholarDigital Library
- Yanco, Holly A., and Jill L. Drury. "Classifying human-robot interaction: an updated taxonomy." SMC (3). 2004.Google Scholar
- Drury, Jill L., Jean Scholtz, and Holly Yanco. "Awareness in human-robot interactions." Systems, Man and Cybernetics, 2003. IEEE International Conference on. Vol. 1. IEEE, 2003.Google Scholar
- Li, Nico, Aditya Shekhar Nittala, Ehud Sharlin, and Mario Costa Sousa. "Shvil: collaborative augmented reality land navigation." CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 2014. Google ScholarDigital Library
- Billinghurst, Mark, and Hirokazu Kato. "Collaborative augmented reality." Communications of the ACM 45.7 (2002): 64--70. Google ScholarDigital Library
- Höllerer, Tobias, Steven Feiner, Tachio Terauchi, Gus Rashid, and Drexel Hallaway. "Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system." Computers & Graphics 23.6 (1999): 779--785.Google ScholarCross Ref
- Stafford, Aaron, Wayne Piekarski, and Bruce Thomas. "Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users." Proceedings of the 5th IEEE and ACM ISMAR'06. IEEE Computer Society, Google ScholarDigital Library
- Alem, Leila, and Weidong Huang, eds. Recent trends of mobile collaborative augmented reality systems. Springer Science & Business Media, 2011. Google ScholarDigital Library
- Kurata, Takeshi, Takahiro Oyabu, Nobuchika Sakata, Masakatsu Kourogi, and Hideaki Kuzuoka. "Tangible tabletop interface for an expert to collaborate with remote field workers." Proceedings of the CollabTech2005. 2005.Google Scholar
- Parasuraman, Raja, Thomas B. Sheridan, and Christopher D. Wickens. "A model for types and levels of human interaction with automation." Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on 30.3 (2000): 286--297. Google ScholarDigital Library
Index Terms
- Flying Frustum: A Spatial Interface for Enhancing Human-UAV Awareness
Recommendations
Contextually Adaptive Multimodal Mixed Reality Interfaces for Dismounted Operator Teaming with Unmanned System Swarms
Virtual, Augmented and Mixed RealityAbstractUS dismounted Special Operations Forces operating in near-threat environments must maintain their Situation Awareness, survivability, and lethality to maximize their effectiveness on mission. As small unmanned aerial systems and unmanned ground ...
A survey of cyber security threats and solutions for UAV communications and flying ad-hoc networks
AbstractUnmanned aerial vehicles (UAVs) are a rapidly evolving technology, and being highly mobile, UAV systems are able to cooperate with each other to accomplish a wide range of different tasks. UAVs can be used in commercial applications, ...
Comments