ABSTRACT
In this paper, we describe an experiment designed to evaluate the effectiveness of three interfaces for surveillance or remote control using live 360-degree video feeds from a person or vehicle in the field. Video feeds are simulated using a game engine. While locating targets within a 3D terrain using a 2D 360-degree interface, participants indicated perceived egocentric directions to targets and later placed targets on an overhead view of the terrain. Interfaces were compared based on target finding and map placement performance. Results suggest 1) non-seamless interfaces with visual boundaries facilitate spatial understanding, 2) correct perception of self-to-object relationships is not correlated with understanding object-to-object relationships within the environment, and 3) increased video game experience corresponds with better spatial understanding of an environment observed in 360-degrees. This work can assist researchers of panoramic video systems in evaluating the optimal interface for observation and teleoperation of remote systems.
- Irrlicht Engine - A free open source 3d engine.Google Scholar
- Agarwala, A., Zheng, K. C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D. and Szeliski, R. Panoramic video textures. ACM Trans. Graph., 24, 3 (2005), 821--827. Google ScholarDigital Library
- Baldwin, J., Basu, A. and Zhang, H., Panoramic video with predictive windows for telepresence applications. in IEEE International Conference on Robotics and Automation, (1999), 2884--2889.Google ScholarCross Ref
- Burt, P. and Adelson, E. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, 2, 4 (1983), 217--236. Google ScholarDigital Library
- Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V. and Hart, J. C. The CAVE: audio visual experience automatic virtual environment. Commun. ACM, 35, 6 (1992), 64--72. Google ScholarDigital Library
- Feng, J., Spence, I. and Pratt, J. Playing an Action Video Game Reduces Gender Difference in Spatial Cognition. Psychological Science, 18, 10 (2007), 850--855.Google Scholar
- Fiala, M., Pano-presence for teleoperation. in Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ International Conference on, (2005), 3798--3802.Google ScholarCross Ref
- Foo, P., Warren, W. H., Duchon, A. and Tarr, M. J. Do humans integrate routes into a cognitive map? Map-versus landmark-based navigation of novel shortcuts. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 2 (2005), 195--215.Google Scholar
- Foote, J. and Kimber, D., FlyCam: Practical panoramic video and automatic camera control. in IEEE International Conference on Multimedia and Expo, (2000), 1419--1422.Google ScholarCross Ref
- Franklin, N. and Tversky, B. Searching imagined environments. Journal of Experimental Psychology: General, 119, 1 (1990), 63--76.Google ScholarCross Ref
- Greenhill, S. and Venkatesh, S. Virtual observers in a mobile surveillance system Proceedings of the 14th annual ACM international conference on Multimedia, ACM, Santa Barbara, CA, USA, 2006, 579--588. Google ScholarDigital Library
- Hirose, M., Ogi, T. and Yamada, T. Integrating live video for immersive environments. Multimedia, IEEE, 6, 3 (1999), 14--22. Google ScholarDigital Library
- Kadous, M. W., Sheh, R. M. and Sammut, C., Effective user interface design for rescue robotics. in 1st ACM Conference on Human-Robot Interaction, (2006), 250--257. Google ScholarDigital Library
- Liu, H., Javed, O., Taylor, G., Cao, X. and Haering, N. Omni-directional surveilance for unmanned water vehicles 8th International Workshop on Visual Surveillance, 2008.Google Scholar
- Meguro, J., Hashizume, T., Takiguchi, J. and Kurosaki, R., Development of an autonomous mobile surveillance system using a network-based RTK-GPS. in 2005 IEEE International Conference on Robotics and Automation, (2005), 3096--3101.Google ScholarCross Ref
- Noë, A. Action in perception. MIT Press, Boston, MA, 2004.Google Scholar
- Park, J. and Myungseok, A. A novel application of panoramic surveillance system IEEE International Syposium on Industrial Electronics, Seoul, Korea, 2009, 205--210.Google Scholar
- Richman, J. B. and Dyre, B. P., Peripheral Visual Stimulation Benefits Heading Perception during Active Control in Human Factors and Ergonomics Society Annual Meeting, (1999), 1411.Google Scholar
- Schmidt, M., Rudolph, M., Werther, B. and Furstenau, N., Remote airport tower operation with augmented vision video panorama HMI. in 2nd International Conference Research in Air Transportation, (2006), 221--230.Google Scholar
- Shum, H. Y. and Szeliski, R. Panormic image mosaics Microsoft Research Technical Report, 1997.Google Scholar
- Stratton, G. M. Some preliminary experiments on vision without inversion of the retinal image. Psychology Review, 3, 6 (1896), 611--617.Google ScholarCross Ref
- Sun, X., Foote, J., Kimber, D. and Manjunath, B. S. Panoramic video capturing and compressed domain virtual camera control Proceedings of the ninth ACM international conference on Multimedia, ACM, Ottawa, Canada, 2001, 329--347. Google ScholarDigital Library
- Szeliski, R. Image mosaicing for tele-reality applications DEC and Cambridge Research Lab Technical Report, 1994.Google Scholar
- Tang, W.-K., Wong, T.-T. and Heng, P. A. A system for real-time panorama generation and display in teleimmersive applications. Multimedia, IEEE Transactions on, 7, 2 (2005), 280--292. Google ScholarDigital Library
- Vincent, L. Taking Online Maps Down to Street Level. Computer, 40, 12 (2007), 118--120. Google ScholarDigital Library
- Waller, D., Loomis, J. M., Golledge, R. G. and Beall, A. C. Place learning in humans: The role of distance and direction information. Spatial Cognition and Computation, 2, 4 (2000), 333--354. Google ScholarDigital Library
- Welch, R. B. Discriminative conditioning of prism adaptation. Perception and Psychophysics, 10, (1971), 90--92.Google ScholarCross Ref
- Xiong, Y. and Turkowski, K., Creating image-based VR using a self-calibrating fisheye lens. in IEEE Computer Society on Computer Vision and Pattern Recognition, (1997), 237--243. Google ScholarDigital Library
Index Terms
The impact of three interfaces for 360-degree video on spatial cognition
Recommendations
How people use 360-degree cameras
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous MultimediaA variety of new kinds of consumer cameras that capture the full 360-degree surroundings in a single panorama photo or video has recently been introduced to the market. In addition to conventional viewing devices, such as smartphones and computers, the ...
Evaluating snapping-to-photos virtual travel interfaces for 3D reconstructed visual reality
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyNavigating through a virtual, 3D reconstructed scene has recently become very important in many applications. A popular approach is to virtually travel to the photos used in reconstructing the scene; such an approach may be generally termed a "snapping-...
Individual differences in virtual reality: Are spatial presence and spatial ability linked?
One aim of virtual reality technology is to immerse the user in a digital environment that is distinct from physical reality. Feeling spatially located in this digital environment is central to the experience and is more formally known as spatial ...
Comments