skip to main content
10.1145/2207676.2208647acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The impact of three interfaces for 360-degree video on spatial cognition

Published:05 May 2012Publication History

ABSTRACT

In this paper, we describe an experiment designed to evaluate the effectiveness of three interfaces for surveillance or remote control using live 360-degree video feeds from a person or vehicle in the field. Video feeds are simulated using a game engine. While locating targets within a 3D terrain using a 2D 360-degree interface, participants indicated perceived egocentric directions to targets and later placed targets on an overhead view of the terrain. Interfaces were compared based on target finding and map placement performance. Results suggest 1) non-seamless interfaces with visual boundaries facilitate spatial understanding, 2) correct perception of self-to-object relationships is not correlated with understanding object-to-object relationships within the environment, and 3) increased video game experience corresponds with better spatial understanding of an environment observed in 360-degrees. This work can assist researchers of panoramic video systems in evaluating the optimal interface for observation and teleoperation of remote systems.

References

  1. Irrlicht Engine - A free open source 3d engine.Google ScholarGoogle Scholar
  2. Agarwala, A., Zheng, K. C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D. and Szeliski, R. Panoramic video textures. ACM Trans. Graph., 24, 3 (2005), 821--827. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Baldwin, J., Basu, A. and Zhang, H., Panoramic video with predictive windows for telepresence applications. in IEEE International Conference on Robotics and Automation, (1999), 2884--2889.Google ScholarGoogle ScholarCross RefCross Ref
  4. Burt, P. and Adelson, E. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, 2, 4 (1983), 217--236. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V. and Hart, J. C. The CAVE: audio visual experience automatic virtual environment. Commun. ACM, 35, 6 (1992), 64--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Feng, J., Spence, I. and Pratt, J. Playing an Action Video Game Reduces Gender Difference in Spatial Cognition. Psychological Science, 18, 10 (2007), 850--855.Google ScholarGoogle Scholar
  7. Fiala, M., Pano-presence for teleoperation. in Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ International Conference on, (2005), 3798--3802.Google ScholarGoogle ScholarCross RefCross Ref
  8. Foo, P., Warren, W. H., Duchon, A. and Tarr, M. J. Do humans integrate routes into a cognitive map? Map-versus landmark-based navigation of novel shortcuts. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 2 (2005), 195--215.Google ScholarGoogle Scholar
  9. Foote, J. and Kimber, D., FlyCam: Practical panoramic video and automatic camera control. in IEEE International Conference on Multimedia and Expo, (2000), 1419--1422.Google ScholarGoogle ScholarCross RefCross Ref
  10. Franklin, N. and Tversky, B. Searching imagined environments. Journal of Experimental Psychology: General, 119, 1 (1990), 63--76.Google ScholarGoogle ScholarCross RefCross Ref
  11. Greenhill, S. and Venkatesh, S. Virtual observers in a mobile surveillance system Proceedings of the 14th annual ACM international conference on Multimedia, ACM, Santa Barbara, CA, USA, 2006, 579--588. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hirose, M., Ogi, T. and Yamada, T. Integrating live video for immersive environments. Multimedia, IEEE, 6, 3 (1999), 14--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Kadous, M. W., Sheh, R. M. and Sammut, C., Effective user interface design for rescue robotics. in 1st ACM Conference on Human-Robot Interaction, (2006), 250--257. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Liu, H., Javed, O., Taylor, G., Cao, X. and Haering, N. Omni-directional surveilance for unmanned water vehicles 8th International Workshop on Visual Surveillance, 2008.Google ScholarGoogle Scholar
  15. Meguro, J., Hashizume, T., Takiguchi, J. and Kurosaki, R., Development of an autonomous mobile surveillance system using a network-based RTK-GPS. in 2005 IEEE International Conference on Robotics and Automation, (2005), 3096--3101.Google ScholarGoogle ScholarCross RefCross Ref
  16. Noë, A. Action in perception. MIT Press, Boston, MA, 2004.Google ScholarGoogle Scholar
  17. Park, J. and Myungseok, A. A novel application of panoramic surveillance system IEEE International Syposium on Industrial Electronics, Seoul, Korea, 2009, 205--210.Google ScholarGoogle Scholar
  18. Richman, J. B. and Dyre, B. P., Peripheral Visual Stimulation Benefits Heading Perception during Active Control in Human Factors and Ergonomics Society Annual Meeting, (1999), 1411.Google ScholarGoogle Scholar
  19. Schmidt, M., Rudolph, M., Werther, B. and Furstenau, N., Remote airport tower operation with augmented vision video panorama HMI. in 2nd International Conference Research in Air Transportation, (2006), 221--230.Google ScholarGoogle Scholar
  20. Shum, H. Y. and Szeliski, R. Panormic image mosaics Microsoft Research Technical Report, 1997.Google ScholarGoogle Scholar
  21. Stratton, G. M. Some preliminary experiments on vision without inversion of the retinal image. Psychology Review, 3, 6 (1896), 611--617.Google ScholarGoogle ScholarCross RefCross Ref
  22. Sun, X., Foote, J., Kimber, D. and Manjunath, B. S. Panoramic video capturing and compressed domain virtual camera control Proceedings of the ninth ACM international conference on Multimedia, ACM, Ottawa, Canada, 2001, 329--347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Szeliski, R. Image mosaicing for tele-reality applications DEC and Cambridge Research Lab Technical Report, 1994.Google ScholarGoogle Scholar
  24. Tang, W.-K., Wong, T.-T. and Heng, P. A. A system for real-time panorama generation and display in teleimmersive applications. Multimedia, IEEE Transactions on, 7, 2 (2005), 280--292. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Vincent, L. Taking Online Maps Down to Street Level. Computer, 40, 12 (2007), 118--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Waller, D., Loomis, J. M., Golledge, R. G. and Beall, A. C. Place learning in humans: The role of distance and direction information. Spatial Cognition and Computation, 2, 4 (2000), 333--354. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Welch, R. B. Discriminative conditioning of prism adaptation. Perception and Psychophysics, 10, (1971), 90--92.Google ScholarGoogle ScholarCross RefCross Ref
  28. Xiong, Y. and Turkowski, K., Creating image-based VR using a self-calibrating fisheye lens. in IEEE Computer Society on Computer Vision and Pattern Recognition, (1997), 237--243. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The impact of three interfaces for 360-degree video on spatial cognition

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      May 2012
      3276 pages
      ISBN:9781450310154
      DOI:10.1145/2207676

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 May 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader