Geert Lugtenberg
Hirokazu Kato
ABSTRACT
By means of augmented reality (AR) systems it has become increasingly easy to manipulate our perception of real objects. In this position paper we review existing work that changes physical property perception, and propose methods for changing perceived object density during haptic interaction. Our goal is to modulate the sound emitted by an object when touched. We hypothesize that augmented sound can make people think that an object is hollow or solid regardless of its actual object density. We describe an experiment to validate this hypothesis. Participants tap a hollow or solid cube and are asked to determine if it is hollow or solid, based on the multimodal feedback.
This research is a first step towards an AR system that can alter multimodal perception of object physical properties, and open doors for related research.
- A. Charpentier. Experimental Study of Some Aspects of Weight Perception. Archives de Physiologie Normales Pathologiques, 3:122--135, 1981.Google Scholar
- D. E. DiFranco, G. L. Beauregard, and M. A. Srinivasan. The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments. In Proceedings of the ASME Dynamic Systems and Control Division, volume 61, pages 17--22, 1997.Google Scholar
- T. Hachisu, M. Sato, S. Fukushima, and H. Kajimoto. Augmentation of Material Property by Modulating Vibration Resulting from Tapping. In Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, pages 173--180, 2012. Google ScholarDigital Library
- S. Hashiguchi, Y. Sano, F. Shibata, and A. Kimura. RV Dynamics Illusion: Psychophysical Influence on Sense of Weight by Mixed-Reality Visual Stimulation of Moving Objects. In Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, pages 55--64, 2014. Google ScholarDigital Library
- Y. Hirano, A. Kimura, F. Shibata, and H. Tamura. Psychophysical Influence of Mixed-Reality Visual Stimulation on Sense of Hardness. In Proceedings of IEEE Virtual Reality, pages 51--54, 2011. Google ScholarDigital Library
- M. Kagimoto, A. Kimura, F. Shibata, and H. Tamura. Analysis of Tactual Impression by Audio and Visual Stimulation for User Interface Design in Mixed Reality Environment. In Proceedings of the International Conference on Virtual and Mixed Reality, pages 326--335, 2009. Google ScholarDigital Library
- T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, and M. Hirose. Augmented Reality Flavors: Gustatory Display Based on Edible Marker and Cross-modal Interaction. In Proceedings of Human Factors in Computing Systems, pages 93--102. ACM, 2011. Google ScholarDigital Library
- P. Punpongsanon, D. Iwai, and K. Sato. SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 21(11):1279--1288, 2015. Google ScholarDigital Library
- N. Rosa, W. Hürst, W. Vos, and P. Werkhoven. The Influence of Visual Cues on Passive Tactile Sensations in a Multimodal Immersive Virtual Environment. In Proceedings of the A CM International Conference on Multimodal Interaction, pages 327--334, 2015. Google ScholarDigital Library
- K. Van Den Doel, P. G. Kry, and D. K. Pai. FoleyAutomatic: Physically-based Sound Effects for Interactive Simulation and Animation. In Proceedings of A CM Computer Graphics and Interactive Techniques, pages 537--544, 2001. Google ScholarDigital Library
Index Terms
- Changing perception of physical properties using multimodal augmented reality: position paper
Recommendations
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
(Re-)examination of multimodal augmented reality
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityThe majority of augmented reality (AR) research has been concerned with visual perception, however the move towards multimodality is imminent. At the same time, there is no clear vision of what multimodal AR is. The purpose of this position paper is to ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Comments