skip to main content
research-article

Feel Effects: Enriching Storytelling with Haptic Feedback

Published:29 September 2014Publication History
Skip Abstract Section

Abstract

Despite a long history of use in communication, haptic feedback is a relatively new addition to the toolbox of special effects. Unlike artists who use sound or vision, haptic designers cannot simply access libraries of effects that map cleanly to media content, and they lack even guiding principles for creating such effects. In this article, we make progress toward both capabilities: we generate a foundational library of usable haptic vocabulary and do so with a methodology that allows ongoing additions to the library in a principled and effective way. We define a feel effect as an explicit pairing between a meaningful linguistic phrase and a rendered haptic pattern. Our initial experiment demonstrates that users who have only their intrinsic language capacities, and no haptic expertise, can generate a core set of feel effects that lend themselves via semantic inference to the design of additional effects. The resulting collection of more than 40 effects covers a wide range of situations (including precipitation, animal locomotion, striking, and pulsating events) and is empirically shown to produce the named sensation for the majority of our test users in a second experiment. Our experiments demonstrate a unique and systematic approach to designing a vocabulary of haptic sensations that are related in both the semantic and parametric spaces.

References

  1. S. Brewster and L. Brown. 2004. Tactons: Structured tactile messages for non-visual information display. In Proceedings of the 5th ACM Conference on Australasian User Interfaces. 15--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. L. Brunet, C. Megard, S. Paneels, G. Changeon, J. Lozada, M. P. Daniel, and F. Darses. 2013. Invitation to the voyage: The design of tactile metaphors to fulfill occasional travelers needs in transportation networks. In Proceedings of the IEEE World Haptics Conference. 259--264.Google ScholarGoogle Scholar
  3. C. Collins. 1970. Tactile television: Mechanical and electrical image projection. IEEE Transactions on Man-Machine Systems. 65--71.Google ScholarGoogle ScholarCross RefCross Ref
  4. F. Danieau, J. Fleureau, P. Guillotel, N. Mollet, A. Lecuyer, and M. Christie. 2012. HapSeat: Producing motion sensation with multiple force-feedback devices embedded in a seat. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology. 69--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Enriquez, K. Maclean, and C. Chita. 2003. The hapticon editor: A tool in support of haptic communication research. In Proceedings of the 11th IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 356. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Enriquez, K. Maclean, and C. Chita. 2006. Haptic phonemes: Basic building blocks of haptic communication. In Proceedings of the 8th International Conference on Multimodel Interfaces. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. R. Gault. 1927. Hearing through the sense of organs of touch and vibration. Journal of the Franklin Institute 204 (1927), 329--358.Google ScholarGoogle ScholarCross RefCross Ref
  8. E. Gunther and S. O'Modhrain. 2003. Cutaneous grooves: Composing for the sense of touch. Journal of New Music Research 32 (2003), 369--381.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Haans and W. Ijsselsteijn. 2006. Mediated social touch: A review of current research and future directions. Virtual Reality 9 (2006), 149--159. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Israr and I. Poupyrev. 2011. Tactile brush: Drawing on skin with a tactile grid display. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. 2019--2028. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Israr, I. Poupyrev, C. Ioffreda, J. Cox, N. Gouveia, H. Bowles, A. Brakis, B. Knight, K. Mitchell, and T. Williams. 2011. Surround haptics: Sending shivers down your spine. In ACM SIGGRAPH 2011 Emerging Technologies. 14:1--14:1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Jonas. 2008. Tactile Editor: A Prototyping Tool to Design and Test Vibrotactile Patterns. Technical Report. RWTH Aachen University.Google ScholarGoogle Scholar
  13. S. Kim, A. Israr, and I. Poupyrev. 2013. Tactile rendering of 3D features on Touch Surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. 531--538. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. R. Klatzky and J. Peck. 2012. Please touch: Object properties that invite touch. IEEE Transactions on Haptics 5 (2012), 139--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Linville and J. Bliss. 1966. A direct translation reading aid for the blind. Proceedings of the IEEE 54 (1966), 40--51.Google ScholarGoogle ScholarCross RefCross Ref
  16. J. Lyons. 1977. Semantics. Cambridge University Press.Google ScholarGoogle Scholar
  17. K. Maclean and M. Enriquez. 2003. Perceptual design of haptic icons. In Eurohaptics.Google ScholarGoogle Scholar
  18. G. Miller. 1995. WordNet: A lexical database for english. Communications of the ACM 38, 11 (1995), 39--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. C. O'Sullivan and A. Chan. 2006. An activity classification for vibrotactile phenomena. In Haptic and Audio Interaction Design. Lecture Notes in Computer Science. Vol. 1429. 145--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Sahami, P. Holleis, A. Schmidt, and J. Häkkilä. 2008. Rich tactile output on mobile devices. In Proceedings of the European Conference on Ambient Intelligence. Springer Verlag, Berlin, 210--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. K. Schuler. 2005. Verbnet: A Broad-Coverage, Comprehensive Verb Lexicon. Ph.D. dissertation. University of Pennsylvania, Philadelphia, PA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. R. Sodhi, I. Poupyrev, M. Glisson, and A. Israr. 2013. AIREAL: Interactive tactile experiences in free air. ACM Transactions on Graphics 32, 134 (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. H. Tan and A. Pentland. 2001. Tactual displays for sensory substitution and wearable computers. In Fundamentals of Wearable Computers and Augmented Reality. W. Barfield and T. Caudell, Eds. Lawrence Erlbaum Associates, 579--598.Google ScholarGoogle Scholar
  24. D. Tsetserukou, A. Neviarouskaya, H. Prendinger, N. Kawakami, and S. Tachi. 2009. Affective haptics in emotional communication. In Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. 1--6.Google ScholarGoogle Scholar
  25. S. Yohanan and K. Maclean. 2012. The role of affective touch in human-robot interaction: Human intent and expectations in touching the haptic creature. International Journal of Social Robotics 4 (2012), 163--180.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Feel Effects: Enriching Storytelling with Haptic Feedback

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Applied Perception
            ACM Transactions on Applied Perception  Volume 11, Issue 3
            Special Issue SAP 2014
            October 2014
            86 pages
            ISSN:1544-3558
            EISSN:1544-3965
            DOI:10.1145/2663596
            Issue’s Table of Contents

            Copyright © 2014 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 29 September 2014
            • Received: 1 June 2014
            • Accepted: 1 June 2014
            Published in tap Volume 11, Issue 3

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader