Abstract
Multimedia is a must-have for almost every person in daily life nowadays, but the truth is that most of the existing ways of enjoying multimedia sources are limited to listening to music or watching videos. In pursuit of the next-level experience, multimodal or multisensory entertainment has arisen in recent years, yet most of which involves special equipment and are designed for extremely limited scenarios that makes them hard to reach the populace. In this article, we propose a software-based, device-independent way to interact with audio contents on the smartphones involving another human sense besides hearing and vision, which is tactile sensation. We provide a system prototype, called MuViT, an adaptive musical vibrotactile system that allows users to feel the vibrations only by holding their phones while playing multimedia contents. The system is designed as a mobile application so that users can easily obtain and use it, and it’s designed to adapt most of the popular multimedia applications found in apps market, such as YouTube and Apple Music. Furthermore, the system is fully open source on GitHub, so that interested individuals are welcomed to further tap its potential.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mazzoni, A., Bryan-Kinns, N.: Mood glove: a haptic wearable prototype system to enhance mood music in film. Entertainment Comput. 17, 9–17 (2016)
Lin, X., Mahmud, S.: Virtual reality-based musical therapy for mental health management. In: Chakrabarti, S., Paul, R. (eds.) Computing and Communication Workshop and Conference (CCWC) 2020, pp. 948–952. IEEE, Las Vegas (2020)
Elvezio, C., Amelot, P.: Hybrid UIs for music exploration in AR and VR. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) 2020, pp. 411–412. IEEE, Munich (2018)
Kobayashi, N., Matsumoto, M.: Music learning support system using blocks. In: Matsuo, T., Takamatsu, K. (eds.) 12th International Congress on Advanced Applied Informatics (IIAI-AAI) 2022, pp. 164–169. IEEE, Kanazawa (2020)
Nanayakkara, S., Taylor, E.: An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 337–346. ACM (2009)
Hayes, L.: Skin music (2012): an audio-haptic composition for ears and body. In: Proceedings of the Conference on Creativity and Cognition, pp. 359–360. ACM, Glasgow (2015)
Hwang, I., Lee, H., Choi, S.: Real-time dual-band haptic music player for mobile devices. IEEE Trans. Haptics 6(3), 340–351 (2013)
Project’s GitHub Repository. https://github.com/henryyantq/MuViT. Accessed 6 Oct 2022
Merchel, S., Altinsoy, M.E.: Auditory-tactile experience of music. In: Papetti, S., Saitis, C. (eds.) Musical Haptics. SSTHS, pp. 123–148. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-58316-7_7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yan, T., Liu, Y. (2023). An Adaptive Musical Vibrotactile System (MuViT) for Modern Smartphones. In: Zhai, G., Zhou, J., Yang, H., Yang, X., An, P., Wang, J. (eds) Digital Multimedia Communications. IFTC 2022. Communications in Computer and Information Science, vol 1766. Springer, Singapore. https://doi.org/10.1007/978-981-99-0856-1_32
Download citation
DOI: https://doi.org/10.1007/978-981-99-0856-1_32
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-0855-4
Online ISBN: 978-981-99-0856-1
eBook Packages: Computer ScienceComputer Science (R0)