Abstract
Recently, numerous prototypes of user interfaces have been presented that are based on interpretation of non-verbal sounds produced by the users, such as humming, whistling, or hissing. These sounds can be characterized by numerous properties, such as pitch, volume, or timbre. The user may intentionally change these properties while producing the sound. The properties (or their profiles over time) can be mapped to different actions. In order to trigger an action or modify an input value, the user produces a corresponding acoustic gesture.
- S. Al-Hashimi. Blowtter: A voice-controlled plotter. In Proceedings of HCI 2006 Engage, The 20th BCS HCI Group conference in co-operation with ACM, vol. 2, London, England, September 2006.Google Scholar
- J. A. Bilmes, X. Li, J. Malkin, K. Kilanski, R. Wright, K. Kirchhoff, A. Subramanya, S. Harada, J. A. Landay, P. Dowden, and H. Chizeck. The Vocal Joystick: A voice-based human-computer interface for individuals with motor impairments. In Human Language Technology Conf./Conf. on Empirical Methods in Natural Language Processing, October 2005. Google ScholarDigital Library
- P. Hämäläinen, T. Mäki-Patola, V. Pulkki, and M. Airas. Musical computer games played by singing. In G. Evangelista and I. Testa, editors, Proceedings of 7th International Conference on Digital Audio Effects, Naples, Italy, pages 367--371, 2004.Google Scholar
- T. Igarashi and J. F. Hughes. Voice as sound: using non-verbal voice input for interactive control. In UIST'01: Proc 14th Annual ACM Symp on User Interface Software and Technology, pages 155--156, New York, NY, USA, 2001. ACM Press. Google ScholarDigital Library
- MIDI Manufacturers Association. Complete MIDI 1.0 Detailed Specification. March 1996.Google Scholar
- A. Sporka, S. H. Kurniawan, M. Mahmud, and P. Slavik. Non-speech input and speech recognition for real-time control of computer games. In The Proceedings of The Eighth International ACM SIGACCESS Conference on Computers & Accessibility, ASSETS 2006, Portland, Oregon. ACM, 2006. Google ScholarDigital Library
- A. J. Sporka, S. H. Kurniawan, and P. Slavík. Accoustic control of mouse pointer. Universal Access in the Information Society, 4(3): 237--245, 2006. Google ScholarDigital Library
- A. J. Sporka, S. H. Kurniawan, and P. Slavík. Non-speech operated emulation of keyboard. In J. Clarkson, P. Langdon, and P. Robinson, editors, Cambridge Workshop on Universal Access and Assistive Technology, CWUAAT 2006. Designing Accessible Technology, pages 145--154. Springer-Verlag London Ltd, 2006.Google Scholar
Index Terms
- Pitch in non-verbal vocal input
Recommendations
Non-Verbal Auditory Input for Controlling Binary, Discrete, and Continuous Input in Automotive User Interfaces
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsUsing auditory input while driving is becoming increasingly popular for making distraction-free inputs while driving. However, we argue that auditory input is more than just using speech. Thus, in this work, we explore using Non-Verbal Auditory Input (...
Vocal manipulation based on pitch transcription and its application to interactive entertainment for karaoke
HAID'11: Proceedings of the 6th international conference on Haptic and audio interaction designA real-time vocal manipulation system is described for improving karaoke. Karaoke is an interactive entertainment system where users sing along with recorded music, and it is used all over the world. However, although the users should sing with accurate ...
The vocal chorder: empowering opera singers with a large interactive instrument
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWith The Vocal Chorder, a large interactive instrument to create accompaniment, opera singers can get more power over the performance. The device allows performers to interactively accompany themselves through pushing, leaning on and bending steel ...
Comments