Sebastian Heise
Jörn Loviscach
ABSTRACT
Finding a specific or an artistically appropriate sound in a vast collection comprising thousands of audio files containing recordings of, say, footsteps, gunshots, and thunderclaps easily becomes a chore. To improve on this, we have developed an enhanced auditory and graphical zoomable user interface that leverages the human brain's capability to single out sounds from a spatial mixture: The user shines a virtual flashlight onto an automatically created 2D arrangement of icons that represent sounds. All sounds within the light cone are played back in parallel through a surround sound system. A GPU-accelerated visualization facilitates identifying the icons on the screen with acoustic items in the dense cloud of sound. Test show that the user can pick the "right" sounds more quickly and/or with more fun than with standard file-by-file auditioning.
- Bederson, B. and Meyer, J. Implementing a zooming user interface: experience building Pad++. Softw. Pract. Exper. 28, 10 (1998), 1101--1135. Google Scholar
Digital Library
- Bregman, A.S. Auditory Scene Analysis. MIT Press, Cambridge, MA, USA, 1990.Google ScholarCross Ref
- Cooper, M., Foote, J., Pampalk, E. and Tzanetakis, G. Visualization in audio-based music information retrieval. Comput. Music J. 30 (2006), 42--62. Google ScholarDigital Library
- Downie, J.S. The music information retrieval evaluation exchange (2005-2007): a window into music information retrieval research. Acoust. Sci. & Tech. 29, 4 (2008), 247--255.Google Scholar
- Fernström, M. Reflections on Sonic Browsing: comments on Fernström and McNamara, ICAD 1998. ACM Trans. Appl. Perception 2, 4 (2005), 500--504. Google ScholarDigital Library
- Heise, S., Hlatky, M. and Loviscach, J., SoundTorch: quick browsing in large audio collections. In Proc. 125th Convention of the Audio Engineering Society (2008), Paper 7544.Google Scholar
- Heuten, W., Henze, N. and Boll, S. Interactive exploration of city maps with auditory torches. In CHI 2007 Interactivity, 1959--1964. Google ScholarDigital Library
- Magnusson, T. Screen-based musical interfaces as semiotic machines. In Proc. NIME 2006, 162--166. Google ScholarDigital Library
- Schmandt, C. Audio hallway: a virtual acoustic environment for browsing. In Proc. UIST 1998, 163--170. Google ScholarDigital Library
- Schwarz, D., Britton, S., Cahen, R. and Goepfer, Th. Musical applications of real-time corpus-based concatenative synthesis. In Proc. ICMC 2007, 47--50.Google Scholar
- Stewart, R., Levy, M. and Sandler, M. 3D interactive environment for music collection navigation, In Proc. DAFx-08, 13--17.Google Scholar
- Streich, S. and Ong, B.S. A music loop explorer system. In Proc. ICMC 2008.Google Scholar
Index Terms
- Aurally and visually enhanced audio search with soundtorch
Recommendations
Visually-Guided Audio Spatialization in Video with Geometry-Aware Multi-task Learning
AbstractBinaural audio provides human listeners with an immersive spatial sound experience, but most existing videos lack binaural audio recordings. We propose an audio spatialization method that draws on visual information in videos to convert their ...
Leveraging behavioral models of sounding objects forgesture-controlled sound design
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interactionSound designers and Foley artists have long struggled to create expressive soundscapes using standard editing software, devoting much time for the calibration of multiple sound samples and parameter adjustments. We present an intuitive approach that ...
Sound Design Impacts User Experience and Attention in Serious Game
Serious GamesAbstractWe study the impact of sound design – soundscape, sound effects, and auditory notifications, namely earcons – on the player’s experience of serious games. Three sound design versions for the game Venci’s Adventures have been developed: 1) no sound;...
Comments