Abstract
This chapter presents embedded implementations of two audio array processing algorithms for a telepresence application as usage examples of the hArtes tool-chain and platform.
The first algorithm, multi-channel wide-band beamforming, may be used to record an acoustic field in a room with an array of microphones, the second one, wave-field synthesis, to render an acoustic field with an array of loudspeakers. While these algorithms have parallelisms and kernel functions typical for their algorithm class, they are chosen to be simple in structure, which makes it easier to follow implementation considerations.
Starting from an overview of the application and structure of the algorithms in question, several implementations on different levels of hardware abstraction are presented, along with empirical results on both the design process supported and the processing performance achieved.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
During the project, in fact the opposite direction was adopted in order to obtain a technical understanding of the DSP architecture and software platform in order to understand the requirements for the hArtes tools.
- 2.
In the measurements in Fig. 4.12, outliers were attributed to scheduling.
References
Beracoechea, J.A., Torres-Guijarro, S., GarcÃa, L., Casajús-Quirós, F.J.: On building immersive audio applications using robust adaptive beamforming and joint audio-video source localization. EURASIP J. Appl. Signal Process. 2006, 40960 (2006), 12 pp.
Heinrich, G., Leitner, M., Jung, C., Logemann, F., Hahn, V.: A platform for audiovisual telepresence using model- and data-based wave-field synthesis. In: Proc. 125th Convention of the AES, San Francisco, Oct. 2008
Lombard, M., Jones, M.T.: Identifying the (tele)presence literature. PsychNology 5(2), 197–206 (2007)
Lombard, M., Jones, M.T.: Defining presence. In: Biocca, F., Ijsselsteijn, W.A., Freeman, J., Lombard, M. (eds.) Immersed in Media: Telepresence Theory, Measurement and Technology. Routledge, London (2011, in press)
Mabande, E., Schad, A., Kellermann, W.: Robust superdirectional beamforming for hands-free speech capture in cars. In: Proc. NAG/DAGA Int. Conf. on Acoustics, Rotterdam, Netherlands, March 2009
Parra, L.C.: Steerable frequency-invariant beamforming for arbitrary arrays. J. Acoust. Soc. Am. 119(6), 3839–3847 (2006)
Rabenstein, R., Spors, S.: Spatial sound reproduction with wave field synthesis. In: Proc. Cong. Ital. Sect. of the AES, Como, Italia, Nov. 2005
Shinoda, K., Mizoguchi, H., Kagami, S., Nagashima, K.: Visually steerable sound beamforming method possible to track target person by real-time visual face tracking and speaker array. In: Proc. IEEE Int. Conf. Systems, Man and Cybernetics, vol. 3, pp. 2199–2204 (2003)
van Veen, B., Buckley, K.M.: Beamforming: a versatile approach to spatial filtering. IEEE ASSP Mag. 5, 4–24 (1988)
Verheijen, E.: Sound reproduction by wave field synthesis. Ph.D. thesis, TU Delft (1998)
Ward, D.B.: Theory and application of wide-band frequency invariant beamforming. Ph.D. thesis, Australian National University (1996)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media B.V.
About this chapter
Cite this chapter
Heinrich, G., Logemann, F., Hahn, V., Jung, C., de Figueiredo Coutinho, J.G., Luk, W. (2012). Audio Array Processing for Telepresence. In: Bertels, K. (eds) Hardware/Software Co-design for Heterogeneous Multi-core Platforms. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-1406-9_4
Download citation
DOI: https://doi.org/10.1007/978-94-007-1406-9_4
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-1405-2
Online ISBN: 978-94-007-1406-9
eBook Packages: EngineeringEngineering (R0)